Senior Etl Consultant Resume
Cypress, CA
SUMMARY:
- 7 years of experience in the field of Information Technology with expertise in analysis, design, development and maintenance of Enterprise Data Warehouse and Business Intelligence applications.
- Strong experience in analysis, design, implementation and testing activities of Enterprise Data warehouse and Business Intelligence applications.
- Extensive experience in working with large datasets and coherent with Data Ingestion, Acquisition, Integration, Transformation and Aggregation
- Hands - on experience in designing and developing ETL processes with traditional ETL tools DataStage, Talend .
- Extensive experience in working with MPP database Netezza and Teradata
- Hands-on experience in working with relational databases Oracle, MS SQL Server and DB2
- Over 7 years of experience in design & implementation of SQL queries , PL/SQL packages.
- Strong understanding of Data warehouse principles and methodologies - Ralph Kimball/Bill Inman. Experienced with designing and implementing star and snow flake schemas.
- Hands-on experience with DW and BI modelling concepts - Conceptual Data Modelling, Logical Data Modelling, Physical Data Modelling, Metadata and Master Data Management .
- Strong knowledge & experience in UNIX shell scripting and Perl scripting .
- Hands-on experience with Job scheduling tools Autosys & TWS .
- Familiar with Big Data technologies Hadoop, Spark, Oozie, Pig, Hive .
- Experienced in design and development of common re-usable ETL components to define audit processes, Job monitoring and error logging processes.
- Strong hands on experience using Teradata utilities ( SQL, B-TEQ, Fast Load, MultiLoad, FastExport, Tpump )
- Experienced in using advance datastage plug in stages like XML input and XML output .
- Experienced in working with SOA environment and familiar in using MQ Connector stage
- Hands-on experience in troubleshooting production issues and performance tuning of ETL jobs
- Over 7 years of working experience in health care domain
- Familiarity in using the service management and IT governance tools ( HP Open View Service Desk, HPSM, HPQC and HP ITG )
- Efficient in creating source to target mappings (ETL Mapping) from various source systems into target EDW (Enterprise Data warehouse) and documenting design specifications.
- Strong understanding of SDLC and Agile Methodologies
- Strong Analytical and Problem Solving Skills. Can quickly adapt to a changing environment.
SKILL:
ETL Tool: IBM Web Sphere Datastage v.7.5, IBM Info Sphere Information Server 8.5, 8.7, 9.1.2, 11.1
Databases: Oracle 10g/9i, Teradata 13.1, DB2, Netezza, MS SQL Server 2000
Environment: IBM AIX 5.3, AIX 6.1, Linux, Windows Xp/7
Others: SQL Plus, SQL*Loader, TOAD, HPSD Open View, HPSM, Autosys 4.5, Tivoli Workload Scheduler, HPQC
WORK EXPERIENCE:
Confidential, Cypress, CA
Senior ETL Consultant
Responsibilities:
- Involved in understanding of business processes and coordinated with business analysts to get specific user requirements.
- Designed and developed jobs that extract data from the source databases using DB connectors Oracle, DB2 and Teradata.
- Designed and developed jobs that read the data from diverse sources such as flat files, XML files, and MQs.
- Created job parameters, parameter sets and shared containers.
- Consistently used Transformer, Modify, Copy, Join, Funnel, Aggregator, Lookup stages and other processing stages to develop parallel jobs.
- Experienced in development and debugging of jobs using stages like Peek, Head & Tail Stage, Column generator stage, Sample Stage.
- Generated Surrogate Keys for composite attributes while loading the data into the data warehouse.
- Imported Metadata from the source database. Imported metadata definitions into the repository. Exported and imported Data Stage components.
- Extracted data from multiple sources like Mainframes and from different databases like Teradata, DB2 etc. Made the required transformations as per business and loaded the data into target which is DB2.
- Developed Job Sequencers and batches, edited the job control to have jobs run in sequence.
- Performed troubleshooting and tuning of Data Stage Jobs for better performance.
- Involved in creating SQL queries, performance tuning and creation of indexes.
- Extensively used materialized views for designing fact tables.
- Ensured that operational and analytical data warehouses are able to support all business requirements for business reporting.
- Developed Unix shell scripts and part of Perl scripts for controlled execution of Datastage jobs
- Extensively designed jobs in TWS scheduler for execution of the jobs in sequence
- Participated in DataStage Design and Code reviews.
- Worked in Agile/Scrum environment.
- Documented ETL test plans, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing and error handling
Environment: IBM Information server DataStage 9.1.1, Teradata 13.1.1, AIX 5.3, AIX 6.1, Linux 2.6.18, Oracle 10g, TWS, DB2, TOAD, SQL Plus, HPSM.
Confidential
Senior ETL Developer
Responsibilities:
- Extensively used Datastage Designer and Teradata to build the ETL process which pulls the data and does the grouping techniques in job design.
- Developed master jobs (Job Sequencing) for controlling flow of both parallel & server Jobs.
- Good knowledge in parameterizing the variables rather than hardcoding directly, Used Director widely for monitoring the job flow and processing speed.
- Based on the above analysis did performance tuning for improving job processing speed.
- Developed Autosys jobs for scheduling the Jobs. These job includes Box jobs, Command jobs, file watcher jobs and creating ITG requests.
- Closely monitor schedules and look into the failures to complete all ETL/Load processes within the SLA.
- Designed and developed SQL scripts and extensively used Teradata utilities like BTEQ scripts, FastLaod, MultiLoad to perform bulk database loads and updates.
- After Completing ETL activities corresponding load file will be sent to Cube team for building Cubes.
- Created spec doc’s for automating the manual processes.
- Closely work with On-shore people and Business people to resolve critical issues occurred during load process.
- Later all the Confidential jobs were migrated from Autosys to TWS, we were involved in end to end migration process and migrated successfully.
Environment: DataStage 8.5, Linux 2.5, Oracle 10g, Teradata 13.1.1, TWS maestro, TOAD, SQL*Loader, SQL Plus, SQL, HPSM, Mercury ITG
Confidential
Senior ETL Developer
Responsibilities:
- Was been part of Data modelling, used Erwin tool to build the architecture.
- Has written Job Control routines to invoke one DS job from another. Also designed a custom BuildOp stage to suit our project requirements, which was reused in the jobs designed.
- Used the Administrator to set the environmental variables and user defined variables for different environments for different projects
- Incorporated error handling in job designs using error files and error tables to log error containing data discrepancies to analyse and re-process the data.
- Designed wrapper Unix shell scripts to invoke the DS Jobs from Command line
- Developed the TWS schedules & Jobs to schedule the running of jobs
- Job Parameters were extensively used to parameterize the jobs.
- Troubleshooting the technical issues aroused during the load cycle
- Used Cognos to provide the reporting data to business
- Implemented enhancements to the current ETL programs based on the new requirements.
- Involved in all phases of testing and effectively interacted with testing team.
- Documented ETL high level design and detail level design documents.
Environment: IBM DataStage 8.5, Teradata 13.1.1, DB2, Linux 2.6, Oracle 10g, TWS, DB2, Netezza, TOAD, SQL*Loader, SQL Plus, SQL, HPSM, Mercury ITG
