Etl Developer Resume
4.00/5 (Submit Your Rating)
Chicago, IL
PROFESSIONAL SUMMARY:
- 5 years of IT experience specializing in Analysis, Design and Development of ETL processes in different phases of the Data Warehousing life cycle.
- Knowledge in OLAP and OLTP, Dimensional modeling using Star schema and Snowflake schema.
- Extensively worked in Extraction/Transformation/Loading of the legacy data to Data warehouse using IBM Websphere Datastage (8.5, 8.1,7.5)including Designer, Director and Administrator.
- Worked on databases Oracle 8i/9i/10g/11g, SQL Server, Teradata and Netezza.
- Experienced in Ralph Kimball’s methodology and Bill Inmon’s approaches.
- Involved in daily interactions with the Business team to understand the requirements.
- Extensively worked on performance tuning of Datastage jobs using best IBM standards by identifying and resolving performance bottlenecks at various levels.
- Extensively used SQL to write ETL and ELT scripts.
- Expertise in developing and maintaining overall Test Methodology and Strategy, Documenting Test Plans, Test Cases and editing, executing Test Cases and Test Scripts.
- Good experience in maintaining the versioning and deployment instruction documents while moving the code to various environments.
- Extensively worked with production support team to resolve issues and worked in extracting data from Oracle, XML and flat files.
- Hands on Experience in data extraction & validation in SQL and UNIX Shell Scripting.
- Good exposure to development, testing, debugging, implementation, documentation, user training & production support.
- Resolved data issues, completed unit testing and system documentation for ETL processes
- Comprehensive knowledge in Conceptual, Logical and Physical Data modeling concepts.
- Experience on Creating detailed project outlines and application design specifications.
- Knowledge on tools such as IBM Cognos 8 (Framework Manager, Report Studio, Query Studio)
- Knowledge on creating reports in Report Studio and Query Studio using IBM Cognos 8
- Solid knowledge in Informatica Powercentre 9.x/8.x/7.x
- Ability to quickly analyze and develop an industry standard solution for a given problem.
- Excellent communication skills, problem solving skills, Leadership qualities and an attitude to learn new cutting edge technologies.
- Expertise in using HP Quality Center for defect tracking management.
- Having sound knowledge on using version control systems like CLEARCASE and VSS.
TECHNICAL SKILLS:
- ETL tools: InfoSphere Datastage Enterprise Edition 8.5/8.1/8.0/7.5, Server Edition.
- Data Modeling: Erwin 4.1/3.5, ER/Studio 3.5, Microsoft Visio 2000
- Databases : Oracle 11g/9i, Netezza, Teradata, MS SQL Server 2000
- GUI: TWS, Autosys, Control-M, Toad, Oracle SQL Developer, Teradata SQL Assistant, Aginity Netezza Workbench.
- Programming: UNIX Shell Script, XML, SQL and PL/SQL
- Tracking Tool: HPQC, JIRA, Pacman
- Version Control : Vss and Clear case
PROFESSIONAL EXPERIENCE:
Client: Confidential, Chicago, IL.
Role: ETL Developer
Environment: DataStage 8.0, Netezza, Teradata, MS SQL Server, UNIX, Control-M, JIRA, Pacman
Period: Jul 2012 – Till Date
Responsibilities
- Developed ETL jobs and ELT process using the Data Stage 8.0.
- Developed SQL scripts and UNIX shell scripts as per the functional and technical specs provided by the client.
- Worked for the migration of reporting database from Netezza to Teradata.
- Designed and modified datastage jobs and Netezza scripts for migration to Teradata.
- Worked extensively with Teradata sql assistant and BTEQ, designed complex teradata sql scripts to be called using datastage job sequences and unix shell scripts.
- Designed complex DataStage Jobs, sequences and tuned them for better performance.
- Responsible for preparing ETL Documentation for the developed processes.
- Extracted data from different source systems (PeopleSoft, Informix, Teradata DB, SLQ Server DB) and moved them into the Netezza warehouse and mart.
- Developed Sequence jobs to call SQL scripts for the ELT process in the Netezza target database.
- Developed UNIX shell scripts to automate the Data Load processes to the Target.
- Responsible for handling Production Support tickets and scheduling Control-M jobs.
- Scheduled the jobs developed as per the time mentioned by the business users and monitor the jobs and fix the issue if there is any job failure.
- Co-ordinated the offshore dev and testing teams.
- Involved in preparing Integration test cases, UAT test cases and involved in UAT testing.
- Involved in tuning many SQL scripts and other ETL processes used in this project.
- Involved in conducting knowledge sharing sessions for end-users, to business and to offshore team members
- Involved in Stream lining the development guide lines for using new Datastage features.
- Responsible for conducting the peer reviews, planning and estimating the project requirements and to report the status to business managers.
Client: Confidential, Columbus, OH.
Role: ETL DataStage Developer
Environment: DataStage 8.5/8.1, Oracle 11g, UNIX, TWS, HP Quality Center
Period: Sep 2010 – Jun 2012
Responsibilities
- Responsible for designing and developing ETL jobs using websphere datastage involving mappings with complex transformation, join and aggregation rules, and with multiple sources and targets in different environments.
- Extensively worked in creating table design and maintained the ETL functional mapping documents.
- Extensively used stages such as Oracle Connector (8.5), Oracle enterprise (8.1), Transformer with loop function, Sparse and Range Lookups, XML input in addition to normally used stages as join, merge, filter, aggregator, funnel, dataset, sequential file etc
- Performed extensive research and implemented the slowly changing dimension logic to suit the project business rules using initial and incremental loads.
- Derived a logic for initial reload of data into the staging table for a scenario to reload data before a past cut off time.
- Derived and implemented a method to capture rejected records from all ETL jobs into a specially designed reject staging table.
- Derived and implemented a method to insert rejected records from previous loads along with new data using staging variables in Transformer stage.
- Designed a Batch_run_history table, and derived and implemented a method to define incremental load start time and load end time, for each table to rollback and run ETL from previous load start time, in case if the job fails..
- Implemented the logic to update the loaded, rejected and unloaded records of the staging table using multiple instance of a single update job
- Developed many complex Job Sequence utilizing user Variable Activity, Terminator Activity, StartLoop, EndLoop, Notification Activity, Routine Activity etc
- Used unix scripts for passing parameters into the Job sequence and also developed Bath run tables to update load start timestamp and load end timestamp.
- Created backup of Datastage project into clearcase software and restored as and when required.
- Used IBM Tivoli Workload Scheduler for scheduling the jobs.
- Responsible for Business Analysis and Requirements Collection to develop ETL to extract data from XML Clob using latest XML Input stages of 8.5 version
- Tuned oracle SQL queries by creating indexes on the key column
- Involved in creating PL/SQL Stored Procedures, Packages, and Triggers for the application, tuning SQL queries and the database.
- Performed tuning on sluggish ETL jobs by introducing manual partitioning, reducing stages, tuning Source and Target SQL queries, creating indexes on tables etc.
Confidential
Role: Junior Engineer
Environment: Datastage server, Oracle9i, Windows 2000, SQL, Toad, Primavera ERP
Period: Sep 2004- Jun 2007
Responsibilities:
- Involved in building a datawarehouse model as per the specific requirements of the business.
- Involved in creating table structures for the staging and target database according to the BI concept.
- Involved in the analysis of physical data model for ETL and the process flow diagrams.
- Developed PL/SQL procedures, SQL Scripts, and SQL*Loader control files for creating a development database.
- Created data governance strategies that reduced data redundancy wherever possible.
- Involved in integrating Primavera ERP informations with oracle database.
- Good experience using Datastage server edition for ETL mapping.
- Developed mappings to load data in slowly changing dimensions.
- Created and maintained ETL documentation that supported business rules and detailed source to target data mappings.
- Prepared production support documents, monitored production jobs, resolved data issues
- Investigated and assisted users in the resolution of any day-to-day data warehouse issues.
EDUCATION:
- Bachelor of Engineering - Confidential, India. (May 2004)
- Master Of Science - Confidential, Lubbock, TX. (Dec 2009)