Etl Data Stage Developer Resume
Boston, MA
SUMMARY:
- Over 9 years of Dynamic career reflecting pioneering experience and high performance in System Analysis, design, development and implementation of Relational Database and Data Warehousing Systems using IBM Data Stage 11.x/9.x/8.x/7.x Server Edition and Enterprise Edition (Info Sphere Information Server, Web Sphere, Ascential Data Stage), Informatica 10.1,9.1,8.6.1, SSIS 2008,2010
- Experience in Designing, Developing, Documenting, Testing of ETL jobs and mappings in Server and Parallel jobs using Data Stage to populate tables in Data Warehouse and Data marts.
- Proficient in developing strategies for Extraction, Transformation and Loading (ETL) mechanism.
- Expert in designing Parallel jobs using various stages like Join, Merge, Lookup, remove duplicates, Filter, Dataset, Lookup file set, Complex flat file, Modify, Aggregator, XML.
- Expert in designing Server jobs using various types of stages like Sequential file, ODBC, Hashed file, Aggregator, Transformer, Sort, Link Partitioner and Link Collector.
- Experienced in integration of various data sources (DB2 - UDB, SQL Server, PL/SQL, Oracle, Teradata, XML and MS-Access) into data staging area.
- Expert in working with Data Stage Manager, Designer, Administrator, and Director.
- Experience in analyzing the data generated by the business process, defining the granularity, source to target mapping of the data elements, creating Indexes and Aggregate tables for the data warehouse design and development.
- Excellent knowledge of studying the data dependencies using metadata stored in the repository and prepared batches for the existing sessions to facilitate scheduling of multiple sessions.
- Proven track record in troubleshooting of Data Stage jobs and addressing production issues like performance tuning and enhancement.
- Expert in working on various operating systems like UNIX AIX 5.2/5.1, Sun Solaris V8.0 and Windows 2000/NT.
- Proficient in writing, implementation and testing of triggers, procedures and functions in PL/SQL and Oracle.
- Experienced in Database programming for Data Warehouses (Schemas), proficient in dimensional modeling (Star Schema modeling, and Snowflake modeling).
- Experience in using software configuration management tools like Rational Clear case/Clear quest for version control.
- Experienced in Data Modeling as well as reverse engineering using tools Erwin, Oracle Designer and MS Visio, SQL server management studio, SSIS and SSRS and store procedure.
- Expert in unit testing, system integration testing, implementation and maintenance of databases jobs.
- Effective in cross-functional and global environments to manage multiple tasks and assignments concurrently with effective communication skills.
TECHNICAL SKILLS:
ETL Tools: IBM Data Stage 11.x/9.x/8.x/7.x Server Edition and Enterprise Edition, Informatica 9.1,8.6.1, MS SSIS (SQL server 2008)
Databases: Oracle 10g,9i/8i, SQL Server 2010, DB2, Teradata
Development: SQL, Unix Shell Scripting, PL/SQL
Tools: SQL*Plus 3.3/8.0, TOAD, Microsoft Visio, Putty, Text Pad, .csv files, Erwin, ER Model, Salesforce Integration.
Business Intelligence Tools: Business Objects, SSRS(SQL Server 2005),IBM Cognos 8
Scheduling Tools: Tidal, Control M, Autosys
HPUX, IBM: AIX 5.3, Sun Solaris, Red-Hat Linux, MS Access
PROFESSIONAL EXPERIENCE:
Confidential, Boston, MA
ETL Data Stage Developer
Environment: IBM Web Sphere Data Stage 11.1 Parallel Extender, Web Services, Quality Stage, (Designer, Director, Manager), Microsoft Visio, IBM AIX 4.2/4.1, IBM DB2 Database, SQL Server, IBM DB2, Teradata, ORACLE 11G, Query man, Unix, Windows.
Responsibilities:
- Involved as primary on-site ETL Developer during the analysis, planning, design, development, and implementation stages of projects using IBM Web Sphere software (Quality Stage, Web Service, Information Analyzer).
- Prepared Data Mapping Documents and Design the ETL jobs based on the DMD with required Tables in the Dev Environment.
- Active participation in decision making and QA meetings and regularly interacted with the Business Analysts & development team to gain a better understanding of the Business Process, Requirements & Design.
- Used Data Stage as an ETL tool to extract data from sources systems, loaded the data into the ORACLE database.
- Designed and Developed Data Stage Jobs to Extract data from heterogeneous sources, applied transform logics to extracted data and Loaded into Data Warehouse Databases.
- Created Data stage jobs using different stages like Transformer, Aggregator, Sort, Join, Merge, Lookup, Data Set, Funnel, Remove Duplicates, Copy, Modify, Filter, Change Data Capture, Change Apply, Sample, Surrogate Key, Column Generator, Row Generator, Etc.
- Extensively worked with Join, Look up (Normal and Sparse) and Merge stages.
- Extensively worked with sequential file, dataset, file set and look up file set stages.
- Extensively used Parallel Stages like Row Generator, Column Generator, Head, and Peek for development and de-bugging purposes.
- Used the Data Stage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions on ad hoc or scheduled basis.
- Developed complex store procedures using input/output parameters, cursors, views, triggers and complex queries using temp tables and joins.
- Converted complex job designs to different job segments and executed through job sequencer for better performance and easy maintenance.
- Creation of jobs sequences.
- Maintained Data Warehouse by loading dimensions and facts as part of project. Also worked for different enhancements in FACT tables.
- Created shell script to run data stage jobs from UNIX and then schedule this script to run data stage jobs through scheduling tool.
- Coordinate with team members and administer all onsite and offshore work packages.
- Analyze performance and monitor work with capacity planning.
- Performed performance tuning of the jobs by interpreting performance statistics of the jobs developed.
- Documented ETL test plans, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.
- Participated in weekly status meetings.
- Developed Test Plan that included the scope of the release, entrance and exit criteria and overall test strategy. Created detailed Test Cases and Test sets and executed them manually.
Confidential, NY
Sr. Data Stage Developer
Environment: IBM DataStage 11.5, Oracle 10, DB2, SQL Server 2016, Flat Files, UNIX scripting, Windows 2007, and Autosys, Netezza.
Responsibilities:
- Involved with Application and Database Support Teams to maintain system and database which supports current data scenarios and easily adapts to changing business needs.
- Used Parallel Extender extensively by using Processing, Development/Debug, File and Real Time Stages.
- Created DataStage jobs using different stages like Transformer, Aggregator, Sort, Join, Merge, Lookup, Data Set, Funnel, Remove Duplicates, Copy, Modify, Filter, Change Data Capture, Change Apply, Sample, Surrogate Key, Column Generator, Row Generator , Etc.
- Integrated with Hadoop using Big data file stage .
- Involved in creating UNIX shell scripts for database connectivity and executing queries in parallel job execution.
- Developed DataStage jobs using Lookup stage for Range Lookup.
- Created Job parameter sets for reusing the parameters.
- Implemented restart ability in all DataStage sequencers.
- Extensively used Flat File Stage, Hashed File Stage. DB2 UDB Stage, FTP Plug-in Stage and Aggregator Stage during ETL development.
- Documented the Data Warehouse development process and performed knowledge transfer to Business Intelligence Developer.
- Performed performance tuning of the jobs by interpreting performance statistics of the jobs developed.
- Performed unit testing for jobs and scripts to validate the data and prepared jobs checklists to validate the user requirements.
- Scheduled DataStage job using Autosys scheduling tool.
Confidential, Richmond, VA
Sr. ETL/Informatica Developer
Environment: Informatica PowerCenter 9.5, Oracle11g/9i, PL/SQL, Flat files, Facets, XML, Teradata, SQL Server 2012R2, SQL Reporting Services ( SSRS ), SQL Integration Services ( SSIS )
Responsibilities:
- Involved in gathering business requirements and attended technical review meetings to understand the data warehouse model.
- Involved in data modeling and design of data warehouse in star schema methodology with confirmed granular dimensions and Fact tables.
- Developed Technical Specifications of the ETL process flow
- Extensively used ETL to load data from Flat files, SQL Server and Oracle into teradata.
- Developed, deployed, and monitored SSIS Packages and Created Complex ETL Packages using SSIS to extract data from staging tables to partitioned tables with incremental load.
- Created SSIS Reusable Packages to extract data from Multi formatted Flat files, Excel, XML files into UL Database and DB2 Billing Systems.
- Created SSIS Packages using SSIS Designer for export heterogeneous data from OLE DB Source (Oracle), Excel Spreadsheet to SQL Server 2005/2008.
- Performed operations like Data reconciliation, validation and error handling after Extracting data into SQL Server.
- Worked on SSIS Package, DTS Import/Export for transferring data from Database (Oracle and Text format data) to SQL Server.
- Created SSRS reports using Report Parameters, Drop-Down Parameters, Multi-Valued Parameters Debugging Parameter Issues Matrix Reports and Charts.
- Used Informatica Designer to Extract & Transform the data from various source systems by incorporating various business rules. Also used different transformations, sessions and command tasks.
- Created mappings using different transformations like Aggregator, Expression, Stored Procedure, Filter, Joiner, Lookup, Router and Update Strategy.
- Developed PL/SQL triggers and master tables for automatic creation of primary keys.
- Performed SQL and PL/SQL tuning and Application tuning using various tools like EXPLAIN PLAN, SQL*TRACE, TKPROF and AUTOTRACE.
- Developed Advance PL/SQLpackages, procedures, triggers, functions, Indexes and Collections to implement business logic using SQLNavigator. Generated server side PL/SQLscripts for data manipulation and validation and materialized views for remote instances.
- Worked with Teradata data lake.
- Responsible for design and developing Teradata BTEQ scripts, MLOAD based on the given business rules and design documents.
- Experience in Coding Teradata SQL, Teradata Stored Procedures, Macros and Triggers
- Loading the data into Netezza from legacy systems and flat files using complex UNIX scripts. Implemented Slow changing dimensions SCD-1 and SCD-II mappings to upgrade Slowly Changing Dimension Tables.
- Experience in migration Informatica objects from 9.1 to 9.5.
- Experience in Informatica upgrade testing, troubleshoot and resolve issues.
- Created complex mappings in the designer and monitored them. The mappings involved extensive use of Aggregator, Filter, Router, Expression, Joiner, Union, Normalizer and Sequence generator transformations.
- Ran the workflows on a daily and weekly basis using Active Batch Scheduling tool.
- Examined the workflow log files and assigning the ticket to the Informatica support based on the error.
- Experience in developing Unix Shell Scripts for automation of ETL process.
- Performed operational support and maintenance of ETL bug fixes and defects.
- Maintained the target database in the production and testing environments.
- Supported migration of ETL code from development to QA and QA to production environments.
- Designed and developed Unix Shell Scripts, FTP, sending files to source directory & managing session files
- Done extensive testing and wrote queries in SQL to ensure the loading of the data.
- Developed PL/SQL code at the database level for the new objects.
Confidential, Richmond, VA
ETL Informatica Developer
Environment: Informatica PowerCenter 10.1/ 9.1, Oracle 11g/10g, SQLServer2008, PL/SQL, Erwin, XML, UNIX, UDB DB2 8.1, Autosys
Responsibilities:
- Interacted with Business Analysts to understand the requirements and the impact of the ETL on the business.
- Worked with data modellers in preparing logical and physical data models and adding/deleting necessary fields using Erwin .
- Extracted data from flat files and oracle database, applied business logic to load them in the central oracle database.
- Developed mappings/Reusable Objects/Transformation/mapplets by using mapping designer, transformation developer and mapplet designer in Informatica Power Center.
- Created reusable transformations and mapplets and used them in mappings.
- Implemented slowly changing dimensions to maintain current information and history information in dimension tables.
- Involved in creation of Folders, Users , Repositories, Deployment Group using Repository Manager.
- Worked on different data sources such as Oracle, SQL Server, Flat files etc.
- Developed PL / SQL and UNIX Shell Scripts for scheduling the sessions in Informatica.
- Created E-mail notifications tasks using post-session scripts.
- Wrote SQL , PL / SQL stored procedures, triggers , cursors for implementing business rules and transformations.
- Used Change Data Capture to implement incremental load.
- Created various reports in report studio and packages in framework manager.
- Generated various reports like List, Crosstab , Chart, Master detail, Drill through reports in report studio.
- Provided support to develop the entire warehouse architecture and plan the ETL process.
Confidential
ETL Informatica Developer
Environment : Informatica PowerCenter 8.6.1, Shell Scripts, Database Systems, SQL and PL/SQL, Windows NT, Oracle8i and UNIX
Responsibilities:
- Experience with ETL/ETI (Informatica) (Extraction Transform and Loading, Extraction Transform and Import) data from production database to data warehouse database.
- Worked on transformations such as source qualifier, joiner, lookup, rank, expression, aggregator and sequence generator etc.
- Reused mapping, mapplets and transformations .
- Scheduled sessions and batches on the Informatica Server using Informatica Server.
- Tuned transformations and mappings in Informatica.
- Implemented slowly changing dimensions.
- Created Unix Shell Scripts and PL/SQL procedures.
