Sr. Etl Developer Resume
Nc Sr Datastage Developer, NC
SUMMARY:
- IT professional, Over Eight years of experience in System Analysis, Design and Development and Extensive experience in IBM Information Analyzer/ IBM Web sphere /IBM DataStage v 11.3/8.5/8.0/ 7. x using Components like Administrator, Manager, Designer, and Director.
- Over Seven years in the fields of data Warehousing, Data Integration, Data Migration using IBM Websphere DataStage, Oracle, PL/SQL, DB2 UDB, SQL Server 2000/2005. SQL procedural language and Shell Scripts
- Around Seven years of experience in ETL methodologies in all the phases of the Data warehousing life cycle
- In Depth knowledge in Data Warehousing & Business Intelligence concepts with emphasis on ETL and full Life Cycle Development including requirement analysis, design, development, testing and implementation
- Expertise in all the phases of System development life Cycle (SDLC) using different methodologies like Agile, Waterfall.
- Have good grasp of data warehousing fundamentals and have proven ability to implement them. Conversant with ETL processes.
- Experience in data stage upgrade and setting up the data stage environment in all the SDLC environments.
- Worked with SQL, SQL*PLUS, Oracle PL/SQL, Stored Procedures, Table Partitions, Triggers, SQL queries, PL/SQL Packages, and loading data into Data Warehouse/Data Marts
- Extensively used SQL coding for overriding the generated SQL in Datastage and also tested the data loaded into the data base.
- Excellent experience in most of the RDBMS including Oracle 10g/9i/8x, SQL Server 7.0/6.5 & DB2 8.1/9.0
- Extensively used DataStage - Designer to design and develop Server and PX jobs to migrate data from transactional systems (Sybase, DB2UDB) into the Data Warehouse.
- Extensively used DataStage- Manager to Export/Import DataStage Job components and Import Plug in Table Definitions from DB2UDB, Oracle and Sybase databases.
- Designed Server jobs, Job Sequencers, Batch Jobs and Parallel jobs. Handled multiple pieces of a Project.
- Designed Parallel jobs using various stages like join, merge, lookup, remove duplicates, filter, dataset, lookup file set, modify, aggregator, CFF, Transformer, MQ Messaging.
- Good Experience in Extraction Transformation and Loading (ETL) processes using Data Stage ETL Tool, Parallel Extender, Quality Stage, Profile Stage
- Developed Server jobs using various types of stages like Sequential file, ODBC, Hashed File, Aggregator, Transformer, Sort, Link Partitioner and Link Collector.
- Experience in integration of various data sources like Oracle, Teradata, DB2, SQL Server, MS Access and Flat files into the Staging Area. Extensively worked with materialized views and TOAD
- Proven track record in troubleshooting of DataStage Jobs and addressing production issues such as performance tuning and enhancement
- Excellent knowledge of studying the data dependencies using Metadata stored in the Repository and preparing batches for the existing sessions to facilitate scheduling of multiple sessions
- Excellent analytical, problem-solving and communication skills.
TECHNICAL SKILLS:
- Data Warehousing IBM Information Analyzer/ IBM Web sphere/IBM DataStage 11.3/8.5/8.0/7.5.3/7.5.2/7.5.1 (Designer, Director, manager, Administrator), Parallel extender, Server Edition, MVS Edition, Quality Stage 7.5, ETL, Informatica, OLAP, OLTP, SQL*Plus, Quality Stage
- Business Intelligence Cognos 7.0 (Impromptu, Transformer, Power Play Reports, Scheduler, Architect)
- Databases Oracle10g/9i/8i/8.0/7.0,DB2UDB7.2/8.1/9.0,Mainframe,TeradataV2R6, DB2UDB,MSAccess 7.0/’97/2000, MS SQL Server 6.5
- Tools SQL*Loader, DB2 QMF V9, Data Version control, Crontab, Autosys4.5, Excel,
- Control M, TOAD, SQL Navigator 6.5, Oracle SQL Developer
- Programming SQL, PL/SQL, C, C++, VB, XML, Java, J2EE, DOS, COBOL, Unix, Korn, Shell Scripting, SQL loader
- Analysis & Design Agile, Rational Unified Process (RUP), UML, Waterfall
- Others HTML 4.0, MS Excel, MS Office,
- Environment Sun Solaris IBM AIX 5.3/5.2/4.2, MS DOS 6.22, Win 3.x/95/98/2000, Win NT 4.0,Win XP
PROFESSIONAL EXPERIENCE:
Confidential,NC
Sr. ETL Developer
Responsibilities:
- Understand the Current system and Prepare high-level system integration designs on the DI platform
- Designed jobs using different parallel job stages.
- Created re-usable jobs for to execute Generic processes.
- Used INFORMATION SERVER (8.1/11.3) to develop the parallel jobs, define job sequence’s
- Participated in conversion of data stage 8.1 to 11.3 migration.
- Setting up the development and test environments on 11.3 server.
- Created the jobs to check various metric categories like Accuracy, Completeness, Consistency, Uniqueness, and Validity.
- Extensively used MQ messaging stage to send the messages to the down stream.
- Prepared Unix scripts for triggering jobs and for various other functionalities.
- Prepare Autosys jil scripts for scheduling jobs in Non-Prod/Prod environments.
- Deploy code to testing regions.
- Region readiness for development and testing.
- Used Star team version control tool to check-in and check-out the code.
- Worked with tech lead to build a data mart and create the repots OBIEE dash board.
- Used Discovery tool to profile the data and create the data profiling reports.
- Did column analysis on tables using information analyzer and created data profiling reports.
Environment: IBM Information Server 8.1/11.3, Oracle, Autosys, Linux, Star Team, Oracle SQL Developer, OBIEE Dashboard.
Confidential,NC
Sr. Datastage Developer
Responsibilities:
- Analyze Business requirements and Prepare high-level system integration designs
- Prepare technical designs based on the high level definitions.
- Prepare mapping of Source fields to target fields using Fast Track.
- Extensively worked on Business glossary to define the Technical terms, business terms and term linkage.
- Set up rules for data Analysis using Information Analyzer.
- Define job sequence’s
- Prepare Unix scripts for triggering jobs.
- Prepare autosys jil scripts for scheduling jobs in Non-Prod/Prod environments.
- Conduct Performance testing to analyze the overall performance of the system built.
- Perform code tuning to improve the performance (check node configuration/stages used and partitioning logic implemented).
- Prepare work break down structure for assigning tasks for code development
- Deploy code to testing regions.
- Region readiness for development and testing.
- Prepare testing scripts for functional testing.
- Designed jobs using different parallel job stages such as Join, Merge, Lookup, Remove Duplicates, Copy, Filter, Funnel, Dataset, Lookup File Set, Change Data Capture, Transformer and Aggregator.
- Extensively used INFOSPHERE INFORMATION SERVER (datastage 8.5) to develop the parallel jobs.
- Used Clear case version control tool to check-in and check-out the code
- Used the Quality Stage to standardize and cleansing the source data
Environment: IBM Information Server 8.5, DB2, Autosys, Aix-Unix, IBM Rational Clear Case, Fast Track, Business Glossary, IBM Data Studio.
Confidential,St. Paul,MN
Sr. ETL Developer
Responsibilities:
- Designed the technical design documents from Functional specifications.
- Worked with Project Lead, Technical Lead and Functional analysts to understand the functional requirements and from there designed the Technical specifications.
- Worked with complex flat files, CSV Files, and Delimited Files, XML Files in the process of extraction of data.
- Developed parallel jobs, which involved of SAP BW Open Hub Extract, ESSBASE plug in stage and oracle enterprise stage.
- Worked as Onsite Coordinator, managed a team of four in offsite.
- Worked in an environment, which involved of different source/target systems like SAP BW, ESSBASE, Oracle, and MS SQL and Flat files.
- Worked on Informatica to Datastage Migration.
- Designed Datastage Parallel jobs based on Informatica jobs.
- Worked on Data Migration from legacy ESSBASE to the ESSBASE V10
- Reviewed the jobs developed by offshore team and assisted them during the daily calls.
- Developed the jobs and documented by following the SJM ETL standards.
- Involved in creation of UTPs, Code review check list and Process flow documents.
- Responsible for building the Hierarchy of the meta data to load the MDM (DRM is the MDM tool used in this project)
- Created the jobs to update the Metadata in the cubes using the incremental files.
- Designed and developed the Internal Auditing jobs.
- Also working on some issues where we are getting special characters (Chinese and Italian,etc) from SAPBW
- Implemented complex logics in Transformer stage like date validation, use of stage variables.
- Unit Testing and Integration testing the individual and extract-transform-load jobs in sequence respectively.
- Extensively used IBM Information Server Director for scheduling the job to run in batch, emailing and online production support for troubleshooting from LOG files
- Used Job Sequencers to run the jobs sequentially and reporting the Status of the Job through Email.
- Exported and imported the Data stage jobs between the production and the development servers
- Involved in S.I.T (System Integration and Testing) and U.A.T (User Acceptance Testing).
- As a Datastage Developer I created both Parallel and server jobs and also Sequence jobs.
- Used the Client components Designer, Manager, Director and Administrator.
- Developed jobs using the stages like Sequential file, Dataset, Oracle connector, ODBC stage, Lookup, Join, Aggregator, Pivot, External Source, BW Open Hub Extractor, Essbase Connector, Link Partitioner/Collector, Column Generator, Copy, Transformer, Sort, Remove Duplicates, Funnel, FTP.
- Also used UNIX scripts in file moving, scheduling jobs, removing null from the Flat files.
Environment: IBM Infosphere Data Stage 8.1,Informatica 8.6, Oracle 10g, MS SQL Server 2005, EssBase Visual Explorer 11,SQL/PLSQL, FTP Client, Linux, Windows XP
Confidential,CO
ETL Developer
Responsibilities:
- Worked with Ascential DataStage Designer to develop jobs for Extracting, Transforming and Loading the data into Target database.
- Involved in the Creating, Designing and Documentation of the Data Warehouse
- Dimensional Implementation and Upgrades.
- Worked with various stages like Sequential File, Hashed File, Aggregator, ODBC, Transformer, UDB DB2 and OraOCI Stages.
- Developed user defined Routines and Transformations by using Universe Basic.
- Used Datastage and SQL*Loader to load the data into target databases.
- Worked with DataStage Manager for importing metadata and DataStage Components.
- Designed parallel jobs using,Oracle enterprise, Teradata Enterprise, Teradata multi load, XML Input, XML Output stages.
- Used the Client components Designer, Manager, Director and Administrator.
- Created Design Documents and Unit Test cases with test Results Documents.
- Involved in Business Requirement gathering sessions
- Extensively wrote Custom Routines and Transformations as per the business requirements.
- Worked with the DataStage Director to validate, schedule and run the jobs.
- Used Unix Shell Scripts for scheduling the jobs.
- Used Hash files, IPC stages to improve the performance of jobs.
- Developed various shared Container jobs for Re-Usability
- Used Parallel Job Extender for jobs for parallel Processing to improve job performance.
- Used Partition methods and collecting methods for implementing parallel processing.
- Used PL/SQL Procedures to handle critical tasks to transform data from staging to
- Data Warehouse Fact and summary tables.
- Involved in Debugging and testing the jobs.
Environment: Ascential DataStage 8.0, Oracle 10g,Teradata, SQL Plus, TOAD, DB2, Business objects, SQL * Loader, HP-Unix and Windows 2000.
Confidential,NJ
Datastage Developer
Responsibilities:
- Involved with Business users and ETL Leads from different teams to implement ETL Frame Work using Datastage Server/Parallel combination of jobs and Migration of data from SAP source to SAP target.
- Extracted data from various sources like Oracle Database, Flat Files, .CSV files and loaded to target warehouse.
- Implemented various strategies for Slowly Changing Dimensions using Datastage Server/Parallel jobs using the Frame Work approach
- Designed jobs using different parallel job stages such as Join, Merge, Lookup, Filter, Dataset, Lookup file Set, Remove Duplicates, Change Data Capture, Switch, Modify, and Aggregator.
- Involved in developing Datastage Designer Server and Parallel jobs for Extracting, Cleansing, Transforming, and Integrating/Loading Data into Corporate Data Warehouse (CDW).
- Developed Job Sequences for automating and scheduling the Datastage Jobs.
- Extensively designed, developed and implemented Parallel Extender jobs using Parallel Processing (Pipeline and partition) techniques to improve job performance while working with bulk data sources.
- Extensively used Datastage Director to Monitor and check the run statistics of the Jobs and to clear the job logs, job resources.
- Extensively used Datastage Manager to Export/import Datastage components.
- Involved in Unit Testing for the jobs.
- Created Shell scripts for scheduling the Datastage jobs using wrappers.
- Used configuration management tools like Rational Clear Case/Clear Quest for version control and migration.
- Involved in documenting the Frame Work Templates and the process of developing jobs using Templates.
Environment: Ascential Datastage 7.5.1 (Server/Parallel Extender), Oracle 9i, UNIX Shell Scripting, Windows NT/2000, Clear Case/Clear Quest, IBM AIX 5.2, Autosys