Etl Data Stage Developer Resume
VA
PROFESSIONAL SUMMARY:
- Over 8 years of Dynamic career reflecting pioneering experience and high performance in System Analysis, design, development and implementation of Relational Database and Data Warehousing Systems using IBM Data Stage 11.0/8.0.1/7. x/6.x/5.x (Info Sphere Information Server, Web Sphere, Ascential Data Stage).
- Excellent Experience in Designing, Developing, Documenting, Testing of ETL jobs and mappings in Server and Parallel jobs using Data Stage to populate tables in Data Warehouse and Data marts.
- Proficient in developing strategies for Extraction, Transformation and Loading (ETL) mechanism.
- Expert in designing Parallel jobs using various stages like Join, Merge, Lookup, remove duplicates, Filter, Dataset, Lookup file set, Complex flat file, Modify, Aggregator, XML.
- Expert in designing Server jobs using various types of stages like Sequential file, ODBC, Hashed file, Aggregator, Transformer, Sort, Link Partitioner and Link Collector.
- Experienced in integration of various data sources (DB2 - UDB, SQL Server,PL/SQL,Oracle, Teradata,XMLand MS-Access) into data staging area.
- Expert in working with Data Stage Manager, Designer, Administrator, and Director.
- Experience in analyzing the data generated by the business process, defining the granularity, source to target mapping of the data elements, creating Indexes and Aggregate tables for the data warehouse design and development.
- Excellent knowledge of studying the data dependencies using metadata stored in the repository and prepared batches for the existing sessions to facilitate scheduling of multiple sessions.
- Proven track record in troubleshooting of Data Stage jobs and addressing production issues like performance tuning and enhancement.
- Expert in working on various operating systems like UNIX AIX 5.2/5.1, Sun Solaris V8.0 and Windows 2000/NT.
- Proficient in writing, implementation and testing of triggers, procedures and functions inPL/SQLandOracle.
- Experienced in Database programming for Data Warehouses (Schemas), proficient in dimensional modeling (Star Schema modeling, and Snowflake modeling).
- Expertise in UNIX shell scripts using K-shell for the automation of processes and scheduling the Data Stage jobs using wrappers.
- Experience in using software configuration management tools like Rational Clear case/Clear quest for version control.
- Experienced in Data Modeling as well as reverse engineering using tools Erwin, Oracle Designerand MS Visio, SQL server management studio, SSIS and SSRS and store procedure.
- Expert in unit testing, system integration testing, implementation and maintenance of databases jobs.
- Effective in cross-functional and global environments to manage multiple tasks and assignments concurrently with effective communication skills.
TECHNICAL SKILLS:
ETL Tools: Data Stage IBM Web Sphere Data stage and Quality Stage 8.0, Ascential Data Stage 11.5/7.5.2/5.1/6.0 Profile Stage 7.0, SSIS (SQL server 2005), Data Integrator.
Databases: Oracle 9i/8i, MS SQL Server 2000/7.0/6.5, MS Access 7.0/2000, SQL Server, Postgress, Teradata and DB2
Development tools and Languages: SQL, C, C++, Unix Shell Scripting, Perl,PL/SQL,oracle
Tools: MS Office 97/2000/professional, SQL*Plus 3.3/8.0, TOAD, Microsoft Visio, Putty, Text Pad, .csv files, Erwin, ER Model, Salesforce Integration.
Business Intelligence Tools: Business Objects, Brio, SSRS(SQL Server 2005),IBM Cognos 8 BI
Testing Tools: Auto Tester, Test Director, Lotus Notes.
HPUX, IBM: AIX 5.3, Windows 95/98/2000/ NT, Sun Solaris, Red-Hat Linux, MS SQL SERVER 2000/2005/2008 & MS Access
PROFESSIONAL EXPERIENCE:
Confidential, VA
ETL Data Stage Developer
Responsibilities:
- Involved as primary on-site ETL Developer during the analysis, planning, design, development, and implementation stages of projects using IBM Web Sphere software (Quality Stage v11.5, Web Service, Information Analyzer, Profile Stage, WISD of IIS 8.0.1).
- Prepared Data Mapping Documents and Design the ETL jobs based on the DMD with required Tables in the Dev Environment.
- Active participation in decision making and QA meetings and regularly interacted with the Business Analysts &development team to gain a better understanding of the Business Process, Requirements & Design.
- Used Data Stage as an ETL tool to extract data from sources systems, loaded the data into theORACLEdatabase.
- Designed and Developed Data Stage Jobs to Extract data from heterogeneous sources, applied transform logics to extracted data and Loaded into Data Warehouse Databases.
- Created Data stage jobs using different stages like Transformer, Aggregator, Sort, Join, Merge, Lookup, Data Set, Funnel, Remove Duplicates, Copy, Modify, Filter, Change Data Capture, Change Apply, Sample, Surrogate Key, Column Generator, Row Generator, Etc.
- Extensively worked with Join, Look up (Normal and Sparse) and Merge stages.
- Extensively worked with sequential file, dataset, file set and look up file set stages.
- Extensively used Parallel Stages like Row Generator, Column Generator, Head, and Peek for development and de-bugging purposes.
- Used the Data Stage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions on ad hoc or scheduled basis.
- Developed complex store procedures using input/output parameters, cursors, views, triggers and complex queries using temp tables and joins.
- Converted complex job designs to different job segments and executed through job sequencer for better performance and easy maintenance.
- Creation of jobs sequences.
- Maintained Data Warehouse by loading dimensions and facts as part of project. Also worked for different enhancements in FACT tables.
- Created shell script to run data stage jobs from UNIX and then schedule this script to run data stage jobs through scheduling tool.
- Coordinate with team members and administer all onsite and offshore work packages.
- Analyze performance and monitor work with capacity planning.
- Performed performance tuning of the jobs by interpreting performance statistics of the jobs developed.
- Documented ETL test plans, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.
- Participated in weekly status meetings.
- Developed Test Plan that included the scope of the release, entrance and exit criteria and overall test strategy. Created detailed Test Cases and Test sets and executed them manually.
- Environment:IBM Web Sphere Data Stage 8.1 Parallel Extender, Web Services, Quality Stage 8.1, (Designer, Director, Manager), Microsoft Visio, IBM AIX 4.2/4.1 IBM DB2 Database, SQL Server, IBM DB2, Teradata,ORACLE 11G, Query man, Unix, Windows.
Confidential, NJ
ETL Data Stage Developer
Responsibilities:
- Used the Data Stage Designer to develop processes for extracting, cleansing, transforming, integrating and loading data into staging tables.
- Extensively used ETL to load data from IBM DB2 database,XML& Flat files Source to Informix Database Server.
- Involved in analysis, planning, design, development, and implementation phages of projects using IBM Web Sphere software (Quality Stage v8.0.1, Web Service, Information Analyzer, Profile Stage, WISD of IIS 8.0.1).
- Developed complex jobs using various stages like Lookup, Join, Transformer, Dataset, Row Generator, Column Generator, Datasets, Sequential File, Aggregator and Modify Stages.
- Created queries using join and case statement to validate data in different databases.
- Created queries to compare data between two databases to make sure data is matched.
- Used the Data Stage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions on an ad hoc or scheduled basis.
- Created shared container to in corporate complex business logic in job.
- Monitoring the Data stage job on daily basis by running the UNIX shell script and made a force start whenever job fails.
- Created and modified batch scripts to ftp files from different server to data stage server.
- Extensively used slowly changing dimension Type 2 approach to maintain history in database.
- Created Job Sequencers to automate the job.
- Modified UNIX shell script to run Job sequencer from the mainframe job.
- Create parameter set to assign a value to job at run time.
- Standardized the Nomenclature used to define the same data by users from different business units.
- Created multiple layer report providing a comprehensive and detail report with Drill through facility.
- UsedParallel Extender for Parallel Processingfor improving performance when extracting the data from the sources.
- Worked with Metadata Definitions, Import and Export of Data stage jobs using Data Stage Manager.
- Providing the logical data model design, generating database, resolving technical issues, and loading data into multiple instances.
- ImplementedPL/SQL scriptsin accordance with the necessaryBusiness rules and procedures.
- Developed PL/SQL procedures & functions to support the reports by retrieving the data from the data warehousing application.
- Used PL/SQL programming to develop Stored Procedures/Functions and Database triggers.
- Environment:IBM Web Sphere Data Stage 8.0.1 Parallel Extender, Web Services, Quality Stage 8.0, (Designer, Director, Manager), Microsoft Visio, IBM AIX 4.2/4.1 IBM DB2 Database, SQL Server 2000, IBM DB2, Teradata,ORACLE 11G, Query man, BMQ, Unix, Windows.
Confidential, TX
ETL Data Stage Developer
Responsibilities:
- Used IBM Data Stage Designer to develop jobs for extracting, cleaning, transforming and loading data into data marts/data warehouse.
- Developed several jobs toimprove performanceby reducing runtime using different partitioning techniques.
- Used different stages of Data Stage Designer likeLookup, Join, Merge, Funnel, Filter, Copy, Aggregator, and Sort etc.
- Used to read complex flat files from mainframe machine buy usingComplex Flat File Stage.
- Sequential File, Aggregator, ODBC, Transformer, Hashed-File, Oracle OCI,XML, Folder,FTP Plug-inStages were extensively used to develop the server jobs.
- Use the EXPLAIN PLAN statement to determine the execution plan Oracle Database.
- Worked on Complex data coming from Mainframes (EBCIDIC files) and knowledge of Job Control Language (JCL).
- Used Cobol Copy books to import the Metadata information from mainframes.
- Designed Data stage jobs usingQuality Stage stages in 7.5for data cleansing & data standardization Process. ImplementedSurvive stage & Match Stagefor data patterns & data definitions.
- Staged the data coming from various environments in staging area before intoDataMart’s.
- Involved in writingTest Plans, Test Scenarios, Test Casesand Test Scripts and performed the Unit, Integration, system testing and User Acceptance Testing.
- Used stage variables for source validations, to capture rejects and usedJob Parametersfor Automation of jobs.
- Strong knowledge in creating procedures, functions, sequences, triggers.
- Expertise inPLSQL/SQL.
- Performed debugging and unit testing and System Integrated testing of the jobs.
- WroteUNIX shell scriptaccording to the business requirements.
- Wrote customized server/parallel routines according to complexity of the business requirements.
- Designed strategies forarchivingof legacy data.
- Created shell scripts to perform validations and run jobs on different instances (DEV, TEST and PROD).
- Created & DeployedSSIS(SQL Server Integration Services) Projects, Schemas and Configured Report Server to generate reports through SSRS SQL Server 2005.
- Used to create ad-hoc reports by MS SQL Server Reporting Services for the business users.
- Used SQL Profiler to monitor the server performance, debug T-SQL and slow running queries.
- Expertise in developing and debugging indexes, stored procedures, functions, triggers, cursors using T-SQL.
- Wrote mapping documents for all the ETL Jobs (interfaces, Data Warehouse and Data Conversion activities).
- Environment:IBM Web Sphere Data stage and Quality Stage 7.5, Ascential Datastage7.5/EE (Parallel Extender), SQL Server 2005/2008, Linux, Teradata 12, Oracle10g, Sybase, PL/SQL Toad, UNIX (HP-UX), Cognos 8 BI
Confidential
ETL Data Stage Developer
Responsibilities:
- Designed and developed mappings between sources and operational staging targets, using Star and Snow Flake Schemas.
- Provided data models and data maps (extract, transform and load analysis) of the data marts for systems in the aggregation effort.
- Involved in Extracting, cleansing, transforming, integrating and loading data into data warehouse using data stage Designer.
- Developed various transformations based on customer last name, zip code for internal business analytical purposes, loaded warehouse based on customer credit card number with dynamic data re-partitioning.
- Developed user defined Routines and Transformations by using Universe Basic.
- Used data stage Manager for importing metadata from repository, new job categories and creating new data elements.
- Used the data stage Director and the runtime engine to schedule running the solution, testing and debugging its components and monitoring the resulting executable versions (on adhoc or scheduled basis).
- Developed, maintained programs for scheduling data loading and transformations using Data stage and Oracle 8i.
- Developed Shell scripts to automate file manipulation and data loading procedures.
- Environment:data stage 5.2/6.0, Oracle 8i, SQL, TOAD, UNIX, Windows NT 4.0.