We provide IT Staff Augmentation Services!

Software Engineer Etl Resume

SUMMARY

  • Overall Eight years of expertise in Information Technology with special emphasis on Design, Development, documentation and implementation of Data Warehousing / Client - Server in various industries such as Financial, Banking, HealthCare (Provider Enrollment, Claims, Enrollment Eligibility, Prior Authorization, etc.,), Pharmacy and Insurance.
  • Worked extensively in analysis, design and development of various applications using DataStage, Oracle, DB2, Teradata, SQL Server, VB, Windows NT\2000\XP and UNIX environments
  • Strong analytical, presentation, problem solving and excellent inter-personal communication skills with flexibility to learn recent technologies in the IT industry.
  • Team Player with the ability to communicate effectively at all levels of the development process
  • Experience in Database programming, creating data warehouses using IBM DataStage versions 11.5/11.3/8.7/8.5/8. x/7.x Using components like Administrator, Manager, Designer and Director.
  • Extensively worked with Parallel Extender for Parallel Processing to improve job performance
  • Used several load programs using DB2/UDB and SQL Loader
  • Developed Custom Routines for implementing complex Business logic
  • Designed Server jobs, Job Sequencers, Batch Jobs and Parallel jobs
  • Designed Parallel jobs using various stages like Oracle Enterprise, SQL Server enterprise, Transformer, Join, Merge, Remove Duplicates, Aggregator, Sort, Filter, Dataset, Sequential file, Shared Containers, Lookup, Funnel stage, Column Generator, Peek stages, Change Data Capture, Column Export, XML Input stage, Wait for file Activity, Hierarchical Input, Complex flat file stage, MQ stage.
  • Written UNIX Shell Scripts for performing file validations and Job scheduling on various flavors of UNIX
  • Written triggers, stored procedures, functions and packages using PL/SQL.
  • Worked with the functional teams to understand the legacy data to convert to MMIS legacy systems.
  • Expertise in Data Warehouse for the Extracting, Transforming of data from multiple sources & Loading data into a Data Warehouse
  • Experience in Data Modeling and involved in creation of Star Schema and Snowflake dimensional data marts using Erwin tool
  • Involved in identification of Facts, Measures and Dimensions
  • Strong experience in Data Warehousing, Data Architecture, Data Modeling, Data Mining, Data Analysis, Decision Support System (DSS) and GUI applications.
  • Working experience on Control M scheduling and Globalscape FTP.
  • Proficient in Software Life Cycle Development Methodology (SDLC), Agile Methodolgy, and Operational Data Store (ODS).
  • Responsible for QA activities. Worked as a defect tracking lead.

TECHNICAL SKILLS

Databases: DB2 LUW 11.1/10.5/9.7 , Oracle 11g/10g/9i/8i, SQL Server 1012/2008/2005 , MS Access, Teradata V2R6/V13.

Programming Language: SQL, PL/SQL, UNIX shell scripting, C.

ETL Tools: DataStage v 11.5/11.3/8.7/8.5/8. 1/8.0

Data Modeling Tools: Erwin 6.0/5.5, MS Visio 2003/2007, ER/Studio 6.0

RDBMS Tools: TOAD 8.5/ 8.0, SQL*Loader (Oracle), SQL*Plus

Operating Systems: Windows 7, Windows XP, Windows 2000, UNIX

PROFESSIONAL EXPERIENCE

Confidential

Software Engineer ETL

Responsibilities:

  • ETL IBM DataStage Developer with emphasis on Hadoop Data Processing - Coding and testing complex (data from multiple sources such as SQL databases and Hadoop) IBM DataStage jobs.
  • Design and development of enterprise systems making specific determination about system performance, reliability and scalability.
  • Determine the appropriate code for ETL applications based on information gathered including data sources, data targets, data definitions, data relationships, and business rules.
  • Work closely with project management, analysts, data modelers and the existing ETL design and developers to understand project requirements and contribute to the project solution.
  • Provide technical expertise on ETL design, Data modeling, Data Warehousing, and Data integration.
  • Collaborate with Business Intelligence and business operational teams to understand data sources and implement new requirement.
  • Analysis of system specifications and translates system requirements to mapping documents and system code.
  • Analyze and summarize data to facilitate business intelligent decision.
  • Responsible to Build ETL code, prepare Unite test case scenarios, Functional testing, Cross product Integration Testing, EDU/UAT testing, Production deployment, Production support of Current ETL components and future deployments.
  • Extensively used Parallel Stages like Join, Merge, Lookup, Filter, Aggregator, Copy, Sort, Funnel, Change Data Capture, Remove Duplicates, Surrogate key Generator, Row Generator, and Column Generator for development and de-bugging purposes.
  • Created several Job Sequences for the maintenance of Data Stage jobs using Wait for file, Job Activity.
  • Monitor the counts of XML’s posted to the MQ and verify counts of the same in MDM.
  • Worked extensively on XML, hierarchical stage.
  • Used File Connector stage to Pull and Load data from HDFS file system.
  • Responsible for the ongoing operational stability of the ETL processes ensuring they are properly monitored and audited to provide data integrity and timeliness of delivery.

Environment: DataStage v11.5, DataStage v 9.1, DB2 LUW 11.1, AIX v7.2, SQL server 2012, Autosys, PuTTYTeradata, Accurev, XML.

Confidential

ETL DataStage Developer

Responsibilities:

  • Analyzed and documented client's business requirements and processes.
  • Participated in the Design discussion, system design, coordinate with EDW team to define the requirements and develop implementation plan and deployment schedule.
  • Extensively used IBM InfoSphere DataStage to develop processes to extract, transform, integrate and load data from various sources into the Data Warehouse.
  • Used DataStage v11.3 to load the data to Staging area and eventually to the DWH.
  • Worked extensively on building CDC jobs to capture new Inserts, Updates and Deletes.
  • Created the Unit test cases for the complete flow and validated the data to achieve accuracy.
  • Used DataStage Director to monitor the jobs, debug, run DataStage jobs.
  • Developed DataStage jobs using various source stages, target and processing stages like Sequential file, Dataset, Aggregator, Transformer, CDC, look-up, join, merge, funnel, Shared containers, ODBC connector, DB2 connector, Job activity, Execute Command Activity, User Variable Activity, Routine Activity, Loop Activities, Notification Activity Etc.
  • Expertise in creating reusable components like Parameter-sets, Multiple instance jobs, Shared Containers and Local Containers.
  • Improved the performance of ETL load jobs to by optimizing the ETL code.
  • Created Technical requirement and mapping documents with the help of business analyst between sources to operational staging targets, using Star Schema, implemented logic to Slowly Changing Dimensions.
  • Worked on Job Sequencers and implemented restart ability with the help of checkpoints to ensure the correct process flow and dependencies.
  • Worked on migrating the entire project code from DataStage v8.5 to DataStage v11.3.
  • Lead the testing activity for the DataStage migration from 8.5 to 11.3.
  • Schedules jobs in Control-M, monitored the running jobs and involved in production support activities.
  • Provided 24/7 support during the various test phases and production support during the release phases.

Environment: DataStage v11.3, DB2 LUW 11.1, AIX v7.1, SQL server 2012, Control M, PuTTY.

Confidential

ETL DataStage Developer

Responsibilities:

  • Involved in Analyzing the Business Requirements.
  • Involved in designing the Data models like star schema to incorporate the Fact and Dimension tables.
  • Designed the Complete ETL Architecture/Flow of the jobs based on the BDW Model to develop the staging jobs Classification and ANALYSIS load jobs.
  • Assessing the source data and providing the required transformations in the mapping documents.
  • Analyzing the root cause for the issues raised by the Business users and find solutions.
  • Responsible for extracting the data from source systems, Transforming and loading into SQL db.
  • Used the SQL Loader for loading the staging tables from the files.
  • Involved in designing of LLD and Mapping documents.
  • Developed parallel jobs with collection of all source stages, target stages and processing stages like Aggregator, Transformer, look-up, join, merge, funnel, Job activity, Execute Command Activity, User Variable Activity, Routine Activity, Loop Activities, Notification Activity Etc.
  • Created Job Sequencer for dependency jobs and to run the jobs by using parameters.
  • Created the Unit test cases for the complete flow and validated the data to achieve accuracy.
  • Viewing Log for the jobs and cleaning up the resources using Director.
  • Worked with Cognos team in building reports as requested by the users.
  • Worked with the EDW Data Management team to schedule the DataStage jobs using Control M.

Environment: DataStage v11.3, SQL server 2012, Cognos 11, Control M

Confidential, Charlotte, NC

ETL DataStage Developer

Responsibilities:

  • Attended daily scrum calls and Interacted with the Business Analyst and Scrum master to gather requirements in an Agile environment.
  • Participated in Design discussions with the Design board to finalize the Interface design.
  • Built Star schema data mart components to load IBM usage data into fact and multiple dimension tables.
  • Worked on most of the DataStage Active Stages like Aggregator, Change data Capture, Change data delivery, Transformer, Filter, Join, Merge, Funnel, Modify, Sort, Remove duplicate.
  • Built custom triggers to reflect New Inserts, Updates and Deletes on tables.
  • Built DataStage processes to handle Incremental and Historical data loads.
  • Designed monitoring process for replication from non-relational (Cloud) database to DB2.
  • Worked with QA teams to track the defects, fix the defects and closing the defects, supported Production defects.
  • Co-ordinated with IBM offshore to track development activities and Production issues.
  • Participated in code review activities to endure code is complying with IBM standards.
  • Job scheduling with the help of Sequences Stages like Job activity, Routine Activity, Loop Activities, User Activity variables etc., and finally scheduling them in DataStage director.
  • Unix Shell scripting to call the DataStage jobs from Unix with the help of dsrunjob options.
  • Established best practices for DataStage jobs to ensure optimal performance, reusability, and restart ability.
  • Responsible for creating complex custom Key Performance Indicator (KPI) reports to identify the number of visitors, enrollers on IBM.com.
  • Created various custom KPI reports using Leadership KPI dashboard for IBM Web Presence and IBM Marketplace.
  • Interacted with API developers and assisted them in building custom API’s.
  • Was an active participant in Scrum Mission and Epic planning, Story pointing, Updating Product backlog, Sprint retrospective.

Environment: DataStage v11.3, DB2 v10.5, Toad 6.1, Unix, Filezilla, PuTTY.

Hire Now