Sr. Etl Developer Resume
Columbus, OH
SUMMARY:
- Overall Eight years of expertise in Information Technology with special emphasis on Design, Development, documentation and implementation of Data Warehousing / Client - Server in various industries such as Financial, Banking, HealthCare (Provider Enrollment, Claims, Enrollment Eligibility, Prior Authorization, etc.,), Pharmacy and Insurance.
- Worked extensively in analysis, design and development of various applications using DataStage, Oracle, DB2, Teradata, SQL Server, VB, Windows NT\2000\XP and UNIX environments
- Strong analytical, presentation, problem solving and excellent inter-personal communication skills with flexibility to learn recent technologies in the IT industry.
- Team Player with the ability to communicate effectively at all levels of the development process
- Experience in Database programming, creating data warehouses using IBM DataStage versions 11.7/11.5/11.3/8.7/8.5/8. x/7.x Using components like Administrator, Manager, Designer and Director.
- Extensively worked with Parallel Extender for Parallel Processing to improve job performance
- Used several load programs using DB2/UDB and SQL Loader
- Developed Custom Routines for implementing complex Business logic
- Designed Server jobs, Job Sequencers, Batch Jobs and Parallel jobs
- Designed Parallel jobs using various stages like Oracle Enterprise, SQL Server enterprise, Transformer, Join, Merge, Remove Duplicates, Aggregator, Sort, Filter, Dataset, Sequential file, Shared Containers, Lookup, Funnel stage, Column Generator, Peek stages, Change Data Capture, Column Export, XML Input stage, Wait for file Activity, Hierarchical Input, Complex flat file stage, MQ stage.
- Written UNIX Shell Scripts for performing file validations and Job scheduling on various flavors of UNIX
- Written triggers, stored procedures, functions and packages using PL/SQL.
- Worked with the functional teams to understand the legacy data to convert to MMIS legacy systems.
- Expertise in Data Warehouse for the Extracting, Transforming of data from multiple sources & Loading data into a Data Warehouse
- Experience in Data Modeling and involved in creation of Star Schema and Snowflake dimensional data marts using Erwin tool
- Involved in identification of Facts, Measures and Dimensions
- Strong experience in Data Warehousing, Data Architecture, Data Modeling, Data Mining, Data Analysis, Decision Support System (DSS) and GUI applications.
- Working experience on Control M scheduling and Globalscape FTP.
- Proficient in Software Life Cycle Development Methodology (SDLC), Agile Methodolgy, and Operational Data Store (ODS).
- Responsible for QA activities. Worked as a defect tracking lead.
TECHNICAL SKILLS:
Databases: DB2 LUW 11.1/10.5/9.7 , Oracle 11g/10g/9i/8i, SQL Server 1012/2008/2005 , MS Access, Teradata V2R6/V13.
Programming Language: SQL, PL/SQL, UNIX shell scripting, C.
ETL Tools: DataStage v 11.7/11.5/11.3/8.7/8.5/8. 1/8.0
Data Modeling Tools: Erwin 6.0/5.5, MS Visio 2003/2007, ER/Studio 6.0
RDBMS Tools: TOAD 8.5/ 8.0, SQL*Loader (Oracle), SQL*Plus
Operating Systems: Windows 7, Windows XP, Windows 2000, UNIX
PROFESSIONAL EXPERIENCE:
Confidential, Columbus, OH
Sr. ETL Developer
Responsibilities:
- Interact with Business Analysts and Data Designers to understand and decode the business rules.
- Participated in the Design discussion, system design, define the requirements and develop implementation plan and deployment schedule.
- Designed Parallel jobs using various stages like Oracle Enterprise, Transformer, Join, Merge, Remove Duplicates, Sort, Filter, Dataset, Lookup, Funnel stage, Column Generator, Peek stages, CDC stage, Lookup fileset, XML hierarchical stage, Unstructured data.
- Actively involved in building ETL code, prepare Unite test case scenarios, Functional testing, Cross product Integration Testing, EDU/UAT testing, Production deployment, Production support of Current ETL components and future deployments.
- Created ETL jobs to read data from Peoplesoft, transform and load the data to Workday.
- Worked extensively on building XSD’s for and build XMLs using XML hierarchical stage.
- Worked on migrating ETL conversion code from Datastage v 9.1 to Datastage v11.7.
- Attended daily scrum calls, worked on creating user stories, tasks and Interacted with the Business Analyst and Scrum master to gather requirements in a fast-paced Agile environment.
Environment: DataStage 11.7, 9.1, Oracle 11g, Workday, Jira, Tableau 2019 3.0
Confidential, Dearborn, MI
Software Engineer ETL
Responsibilities:
- ETL IBM DataStage Developer with emphasis on Hadoop Data Processing - Coding and testing complex (data from multiple sources such as SQL databases and Hadoop) IBM DataStage jobs.
- Design and development of enterprise systems making specific determination about system performance, reliability and scalability.
- Determine the appropriate code for ETL applications based on information gathered including data sources, data targets, data definitions, data relationships, and business rules.
- Work closely with project management, analysts, data modelers and the existing ETL design and developers to understand project requirements and contribute to the project solution.
- Provide technical expertise on ETL design, Data modeling, Data Warehousing, and Data integration.
- Collaborate with Business Intelligence and business operational teams to understand data sources and implement new requirement.
- Analysis of system specifications and translates system requirements to mapping documents and system code.
- Analyze and summarize data to facilitate business intelligent decision.
- Responsible to Build ETL code, prepare Unite test case scenarios, Functional testing, Cross product Integration Testing, EDU/UAT testing, Production deployment, Production support of Current ETL components and future deployments.
- Extensively used Parallel Stages like Join, Merge, Lookup, Filter, Aggregator, Copy, Sort, Funnel, Change Data Capture, Remove Duplicates, Surrogate key Generator, Row Generator, and Column Generator for development and de-bugging purposes.
- Worked on Successful Migration of Datastage jobs from version 9.1 to 11.5 and from Datastage v11.5 to v11.7.
- Built Automated ETL Testing process using Datastage to integrate with Jenkins CI/ CD pipeline.
- Created several Job Sequences for the maintenance of Data Stage jobs using Wait for file, Job Activity.
- Monitor the counts of XML’s posted to the MQ and verify counts of the same in MDM.
- Worked extensively on XML, hierarchical stage.
- Used File Connector stage to Pull and Load data from HDFS file system.
- Good understanding of Hadoop concepts and knowledge of components like HDFS, Hive, Oozie.
- Have Working knowledge of MQ, IBM MDM.
- Responsible for the ongoing operational stability of the ETL processes ensuring they are properly monitored and audited to provide data integrity and timeliness of delivery.
Environment: DataStage 11.7,11.5, 9.1, DB2 LUW 11.1, AIX v7.2, SQL server 2012, Autosys, PuTTYTeradata, Accurev, XML.
Confidential, Tampa, FL
ETL DataStage Developer
Responsibilities:
- Analyzed and documented client's business requirements and processes.
- Participated in the Design discussion, system design, coordinate with EDW team to define the requirements and develop implementation plan and deployment schedule.
- Extensively used IBM InfoSphere DataStage to develop processes to extract, transform, integrate and load data from various sources into the Data Warehouse.
- Used DataStage v11.3 to load the data to Staging area and eventually to the DWH.
- Worked extensively on building CDC jobs to capture new Inserts, Updates and Deletes.
- Created the Unit test cases for the complete flow and validated the data to achieve accuracy.
- Used DataStage Director to monitor the jobs, debug, run DataStage jobs.
- Developed DataStage jobs using various source stages, target and processing stages like Sequential file, Dataset, Aggregator, Transformer, CDC, look-up, join, merge, funnel, Shared containers, ODBC connector, DB2 connector, Job activity, Execute Command Activity, User Variable Activity, Routine Activity, Loop Activities, Notification Activity Etc.
- Expertise in creating reusable components like Parameter-sets, Multiple instance jobs, Shared Containers and Local Containers.
- Improved the performance of ETL load jobs to by optimizing the ETL code.
- Created Technical requirement and mapping documents with the help of business analyst between sources to operational staging targets, using Star Schema, implemented logic to Slowly Changing Dimensions.
- Worked on Job Sequencers and implemented restart ability with the help of checkpoints to ensure the correct process flow and dependencies.
- Worked on migrating the entire project code from DataStage v8.5 to DataStage v11.3.
- Lead the testing activity for the DataStage migration from 8.5 to 11.3.
- Schedules jobs in Control-M, monitored the running jobs and involved in production support activities.
- Provided 24/7 support during the various test phases and production support during the release phases.
Environment: DataStage v11.3, DB2 LUW 11.1, AIX v7.1, SQL server 2012, Control M, PuTTY.
Confidential, Columbus, GA
ETL DataStage Developer
Responsibilities:
- Involved in Analyzing the Business Requirements.
- Involved in designing the Data models like star schema to in corporate the Fact and Dimension tables.
- Designed the Complete ETL Architecture/Flow of the jobs based on the BDW Model to develop the staging jobs Classification and ANALYSIS load jobs.
- Assessing the source data and providing the required transformations in the mapping documents.
- Analyzing the root cause for the issues raised by the Business users and find solutions.
- Responsible for extracting the data from source systems, Transforming and loading into SQL db.
- Used the SQL Loader for loading the staging tables from the files.
- Involved in designing of LLD and Mapping documents.
- Developed parallel jobs with collection of all source stages, target stages and processing stages like Aggregator, Transformer, look-up, join, merge, funnel, Job activity, Execute Command Activity, User Variable Activity, Routine Activity, Loop Activities, Notification Activity Etc.
- Created Job Sequencer for dependency jobs and to run the jobs by using parameters.
- Created the Unit test cases for the complete flow and validated the data to achieve accuracy.
- Viewing Log for the jobs and cleaning up the resources using Director.
- Worked with Cognos team in building reports as requested by the users.
- Worked with the EDW Data Management team to schedule the DataStage jobs using Control M.
Environment: DataStage v11.3, SQL server 2012, Cognos 11, Control M
Confidential, Charlotte, NC
ETL DataStage Developer
Responsibilities:
- Attended daily scrum calls and Interacted with the Business Analyst and Scrum master to gather requirements in an Agile environment.
- Participated in Design discussions with the Design board to finalize the Interface design.
- Built Star schema data mart components to load IBM usage data into fact and multiple dimension tables.
- Worked on most of the DataStage Active Stages like Aggregator, Change data Capture, Change data delivery, Transformer, Filter, Join, Merge, Funnel, Modify, Sort, Remove duplicate.
- Built custom triggers to reflect New Inserts, Updates and Deletes on tables.
- Built DataStage processes to handle Incremental and Historical data loads.
- Designed monitoring process for replication from non-relational (Cloud) database to DB2.
- Worked with QA teams to track the defects, fix the defects and closing the defects, supported Production defects.
- Co-ordinated with IBM offshore to track development activities and Production issues.
- Participated in code review activities to endure code is complying with IBM standards.
- Job scheduling with the help of Sequences Stages like Job activity, Routine Activity, Loop Activities, User Activity variables etc., and finally scheduling them in DataStage director.
- Unix Shell scripting to call the DataStage jobs from Unix with the help of dsrunjob options.
- Established best practices for DataStage jobs to ensure optimal performance, reusability, and restart ability.
- Responsible for creating complex custom Key Performance Indicator (KPI) reports to identify the number of visitors, enrollers on IBM.com.
- Created various custom KPI reports using Leadership KPI dashboard for IBM Web Presence and IBM Marketplace.
- Interacted with API developers and assisted them in building custom API’s.
- Was an active participant in Scrum Mission and Epic planning, Story pointing, Updating Product backlog, Sprint retrospective.
Environment: DataStage v11.3, DB2 v10.5, Toad 6.1, Unix, Filezilla, PuTTY.
Confidential, Lake Forest, IL
ETL DataStage developer
Responsibilities:
- Worked in PAS (Policy Administration system) project, dealing with administering the Life Insurance policies and the benefits associated with.
- Interacted with the Business users to build functional and source to target mapping documents.
- Interacted with the Mainframe, Message Broker ESB and external vendors from Integration point of view.
- Worked with DataStage components like Designer, Director.
- Built ETL Processes using various transformation stages like Oracle Connector, SQL Server enterprise, Transformer, Join, Merge, Lookup, Remove Duplicates, Aggregator, Change Data Capture, Column Export, XML Input stage, Wait for file Activity, Hierarchical Input, MQ stage for Datamart load and XML processing.
- Developed Unzip and Archive process to consume, Unzip and Archive all the incoming files from external vendor and moving them to the corresponding file locations on server.
- Worked extensively on consuming XML Input files from Message Broker and Mainframe and generating XML files using Hierarchical Input stage.
- Built jobs to write data into Complex flat file stage.
- Worked on modules extracting and processing data from CDC tables in SQL server 2008.
- Used appropriate partitioning techniques for enhancing performance of DataStage jobs extracting bulk loads from Data marts.
- Build Load jobs for Data marts for development and QA environments.
- Participated with the NETOPS team to schedule the DataStage jobs using Control M and setting up FTP accounts in Global scape for Ftp’ing the files to external vendors.
- Performed Unit testing and worked closely with SIT and UAT teams.
- Made sure the ETL code is as per TMK (Trustmark) coding standards.
- Was part of the Peer and Code review board to give a sign off on the code to be moved to QA.
- Responsible for building packages and deploying Data stage code in QA.
- Worked with QA teams to track the defects, fix the defects and closing the defects using ALM Quality center.
- Mentored newly hired junior developers.
Environment: DataStage 11.3, SQL server 2008, FileZilla, Control M, Globalscape, UNIX, PuTTy, HP ALM Quality center 12.01
Confidential, Gaithersburg, MD
ETL Datastage Developer
Responsibilities:
- Analyzing the requirement, understanding the current system, and preparing the mapping specification.
- Work with the functional team to understand the legacy data with respect to CNSI’s homegrown product eCAMS for conversion of MMIS legacy systems.
- Analyze various subsystems (ex: Provider Enrollment, Claims, Enrollment Eligibility, etc.) of MMIS to create mapping docs for conversion of legacy data into eCAMS data model.
- Responsible for converting the data from the current legacy system into the replacement (eCams) as per EDI and HIPPA standards.
- Responsible for designing and implementing robust Extract Transform and Load applications and processes to load data.
- Responsible for the ongoing operational stability of the ETL processes ensuring they are properly monitored and audited to provide data integrity, accuracy and timeliness of delivery.
- Working closely with Data Conversion manager, Application team to understand requirements.
- Developing ETL processes in support of the requirements validate that they meet business and technical specifications.
- Hands on knowledge in creating stored procedures, packages for Authorization module.
- Responsible for creating minus queries for Quantitative and Quality testing.
- Helped HCA in building complex queries for analysis.
- Wrote SQL queries for generating Exception reports.
- Appropriate backups are taken to protect the data integrity.
- Design, build and maintenance of transform rules and processes to derive the correct data from the extracted data and to transform it into the required format.
- Developing and execution of ETL test plans.
- Extensively worked on Parallel Jobs using various stages like Join, Lookup, Filter, Funnel, Copy, Column Generator, Sequential File, Oracle connector, Merge, and Transformer.
- Built jobs to consume XML input and write it to Complex flat file stage.
- Performed Job tuning which helps in reducing the production time for the daily job runs.
- Writing SQL queries as needed per the business requirements to generate applicable reports.
- Performed System testing.
- Mentored new hires/Jr developers.
Environment: DataStage 8.7 / 8.5, SQL developer, TOAD, Oracle 11g, Unix, WinCvs, WinScp, PuTTy 0.63, Clearcase.
Confidential, Deerfield, IL: Sept ‘11 - Oct ‘12
DataStage Developer
340B limits the cost of covered outpatient drugs to certain federal grantees, federally qualified health center look-alikes and qualified disproportionate share. Involved in integrating 850 Mail system into the current 340B, also involved in building several drugs, customer related dimension tables and Lookup and Fact tables. Worked on Data Migration for a new Release (6.0).
Responsibilities:
- Involved in status meetings and interacted with the technical team and business analyst to get the business rules and understand the process.
- Extensively worked on Parallel Jobs WebSphere DataStage and Quality Stage 8.5/8.0.1.
- Imported/Exported table definitions, Repositories and attributes for the designing process.
- Built ETL jobs to populate dimension tables (Type1, Type2), FACT tables, and LOOKUP tables.
- Built ETL jobs for migration of data from Source to Target and extensively worked on the Performance issues to enhance the performance.
- Scheduled Job Sequencers to populate data into the dimension tables at specific times.
- Used DataStage to design and develop jobs for extracting, cleansing, transforming, integrating, and loading data into different Data Marts and Data Warehouse.
- Also worked on Data Migration for a new Release (6.0) independently, worked on mapping logic and performed various transformations.
- Designed Parallel jobs using various stages like Oracle Enterprise, Transformer, Join, Merge, Remove Duplicates, Sort, Filter, Dataset, Lookup, Funnel stage, Column Generator, Peek stages, CDC stage, Lookup fileset
- Enhanced the reusability of the jobs by making and deploying shared containers and multiple instances of the jobs.
- Ran Jobs, Job monitoring using UNIX command line.
- Edited text files, moved and copied files using UNIX scripts.
- Modified existing shell and UNIX scripts to suit the present functional requirements.
- Wrote shell scripts for automation, job run, file processing, initial load, batch loads, cleanup, job scheduling and reports.
- Used DataStage Director effectively to read through the logs and rectify the issues causing warnings and errors.
- Involved in creating, testing, proofing and updating technical documentation for source to target mapping procedures to facilitate better understanding of the process and in corporate changes as and when necessary
- Involved in the migration of DataStage jobs from development to production environment
- Worked on troubleshooting, performance tuning and performance monitoring for enhancement of DataStage jobs
Environment: DataStage 8.5/8.1, SQL developer, Oracle 10g/11g, TeraData V 13, Unix, Microsoft Visio 2007, SQL Assistant, DB2 9.7, XML, Autosys, WinCvs, WinScp, PuTTy 0.61.
