Lead Etl Developer Resume
4.00/5 (Submit Your Rating)
CT
SUMMARY
- 11.5 years of diversified IT experience in all the phases of design, development, testing, migration and Application Support of full life cycle of Data Warehousing and Data Migration implementation.
- Experience in DWH methodologies e.g. Target to Source and Source to Target Mappings , Data Profiling, Data Cleansing, Data Validation, Data Verification, Data Analysis etc. to support full life cycle of Business Intelligence implementations .
- Used Informatica power center 9.0.x and IBM InfoSphere DataStage 11.x to create ETL programs, performance tuning of ETL programs, job scheduling, troubleshooting, performance tuning and monitoring etc.
- Used Netezza DB Appliance, Oracle PL/SQL and DB2 to create stored procedure, perform data analysis to test ETL jobs, create ETL Jobs and working in Production Support.
- Developed Unix Scripts and Python scripts to automate data profiling, data validations etc. in staging area (DB installed in Unix Server) and in the AWS cloud.
- Developed automation and scheduling jobs using Python crontab feature in AWS Cloud.
- Used several tools such as IBM - Jazz, JIRA, Embarcadero, Erwin, Confidential Console, MS office applications, SQL * Plus 8, Squirrel, SVN.
- Past experience in working with Micro strategy and Cognos.
- Methodologies followed: Agile Practice, Waterfall Methods
PROFESSIONAL EXPERIENCE
Confidential, CT
Data Migration Lead, Lead ETL Developer
Technologies: Informatica 9.0, Data Stage 11.3, UNIX, Python, AWS, DB2, Embarcadero, IBM JazzResponsibilities:
- Created and delivered documentations like data migration strategy, data bridging solution, data mapping, data profiling and cleansing reports, data validation and data verification scenarios and reports etc.
- Conducted data mapping session with client, finalize transformation rules and create ETL design documents.
- Developed ETL program with Informatica to extract data from source e.g. Flat files, VSAM files, DB2, Excel and XML.
- Used DataStage to apply transformation logic to migrate legacy data from the staging area in to the Final DM DB.
- Finalized standard of ETL jobs to ensure performance and quality and provided guidance to the ETL developers.
- Tested ETL programs and perform rejection analysis by writing SQL Queries in DB2.
- Developed Unix Scripts and Python scripts to automate data profiling, data validations etc in staging area and in the cloud.
- Involved in conducting the review of ETL Code, Unit Test Cases & Results with the Developers
- Involved in detailed technical design and provide KT to the QA team.
- Create & publish the daily and weekly progress reports of the Data Migration Project
- Coordinate and communicate with functional/business leads, test leads, and developers across different locations
- Analyze and provide mitigation plan for identified risks and issues.
- Experience in leading the ETL team and helping management with resource planning, effort estimation, status reporting, task planning and assignment etc.
- Break up the work into task list and estimate based on simple, medium and complex methodology to help management in resource planning and effort estimation.
- Divide stories in to tasks, create Jazz task, assign to team members and track daily progress.
Confidential, Chicago, IL
DataStage Developer, Onsite Coordinator
Technologies Tools: DataStage 8.1, UNIX, Netezza, JiraResponsibilities:
- Worked closely with the Measurement Science team to understand updated formula of facts and update data mapping documents, existing data models, UNIX scripts and DataStage Jobs.
- Extensively used Netezza analytic functions to unit test ETL Jobs to ensure correctness of Fact calculations.
- Manage tasks and deadlines for the ETL development teams both at offshore and onsite.
- Break up the work into task list and estimate based on simple, medium and complex methodology to help management in resource planning and effort estimation.
- Performance tuning of DataStage jobs.
- Organize daily technical discussions with the onsite and offshore teams to set expectations for offshore delivery, doubt clarification.
- Provided weekly and monthly project status to the Nielsen and TCS management.
- Code migration between development, testing and production environment.
- Provide warranty support of ETL Jobs post production.
- Create ETL Folder structure at the UNIX server & Client repository set up.
- Got introduced to HDFS eco system in this project.
Confidential, Chicago, IL
Tech Lead, Support Analyst
Technologies Tools: DataStage, Informatica, UNIX, Netezza, JiraResponsibilities:
- Trigger master scripts from Confidential and monitor DataStage jobs in FCM and Informatica mappings in Factory production interfaces.
- Investigate the root cause of all major and minor issues in production environment.
- Create defect for development team for issues in logics found during data analysis in Jira and provide work around for the issues.
- Create automation with Unix scripting for basic file handling for issue analysis like presence of unstructured or control M character in input files, corrupt files, repetitive data analysis scenarios etc.
- Leading severity one ticket resolution with TCS Incident Management team till its closure to make sure there will be no slippage on SLA.
- Co-Ordinate with Offshore Team and participate in daily hand over take over calls.
- Create, evaluate and send daily (as appropriate), weekly and release status communications to the project leadership.
- Organizing meeting with clients on the production tickets and understanding the severity and exact issues to make sure providing exact solution with in SLA.
- Work with Project Managers/Delivery Managers/Client to schedule code migration.
- Assist Project Lead/PM/BA in project coordination.
- Conduct project risk identification and mitigation action planning with the project manager.
- Reprioritize and distributed production tickets among the team.
- Helped the team to resolve the technical issues and other challenges faced during project execution.
Confidential, Chicago (IL)
Informatica Developer
Technologies Tools: Informatica, UNIX, Netezza, MicrostrageyResponsibilities:
- Worked in the Factory module to create Informatica mappings to populate product, store, exhibition, location, time dimensions and final fact table.
- Created Informatica mappings to support the change request in the Factory Module.
- Performed unit testing of the Informatica mappings.
- Analysis & fix on QA defects made by QA team and defects created by Product support team.
- Involved in job performance tuning of Informatica mappings.
- QA & Production deployment.
- Participated in high level and low level ETL design.
- Involved in end to end delivery of multiple POC using Data Stage, Micro Strategy and Netezza in the UNIX environment.