Etl Tech Lead Resume
IowA
PROFESSIONAL SUMMARY:
- 8 years in the information technology and wide range of experience in Software development, Project management, Data Integration, Master Data Management(MDM) andInformatica Data Quality(IDQ).
- Strong Data warehousing experience using Informatica Power Center 10.1/ 9.6/9.0/8.6/8.0/7 (Source Analyzer, Repository Manager, Mapping Designer, Mapplets, Transformations, Workflow Manager, Task Developer),IDQ 10.1/9.5, Power Connect for ETL, OLTP, OLAP, Data Mining, scheduling tool.Worked with heterogeneous source systems like flat files, RDBMS, DWH, parameterizing variables.
- Involved in driving complex discussions with business analyst and systems architect to determine the solution.
- Worked on deployment document preparation and assistance to deployment team while migration.
- Converted the business rules into technical specifications for ETL process for populating Fact and Dimension table of data warehouse.
- Expertise in Master Data Management concepts, Methodologies and ability to apply this knowledge in building MDM solutions.
- Data modelling knowledge in Dimensional Data modeling, Star Schema, Snow - Flake Schema, FACT and Dimensions tables, Physical and logical data modeling and De-normalization techniques.
- Created mappings for various sources like DB2, Oracle, and flat files to load and integrate details to warehouse.
- Scheduled jobs and automated the workload using the Autosys Job Scheduler, Control-M Job Scheduler and Informatica Scheduler.
- Knowledge on implementing hierarchies, relationships types, packages and profiles for hierarchy management in MDM Hub implementation.
- Created IDQ mappings to make data standardized and validated.
- Expertise in Data Warehousing with variety of Data manipulating skills like Data Migration, Data Modeling, Data Profiling, Data Cleansing and Data Validation.
- Worked in a production support role of processing daily, weekly and monthly loads in datastage based upon the business requirements.
- Expertise in OLTP/OLAP System Study, Analysis and E-R modeling, developing Database Schemas like Star schema and Snowflake schema used in relational, dimensional and multidimensional modeling
- Scheduled the ETL jobs daily. Weekly and monthly based on the business requirement in Autosys.
- Experience in integration of Heterogeneous data sources like Oracle, SQL Server 2005/2008, DB2,XML Files, Flat Files into staging area as well as from homogenous sources.
- Performed Unit testing for the mappings developed.
- Scheduled jobs and automated the workload using the Autosys Job Scheduler, Control-M Job Scheduler and Informatica Scheduler.
- Experience in Dimensional Modeling (Erwin), Star / Snowflake Schema, Fact / Dimension Tables, Business Process Analysis, Production support, Data cleansing, Data analysis and Performance tuning of sources, targets, mappings sessions and SQL’s.
- Cleansed, labeled and fix data gaps with IDQ.
- Experienced in UNIX work environment, File Transfers, Job Scheduling and Error Handling.
- Scheduled sessions and batches on the Informatica server using Informatica Workflow manager.
- Performed application systems development tasks which include working with users to define system needs, analyzing, designing and developing applications to meet user needs.
- Provided technical support for very complex, highly critical mapping designs. Plan and coordinate tests, resolve production problems, identify opportunities to improve the performance.
- Tuned the Performance for ETL jobs by tuning the SQL used in Transformations and fine-tuning the database.
- Determined alternate solutions with risk analysis and identified opportunities to improve availability and advance business initiatives.
- Hands on experience in resolving the production issues in 24/7 environment.
- Worked on deploying the product in development environment and exposing the application to rigorous testing via functional, performance and user acceptance testing in test environments.
- Reviewed the code developed by co-team members.
- Experience with Sales, Retail, HealthCare, Financial and Banking Domains.
TECHNICAL SKILLS:
Data Warehousing:: Informatica Power Center 10.2/9.6/9.5/9.0/8.6 , Informatica Analyst, OLAP, OLTP, ETL,AutosysTidal, Informatica Data Quality 10.1/9.5,Data Cleansing, Data Profiling.
Tools: & Utilities: Informatica PowerCenter, Informatica MDM, Informatica Data Director(IDD), SAP Business Objects,Toad,Autosys,Control- M,Putty, SQL Developer, Tableau, Qlikview,Tidal,SERVICE NOW
Databases:: Teradata, Oracle 11g/10g/9i, MS SQL Server 2008/2005
Operating Systems: Linux, UNIX, Windows, Sun Solaris 2.x
Languages/Web:: SQL, PL/SQL, UNIX,C, JAVA,PERL
PROFESSIONAL EXPERIENCE:
Confidential, Iowa
ETL Tech Lead
Tools: Informatica10.2
Operating system: Windows XP/Win 7/Win 8, LINUX and UNIX.
Database: Teradata, Microsoft SQL Server
Responsibilities:
- As an ETL Tech lead, lead the ETL development for enhancements in Data warehouse.
- Gathering requirements from the Data Modelers and understanding the design from the technical analysis provided.
- Analyzing the technical documentation and concluding the design of the ETL loads.
- Extracting the data from the Relational Databases, Flat files and Xml using ETL process.
- Developing the ETL mappings according to the loads for Stage and Reporting.
- Building mappings, workflows in a cost effective manner.
- Worked on all phases of data warehouse development life-cycle, ETL design and implementation, and support of new and existing applications.
- Created generic rules in Informatica developer as per the business.
- Involved in analyzing business requirements and translating requirements into functional and technical design specifications.
- Responsible for creating the data maps, extracting (incremental) CDC data from Mainframe sources, exporting and updating them to the repository, importing the required source files on the staging environment by using Informatica Power Exchange.
- Designed complex UNIX scripts and automated it to run the workflows daily, weekly and Monthly.
- Used Debugger in Informatica Power Center Designer to check the errors in mapping.
- Used Debugger wizard to remove bottlenecks at source level, transformation level, and target level for the optimum usage of sources, transformations and target loads.
- Support true ad hoc query by having predictable and consistent query performance for all queries and no requirement for known query workloads or precomputation of aggregates or summaries using tableau.
- Captured data error records corrected and loaded into target system.
- Implemented efficient and effective performance tuning procedures.
- Resolving performance issues by understanding the bottles necks at various levels and tuning them for better performance.
- Resolving productions issues for any scheduled jobs failures and reporting issues to the concerned teams.
- Documenting the Cut over plans, Design documents and Run books for the Production support teams.
Confidential, New Jersey
ETL Tech Lead
Tools: Informatica10.1/9.5.1,InformaticaDataQuality10.1/9.5,Toad,Autosys,InformaticaMDM, Informatica Data Director(IDD),Tableau
Operating system: Windows XP/Win 7/Win 8, LINUX and UNIX.
Database: Oracle 9i, Oracle 10g,Teradata
Responsibilities:
- As an ETL Tech lead, lead the ETL development for enhancements in Data warehouse.
- Gathering requirements from the Data Modelers and understanding the design from the technical analysis provided.
- Analyzing the technical documentation and concluding the design of the ETL loads.
- Extracting the data from the Relational Databases, Flat files using ETL process.
- Developing the ETL mappings according to the loads for Stage and Reporting.
- Worked on data profiling & various data quality rules development using Informatica Data Quality.
- Building mappings, workflows in a cost effective manner.
- Worked on all phases of data warehouse development life-cycle, ETL design and implementation, and support of new and existing applications.
- Designed, Developed and implemented Informatica Developer Mappings for data cleansing using Address validator,Labeler, Association, Parser, Expression, Filter, Router, Lookup transformations etc.
- Imported mapplets and mappings from Informatica developer (IDQ) to Power Center.
- Created generic rules in Informatica developer as per the business.
- Worked with IDQ toolkit, Analysis, data cleansing, data matching, data conversion, reporting and monitoring capabilities.
- Responsible for creating the data maps, extracting (incremental) CDC data from Mainframe sources, exporting and updating them to the repository, importing the required source files on the staging environment by using Informatica Power Exchange.
- Involved in analyzing business requirements and translating requirements into functional and technical design specifications.
- Designed complex UNIX scripts and automated it to run the workflows daily, weekly and Monthly.
- Used Debugger in Informatica Power Center Designer to check the errors in mapping.
- Involved in implementing the Land Process of loading the customer Data Set into Informatica MDM from various source systems.
- Worked on data cleansing and standardization using Cleanse Adapter’s in Informatica MDM.
- Used Debugger wizard to remove bottlenecks at source level, transformation level, and target level for the optimum usage of sources, transformations and target loads.
- Support true ad hoc query by having predictable and consistent query performance for all queries and no requirement for known query workloads or precomputation of aggregates or summaries using tableau.
- Captured data error records corrected and loaded into target system.
- Implemented efficient and effective performance tuning procedures.
- Used Address validator transformation in IDQ and passed the partial address and populated the full address in the target table.
- Resolving performance issues by understanding the bottles necks at various levels and tuning them for better performance.
- Resolving productions issues for any scheduled jobs failures and reporting issues to the concerned teams.
- Documenting the Cut over plans, Design documents and Run books for the Production support teams.
Confidential, Minneapolis, MN
Informatica Developer
Tools: Informatica 9.5.1, Toad, Informatica Data Quality,Autosys,Qlikview
Operating system : Windows XP/Win 7/Win 8, LINUX and UNIX,AS400
Database : SQL Server, Oracle,Teradata
Responsibilities:
- Extracting the data from the Relational Databases, Flat files using ETL process.
- Used Informatica Version Control for checking in all versions of the objects used in creating the mappings, workflows to keep track of the changes in the development, test and production environment.
- Developed UNIX shell scripts to scheduling Scripts by using scheduling tools.
- Thorough Validation on source data and the load in the dimension and fact tables.
- Developed new Informatica mappings and workflows based on specifications.
- Extensively used XML transformation to generate target XML files.
- Involved in Using Parameters, Variables, for doing incremental loads and CDC.
- Created mappings to load different sources sent by IMS and CDC (Flat files, Oracle tables) to Target Oracle database.
- Used Session parameters, Mapping variable/parameters and created Parameter files for imparting flexible runs of workflows based on changing variable values.
- Implemented Type 2 Slowly Changing Dimensions to maintain the historical data in sales Data mart as per the business requirements.
- Worked on development of metric dashboards via Tableau data at varying levels of complexity.
- Created IDQ mappings to make data standardized and validated.
- Worked with Informatica Data Quality (IDQ) toolkit, Analysis, data cleansing, data matching, data conversion, exception handling, and reporting and monitoring capabilities of IDQ.
- Cleansed, labeled and fix data gaps with IDQ.
- Developed and tested all the backend programs, Error Handling Strategies and update processes.
- Building mappings, workflows in a cost effective manner.
- Worked on all phases of data warehouse development life-cycle, ETL design and implementation, and support of new and existing applications.
- Involved in analyzing business requirements and translating requirements into functional and technical design specifications
- Used Debugger wizard to remove bottlenecks at source level, transformation level, and target level for the optimum usage of sources, transformations and target loads.
- Captured data error records corrected and loaded into target system.
- Implemented efficient and effective performance tuning procedures.
Confidential, Kinnelon, NJ
Informatica Developer
Tools: Informatica 9.5.1, Toad, Autosys
Operating system: Windows XP/Win 7/Win 8, LINUX and UNIX.
Database : SQL Server, Oracle
Responsibilities:
- Understanding business needs and implement the same into a functional database design.
- Participated in requirements gathering.
- Involved in all the phases of SDLC.
- Developed new Informatica mappings and workflows based on specifications.
- Developed Batch Processing, Source and Target Reconciliation.
- Designed and developed various Informatica mappings using transformations like Expression, Aggregator, External Procedure, Stored Procedure, Lookup, Filter, Joiner, Rank, Router, and Update Strategy. Developed various Ad-hoc mappings for various business needs.
- Performed extraction, transformation and loading of data from RDBMS tables, Flat Files into Oracle in accordance with requirements and specifications.
- Executed various staging data validation strategies, to ensure/improve data quality. Extensively worked on the source EDW warehouse data analysis on various data domains-claims, provider, members, Medicaid waivers, pharmacy data for reporting
- Experience in using Normalizer transformation for normalizing the XML source data.
- Extensively used XML Parser transformation to generate target XML files.
- Developed and tested all the backend programs, Error Handling Strategies and update processes.
- Provided technical support for very complex, highly critical mapping designs. Plan and coordinate tests, to resolve production issues.
- Developed UNIX Shellscripts to automate applications, Schedule jobs,develop interfaces and Created pre-session and post-session shell scripts and mail-notifications.
- Involved in Analyzing Source system and designing low level design for the mappings.
- Involved Data loading Sequence and Populated Data into Staging area and Warehouse with Business Rules.
- Developing the transformation logic, Identifying and tracking the slowly changing dimensions, heterogeneous sources and determining the hierarchies in dimensions.
- Involved in the Development of Informatica mappings and also tuned them for better performance.
- Fixed invalid Mappings, Unit and Integration Testing of Informatica Sessions, Batches and Target Data.
- Implement performance tuning logic on Targets, Sources, mappings, sessions to provide maximum efficiency and performance.
- Used most of the Transformations such as Source Qualifier, Joiner, Expression, Aggregator, Lookups, Filters, Stored Procedures, Update Strategy and Sequence Generator while designing mappings.
- Prepared Unit test cases for the mappings.
Confidential
Informatica Developer
Tools : Informatica 8.6.1, SQL Developer, Control-M, Informatica MDM,Tidal
Operating system: Windows XP/Win 7/Win 8, LINUX and UNIX.
Database: SQL Server, Oracle
Responsibilities:
- Involved in analyzing business requirements and translating requirements into functional and technical design specifications.
- Created different Transformations for loading the data into target like Source Qualifier, joiner transformation, Update Strategy, Lookup transformation, Rank transformations, Expressions, Aggregator and Sequence Generator.
- Worked with Power Center- Designer tool in developing mappings and Mapplets to extract product, customer and sales and load the data from flat files and load to the Data Warehouse.
- Determine alternate solutions with risk analysis and identified opportunities to improve availability and advance business initiatives.
- Worked on scheduling jobs using tidal Scheduling tool.
- Worked on Informatica MDM Hub configurations - Data modelling & Data Mappings (Landing, staging and Base Objects), Data validation, Match and Merge rules, writing and customizing user exits.
- Created reusable transformations and Mapplet to use in multiple mappings.
- Used Informatica repository manager to backup and migrate metadata in development, test and production environments.
- Used various lookup caches like Static, Dynamic, and Persistent in Lookup transformation to identify by the incremental data relevant ETL process.
- Created mappings for various sources like DB2, Oracle, and flat files to load and integrate details to warehouse.
- Created staging tables to do validations against data before loading data into original fact and dimension tables.
- Tuned the Performance for ETL jobs by tuning the SQL used in Transformations and fine-tuning the database.
- Scheduled the ETL jobs daily. Weekly and monthly based on the business requirement in Autosys.
Confidential
Tools: Informatica 8.1.1, SQL Developer, Control-M
Operating system : Windows XP/Win 7, LINUX and UNIX.
Database : SQL Server, Oracle
Responsibilities:
- Developed different mappings by using different Transformations like Aggregator, Lookup, Expression, update Strategy, Joiner, Router etc to load the data into staging tables and then to target.
- Created ETL mappings using Informatica Power Center to move Data from multiple sources like Flat files, Oracle into a common target area such as Staging, Data Warehouse and Data Marts.
- Involved into source code review, the mappings created by my team members.
- Involved in deployment document and assisted to deployment team while migration.
- Used Workflow Manager for Creating, Validating, Testing and running the sequential and concurrent Sessions.
- Creating Unit test cases for the Informatica mappings.
- Developed the automated and scheduled load processes using Control-m scheduler.
- Created Folders using Informatica PowerCenter Repository Manager to store Source, Target, Transformations, Mapplets and Mappings Meta Data Information..
- Implemented Type 2 Slowly Changing Dimensions to maintain the historical data in Data mart as per the business requirements.
- Created sessions, sequential and concurrent batches for the mappings using Workflow Manager.
- Involved in Unit testing for the mappings developed by myself.
- Involved in Designing and monitoring the jobs using Control-M tool based on user needs.
- Created, scheduled and monitored the sessions and batches on the basis of the run on command, run on time using Informatica Power Center Workflow Manager.
- Discussing the technical way of development with team lead.
- Doing the review of code developed by co-team members
