Sr. Etl/informatica Mdm Consultant Resume
Grand Rapids, MichigaN
SUMMARY:
- Overall 8 years of Software Life Cycle experience in System Analysis, Design, Development, Implementation, Maintenance, and Production support of Data Warehouse Applications.
- Extensive experience inETL/Informatica Power Center and data integration experience in developingETL mappingsand scripts usingInformatica Power Center 10.x/9.x/8.x/7.x, IDQ.
- Have clear understanding of Data Warehousing and BI concepts with emphasis on ETL and life cycle development using Power Center, Repository Manager, Designer, Workflow Manager and Workflow Monitor.
- Experience in creatingHigh Level Design and Detailed Designin the Design phase.
- Extensively worked on the ETL mappings, analysis and documentation of OLAP reports requirements. Solid understanding of OLAP concepts and challenges with large data sets.
- Strong experience in designing and developing complex mappings from varied transformation logic like Unconnected and Connected, Static and Dynamic lookups, Java, SQL, Stored Procedure, Router, Filter, Expression, Aggregator, Joiner, Update Strategy.
- Strong knowledge of Entity - Relationship concept, Facts and dimensions tables, slowly changing dimensions and Dimensional Modeling (Star Schema and Snow Flake Schema).
- Experience working on Informatica MDM to design, develop, test, review & optimize Informatica MDM.
- Expertise in creating Mappings, Trust and Validation rules, Match Path, Match Column, Match rules, Merge properties and Batch Group creation.
- Experience in creation and maintenance of entity objects, hierarchies, entity types, relationship objects.
- Relationship types using Hierarchy tool to enable Hierarchy Manager (HM) in MDM HUB implementation.
- Hands on experience in design and configuration of landing tables, staging tables, base objects, hierarchies, foreign - key relationships, lookups, query groups, queries/custom queries and packages.
- Good understanding of relational database management systems like Oracle, DB2, SQL Server and worked on Data Integration using Informatica for the Extraction transformation and loading of data from various database source systems.
- Worked on IDQ/IDE tools for data profiling, data enrichment and standardization.
- Experience in development of mappings in IDQ to load the cleansed data into the target table using various IDQ transformations. Experience in data profiling and analyzing thescorecardsto design the data model.
- Expertise in Business Model development withDimensions, Hierarchies, Measures, Partitioning, Aggregation Rules, Time Series, Cache Management.
- Extensively created Mapplets, common functions, reusable transformations, look-ups for better usability.
- Extensively used SQL, PL/SQL in writing Stored Procedures, Functions, Packages and Triggers.
- Experience in UNIX shell scripting, job scheduling and server communication.
- Involved inUnit testing, System testingto check whether the data loads into target are accurate.
- Extensive database experience and highly skilled in SQL Server, Oracle, DB2, Sybase, XML Files, Flat Files, MS Access.
- Excellent communication skills and result-oriented with minimum supervision, problem solving skills and team player.
TECHNICAL SKILLS:
ETL Tools: Informatica 10.1/9.6/9.1/8.6.1/8.1 Source Analyzer, Mapping Designer, Workflow Monitor, Workflow Manager, Data Cleansing, Data Quality, Repository, Metadata, Data Mart, OLAP, OLTP, IDQ, MDM, IDD, SQL Server SSIS.
Data modeling tools: Erwin
Databases: Oracle 11g/10g/9i/8i, IBM: DB2, MSSQL Server
Other Tools: Toad, SQL Developer, Crystal Reports, SQL Assistant
Programming Languages: SQL, Java, PL/SQL, T: SQL, UNIX Shell Scripting
Job scheduling: Shell Scripting, Autosys, Tidal, Control M
Environment: MS Windows 2012/2008/2005 , UNIX
PROFESSIONAL EXPERIENCE:
Confidential, Grand Rapids, Michigan
Sr. ETL/Informatica MDM Consultant
Responsibilities:
- Worked with business analysts for requirement gathering, business analysis, and translated the business requirements into technical specifications to build the Enterprise data warehouse.
- Design and developed end-to-end ETL process from various source systems to Staging area, from staging to Data Marts.
- Worked on Informatica Power Center tools- Mapping Designer, Repository Manager, Workflow Manager and Workflow Monitor.
- Involved in creating data models using Erwin.
- Worked with Designer tools like Source Analyzer, Target designer, Mapping designer, Mapplet designer, Transformation Developer.
- Created Mappings and used transformations like Source Qualifier, Filter, Update Strategy, Lookup, Java, Expression, Router, Joiner, Normalizer, Aggregator Sequence Generator and Address validator.
- Developed mappings to load Fact and Dimension tables, SCD Type 1 and SCD Type 2 dimensions and Incremental loading and unit tested the mappings.
- Created work flows and sessions for each mapping that we are extracting from source systems to staging area; staging area to target.
- Extensively created Re-Usable Transformations and Mapplets to standardized Business logic.
- Implemented performance tuning logic on targets, sources, mappings, sessions to provide maximum efficiency and performance.
- Responsibilities include creating the sessions and scheduling the sessions.
- Used the PL/SQL procedures for Informatica mappings for truncating the data in target tables at run time.
- Involved with Data Steward Team for designing, documenting and configuring Informatica Data Director for supporting management of MDM data.
- Analyze the business data and defined the Match and Merge rules and Trust Scores for MDM Hub.
- Identify (Golden Record/Best version of the Truth/ Single source of truth) by analyzing the data coming from various source systems.
- Involved in creating the entity objects, hierarchies, entity types, relationship objects and relationship types using Hierarchy tool to enable Hierarchy Manager (HM) in MDM HUB implementation and Informatica Data Director (IDD).
- Define Trust and validation rules before loading the data into the base tables.
- Publish the Data using Message Queues to notify external applications on data change in MDM Hub Base Objects.
- Worked on match/merge and ran match rules to check the effectiveness of MDM process on data.
- Implemented IDD using hierarchy configuration and created subject area groups, subject areas, subject area child, IDD display packages in hub and search queries.
- Involved in defining and configuring the schema, staging tables, landing tables, base objects foreign-key Relationships, look up systems and tables, packages, query groups and queries/custom queries.
- Define the Trust Score Validation rules, Match rules and Merge settings.
- Develop and maintain the master and translation entities in the MDM Hub and publish the data into ERP s for supporting the ongoing business support.
- Prepared SQL Queries to validate the data in both source and target databases.
- Actively participated in Scrum Meetings.
- Designed and developed the ETL processes using Informatica to load data from Oracle, Flat files and XML files to target Oracle Data warehouse.
- Tuned performance of Informatica session for large data files by increasing block size, data cache size, sequence buffer length and target-based commit interval.
- Created partitioned tables, indexes for manageability and scalability of the application.
- Leveraged workflow manager for session management, database connection management and scheduling of jobs.
- Developed various mapping and tuning using Oracle and SQL*Plus in the ETL process.
- Involved in testing of Stored Procedures and Functions, Unit and Integrating testing of Informatica Sessions, Batches and the Target Data.
- Created control-M jobs and scheduled them.
- Experience in scheduling of ETL jobs using Autosys, Tidal, Control-M.
- Created Test cases and Test Plans for unit testing.
- Supported during QA/UAT/PROD deployments and bug fixes.
- Created Unix Shell Scripts for Informatica ETL tool to automate sessions and cleansing the source data.
- Documented and presented the production/support documents for the components developed, when handling over the application to the product support team.
Environment: Informatica Power Center 10.1, Informatica MDM 10, IDD, Oracle 11g, UNIX, PL/SQL, SQL* PLUS, Java, TOAD, MS Excel.
Confidential, Ann Arbor, Michigan
Sr. Informatica MDM Developer
Responsibilities:
- Interacted actively with Business Analysts and Data Modelers on Mapping documents and Design process for various Sources and Targets.
- Developed rules and Mapplets that are commonly used in different mappings.
- Created complex mappings in Power Center Designer using Aggregate, Expression, Filter, and Sequence Generator, Update Strategy, Union, Lookup, Joiner, XML Source Qualifier and Stored procedure transformations.
- Worked on Power Center Tools like designer, workflow manager, workflow monitor and repository manager.
- Parsed high-level design specification to simple ETL Java coding and mapping standards.
- Involved in building the ETL architecture and Source to Target mapping to load data into Data warehouse.
- Created mapping documents to outline data flow from sources to targets.
- Involved in Dimensional modeling (Star Schema) of the Data warehouse and used Erwin to design the business process, dimensions and measured facts.
- Extracted the data from the flat files and other RDBMS databases into staging area and populated onto Data warehouse.
- Used various transformations like Filter, Expression, Sequence Generator, Update Strategy, Joiner, Stored Procedure, and Union to develop robust mappings in the Informatica Designer.
- Defined the Base objects, Staging tables, foreign key relationships, static lookups, dynamic lookups, queries, packages and query groups.
- Involved in Informatica MDM where data Cleansing, De-duplication and Address corrections were performed.
- Identify Golden Record (BVT/SSR) analyzing the data and duplicate records coming from different source systems.
- Define the Trust and Validation rules and setting up the match/merge rule sets to get the golden master records.
- Involved in implementing the Land Process of loading the Incoming Data Set into Informatica MDM from various source systems.
- Used Hierarchies tool for configuring entity base objects, entity types, relationship base objects, relationship types, profiles, put and display packages and used the entity types as subject areas in IDD.
- Implement Informatica MDM including data profiling configuration specification and coding match rules tuning migration.
- Define and build best practices regarding creating business rules within the Informatica MDM solution.
- Worked extensively to develop customized MDM services.
- Maintained MDM jobs and Master Data sequences, Build test scripts for unit testing of customized MDM Java code.
- Worked on data cleansing using the cleanse functions in Informatica MDM.
- Running the Stage Jobs, Load Jobs, Match and Merge Jobs using the Batch Viewer and Automation Processes.
- Implemented IDD using hierarchy configuration and created subject area groups, subject areas, subject area child.
- Rolled out new MDM Hub for portals in conjunction with user interface on IDD application.
- Worked on Data Quality checks for data feeds and performance tuning.
- Worked on data analysis to find the data duplication and existed data pattern using a data profiling tool.
- Involved in developer testing, unit testing and helped the testing team for data integrity and consistency.
- Experience in scheduling of ETL jobs using Autosys, Tidal, Control-M.
- Supported during QA/UAT/PROD deployments and bug fixes.
- Created Unix Shell Scripts for Informatica ETL tool to automate sessions and cleansing the source data.
Environment: Informatica Power Center 9.6, Informatica MDM 9.6, IDD, Oracle 11g, UNIX, PL/SQL, IDQ, SQL* PLUS, TOAD, MS Excel .
Confidential, Dallas, Texas
Sr. Informatica MDM/IDQ Developer
Responsibilities:
- With the users and making changes to Informatica mappings according to the Business requirements.
- Developed the Informatica mappings using various transformations, Sessions and Workflows. SQL Server was the target database, Source database is a combination of Flat files, Oracle tables, People Soft, Excel files, CSV files etc.
- Worked on all facets of MDM implementations including Data Profiling metadata acquisition data migration, validation and pre landing processing.
- Developed the Informatica Mappings by usage of Aggregator, SQL overrides usage in Lookups, source filter usage in Source qualifiers and data flow management into multiple targets using Router.
- Optimizing the Mappings and implementing the complex business rules by creating re-usable transformations and Mapplets.
- Involved in Informatica MDM hub configuration, IDQ cleanse function implementation, Hierarchy Configuration in MDM hub.
- Used Metadata manager for validating, promoting, importing and exporting repositories from development environment to testing environment.
- Analyzed the source system for integrity issues to the data resided in various source systems and defined the same in Systems and Trust.
- Worked on data cleansing and standardization using the cleanse functions in Informatica MDM.
- Created landing tables, Staging tables and Base Tables as per the data model and data sources.
- Implemented batch process using automation and real time integration with Power Center for JMS interfacing with MDM HUB.
- Develop and maintain the master and translation entities in the MDM Hub and published the data to downstream applications.
- Worked with IDQ toolkit, Analysis, data cleansing, data matching, data conversion, reporting and monitoring capabilities.
- Worked withInformatica Developer (IDQ)tool to ensure data quality to the consumers.
- Used the Address Doctor Geo-coding table to validate the address and performed exception handling reporting and monitoring the data.
- Created Reference/Master data for profiling using IDQ Analyst tools.
- Experience in Data Quality Analysis, Data Profiling, Data cleansing and Master data management.
- Involved in massive data profiling using IDQ (Analyst tool) prior to data staging.
- Worked with Informatica and other consultants to develop IDQ plans to identify possible data issues.
- Involved in deployment of IDQ mappings to application and to different environments.
- Worked on Data Quality checks for data feeds and performance tuning.
- Worked on data analysis to find the data duplication and existed data pattern using a data profiling tool, IDE.
- Monitoring the Data Quality, Generating weekly/monthly/yearly statistics reports on production processes - success / failure rates for causal analysis as maintenance part and Enhancing exiting production ETL scripts.
- Data if validated from third party before providing to the internal transformations should be checked for its accuracy (DQ).
- Used Address validator transformation forvalidating various customers address from various countries by using SOAP interface
- Leveraged workflow manager for session management, database connection management and scheduling of jobs.
- Developed various mapping and tuning using Oracle and SQL*Plus in the ETL process.
- Involved in testing of Stored Procedures and Functions, Unit and Integrating testing of Informatica Sessions, Batches and the Target Data.
- Created Unix Shell Scripts for Informatica ETL tool to automate sessions and cleansing the source data.
- Experience in scheduling of ETL jobs using Autosys, Tidal, Control-M.
- Actively participated in Scrum Meetings.
- Created Test cases and Test Plans for unit testing.
- Supported during QA/UAT/PROD deployments and bug fixes.
- Created Unix Shell Scripts for Informatica ETL tool to automate sessions and cleansing the source data.
Environment: Informatica Power Center 9.5.1, MDM, IDQ, Oracle 11g, UNIX, PL/SQL, SQL* PLUS, TOAD, MS Excel .
Confidential, Phoenix, AZ
Sr. ETL/Informatica MDM Developer
Responsibilities:
- Responsible for developing, support and maintenance for the ETL (Extract, Transform and Load) processes using Informatica MDM/Power Center 9.1 by using various transformations like Expression, Source Qualifier, Filter, Router, Sorter, Aggregator, Update Strategy, Connected and unconnected look up etc.
- Interacted with the users and making changes to Informatica mappings according to the Business requirements.
- Extensively created Re-Usable Transformations and Mapplets to standardized Business logic.
- Mappings, Mapplets and Sessions for data loads and data cleansing. Enhancing the existing mappings where changes are made to the existing mappings using Informatica Power center.
- Used various active and passive transformations like Filter, Router, Expression, Source Qualifier, Java, Joiner, Look up, Update Strategy, Sequence Generator, Rank and Aggregator Transformation.
- Involved in massive data cleansing prior to data staging from flat files.
- Created Use-Case Documents to explain and outline data behavior.
- Implemented slowly changing dimensions Type 2 using ETL Informatica MDM tool.
- Created mapping documents to outline source-to-target mappings and explain business-driven transformation rules.
- Involved in designing and developing logical and physical data models to best suit the requirements.
- Worked with different Caches such as Index cache, Data cache, Lookup cache (Static, Dynamic and Persistence) and Join cache while developing the Mappings.
- Created partitions for parallel processing of data and worked with DBAs to enhance the data load during production.
- Overall responsibility for the day-to-day operations and oversight of the Metadata Repository.
- Developed shell scripts, PL/SQL procedures, for creating/dropping of table and indexes of performance for pre and post session management.
- DevelopedPL/SQL triggersandmaster tablesfor automatic creation of primary keys.
- Created PL/SQLstored procedures, functions and packagesfor moving the data from staging area to data mart.
- Performed Unit testing on the Informatica MDM code by running in the debugger and writing simple test scripts in the database thereby tuning it by identifying and eliminating the bottlenecks for the optimum performance.
- Involved in fixing invalid Mappings, Testing of Informatica Sessions, Worklets and Workflows.
- Knowledge in working with Informatica Power Exchange.
- Converted business requirements into highly efficient, reusable and scalable Informatica ETL processes.
- Involved, Conducted and participated in process improvement discussions and recommending possible outcomes and focused on production application stability and enhancements.
Environment: Informatica MDM, Power Center 9.1, Oracle 10g, PL/SQL, Java, UNIX, SQL* PLUS.
Confidential, Pleasanton, CA
Sr. ETL Developer
Responsibilities:
- Used Informatica as ETL tool, and stored procedures to pull data from source systems/ files, cleanse, transform and load data into databases.
- Worked with different Caches such as Index cache, Data cache, Lookup cache (Static, Dynamic and Persistence) and Join cache while developing the Mappings.
- Assisted the team in the development of design standards and codes for effective ETL procedure development and implementation.
- Performed ILIT (Irrevocable Life Insurance Trust) implementation and replacement activities.
- Created detailed Technical specifications for the ETL processes.
- Involved in the mirroring of the staging environment to production.
- Developed the Informatica mappings using various transformations, Sessions and Workflows. SQL Server was the target database, Source database is a combination of Flat files, Oracle tables, Excel files, CSV files etc.
- Extensively used Transformations like Source Qualifier, Expression, Filter, Aggregator, joiner, lookup, Sequence Generator, Router, Sorter and Stored Procedures. And used debugger to test the mappings and fixed the bugs.
- Optimizing the Mappings and implementing the complex business rules by creating re-usable transformations and Mapplets.
- Fixing and tracking mapping defects and implementing with enhancements.
- Developed and tested Stored Procedures for initial bulk loads and batch processing
- Extensively involved in implementing NormalLoads, BulkLoads, InitialLoads, IncrementalLoads, Dailyloads and Monthlyloads.
- Worked on Modification of Actuate report to upload and run reports on servers.
- Worked on Perl for writing scripts handling flat files such as validating file formats, encryption/decryption, SFTP/FTP etc.
- Used Informatica command task to transfer the files to bridge server to send the file to third party vendor.
- Took part in migration of jobs from UIT to SIT and to UAT
- Involved in writing UNIX shell scripts for Informatics ETL tool to run the Sessions.
- Used mapping parameters and variables for pulling incremental loads from source
- Identified and fixed the Bottle Necks and tuned the Mappings and Sessions for improving performance. Tuned both ETL process as well as Databases.
- Defined the program specifications for the data migration programs, as well as the necessary test plans used to ensure the successful execution of the data loading processes.
- Worked on all phases of multiple projects from initial concept through research and development, implementation, QA, to live production, by strict adherence to project timelines.
- Managed production issues and delivered all assignments/projects within specified time lines.
Environment: Informatica Power Center 8.6, SQL server 2008, SQL, Autosys, UNIX.
Confidential, Bloomington, IL
ETL Informatica Developer
Responsibilities:
- Coordinated with Business Users for requirement gathering, business analysis to understand the business requirement and to prepare Technical Specification documents (TSD) to code ETL Mappings for new requirement changes.
- Designed the ETL processes using Informatica to load data from Oracle, Flat Files, XML Files to target Oracle Data Warehouse database.
- Extensively used Informatica Power Center 8.6.1 to create and manipulate source definitions, target definitions, mappings, mapplets, transformations, re-usable transformations, etc.
- Created sessions and workflow for designed mappings.
- Performed data manipulations using various Informatica Transformations like Joiner, Expression, Lookup, Aggregate, Filter, Update Strategy, and Sequence Generator etc.
- Involved in loading the data from Source Tables to ODS (Operational Data Store) Tables using Transformation and Cleansing Logic using Informatica.
- Designed and developed various mappings focusing on SCD2 and SCD1 implementation.
- Developed PL/SQL procedures for processing business logic in the database.
- Performed Code review to ensure that ETL development was done according to the company’s ETL standard and that ETL best practices were followed.
- Used Update Strategies for cleansing, updating and adding data to the existing processes in the warehouse.
- Migrated the mapping to the testing and production department and introduced the concepts of Informatica to the people in testing department.
- Worked on ETL strategy to store data validation rules, error handling methods to handle both expected and non expected errors and documented it carefully.
- Designed and developed UNIX shell scripts as part of the ETL process to compare control.
- Involved in Performance Tuning by determining bottlenecks at various points like targets, sources, mappings, sessions or system. This led to better session performance.
Environment: Informatica 8.6.1, ORACLE 9i, XML, Windows NT, UNIX Shell Programming.
Confidential
ETL Developer
Responsibilities:
- Involved in creating Technical Specification Document (TSD) for the project.
- Used Informatica for loading the historical data from various tables for different departments.
- Involved in the development of Data Mart and populating the data marts using Informatica.
- Created and maintained metadata and ETL documentation that supported business rules and detailed source to target data mappings.
- Involved in the process design documentation of the Data Warehouse Dimensional Upgrades.
- Developed sessions using Server Manager and improved the performance details.
- Created reusable transformations called mapplets and used them in mappings in case of reuse of the transformations in different mappings.
- Created mapplets and reusable transformations to use across different mappings.
- Created transformations like Aggregate, Expression, Filter, Sequence Generator, Joiner, and Stored procedure transformations.
- Created and managed the global and local repositories and permissions using Repository Manager in Oracle Database.
- Designed and coded maps, which extracted data from existing, source systems into the data warehouse.
- Scheduled Sessions and Batch Process based on demand, run on time, run only once using Informatica Server Manager.
Environment: Oracle RDBMS 9i, Informatica, JAVA, SQL*Plus Reports, SQL*Loader, XML, Toad.