Sr Etl Informaticaconsultant Resume
Minneapolis, MN
PROFESSIONAL SUMMARY:
- Senior Informatica developer with 7+ years of experience with Informatica PowerCenter (9.5.1, 9.x, 8.x, 7.x), Pentaho, Informatica IDQ / Informatica Data Explorer (IDE), Informatica MDM and in developing & Administering ETL mappings with Designer (Source Analyzer, Target Designer, Transformation Developer, Mapping designer, Mapplet Designer), Repository Manager, Workflow Manager, Workflow Monitor & Admin console.
- Experienced with Informatica Data Quality (IDQ) tools for Data Analyst / Developer
- Good experience in all phases of software development life cycle (SDLC) including system design, development, integration, testing, deployment and delivery of applications.
- Experienced in integration of various data sources like Oracle 11g/10g/9i, IBM DB2, MS SQL Server 2012/2008/2005, XML files, Mainframe sources into staging area and different target databases.
- Expertise in Informatica MDM Hub Match and Merge Rules, Batch Jobs and Batch Groups
- Working knowledge on Real Time Integration of applications by using SIF Integration and JMS Queues
- Experience using Informatica IDQ for qualifying the data content and MDM to filter duplicate data as well as to deploy the project as well as Meta Data Management.
- Data standardization of addresses using Address Doctor, Data integration in real - time using SIF API's.
- Strong knowledge of various development tools of Pentaho - Pentaho Design Studio (PDS), Pentaho Report Designer (PRD), Pentaho Analyzer, Pentaho Workbench, Community Dashboard Framework (CDF), and Pentaho BI Server.
- Conduct root cause analysis and advanced performance tuning for complex business processes and functionality
- Extensively worked on Reports and dashboards creation and publishing using various BI tools Cognos, Tableau and Pentaho.
- Gathering business and Technical requirements that would best suit the needs of the technical architectural development process.
- Participated in all phases of the Software development lifecycle (SDLC) using both Agile and Waterfall methodologies.
- Experience in all stages of ETL - requirement gathering, designing and developing various mappings, unit testing, integration testing and regression testing.
- Experience in creating complex reports in Micro Strategy Desktop using features like Templates, Transformations, Consolidations and Custom groups.
- Experience in Extraction, Transformation and Loading (ETL) of Data into Data Warehouse using Informatica PowerCenter 9.x, 8.x, 7.x versions.
- Extensive Experience in designing and developing complex mappings applying various transformations such as Expression, Aggregator, Lookup, Source qualifier, Update strategy, Filter, Router, Sequence generator, Rank, Stored procedure, Joiner and Sorter.
- Good knowledge on Data Analysis/Validation and Profiling based on the business and functional requirements of the Project.
- Good experience in installation of Informatica Power Exchange.
- Proficient in the implementation of Data Cleanup procedures, Stored Procedures, Scripts and execution of Test plans for loading the data successfully into the various Target types (Relational and flat file).
- Involved in performance improvements using partitioning, pushdown optimization and parallel loading.
- Involved in performance tuning and resolving performance bottlenecks of sources, transformation, targets, mappings and sessions.
- Good understanding in database and data warehousing concepts (OLTP & OLAP).
- Experience in detecting/resolving bottlenecks at various levels like source, target, mapping and sessions.
- Prepare/maintain documentation on all aspects of ETL processes, definitions and mappings to support knowledge transfer to other team members.
- Used various database client tools like TOAD, SQL developer, SQL server to access/create/change database objects and create scripts.
- Extensively worked with Oracle, SQL Server and UNIX shell scripting, Linux
- Experience on Data Modeling Tools Erwin, Sybase Power designer.
- Experience in working on Enterprise Job scheduling tools like Autosys.
TECHNICAL SKILLS:
Database: Oracle (10g and 11g), MS SQL Server 2008/2005, MySQL, DB2, Teradata, Oracle EBS
ETL Tools: Informatica PowerCenter9.x/8.x/7.x, OBIEE11g, OBIA, Pentaho, Informatica MDM Hub, Oracle Warehouse Builder (OWB), Informatica Power exchange, DAC.
Languages: C, C++, SQL, PL/SQL, Shell Script, Java, HTML, CSS, UNIX
Data Modeling: Rational Rose, Oracle Data Modeler, Erwin
Tools: PL/SQL Developer, Toad, Quality Center, JIRA, Escenic Content Management Studio, Microsoft Server management Studio, Bugzilla, Eclipse, VMware, Oracle APEX
Operating Systems /Environments: Windows NT/XP/Vista/98/2000/7/8, UNIX, LINUX, MAC-OS, Ubuntu.
PROFESSIONAL EXPERIENCE:
Confidential, Minneapolis, MN
Sr ETL InformaticaConsultant
Responsibilities:
- Involved in translating business requirements to integrate into existing data mart design.
- Coordinated cross-functional team efforts in meeting and exceeding goals.
- Interact with business users for requirements gathering and converting these requirements into technical
- Involved in System analysis, Estimations and design for enhancements.
- Troubleshooting and fine tuning of mappings for maximum.
- Used different components inPentaholike Database Lookup & Join, Generate rows, Calculator, Row normalizer &denormalizers, Java Script, Add constant, Add Sequence.
- Cleansed and standardized data using Pentaho transformations like Standardizer, Parser, Match, Merge & Consolidation Transformations using PDI tool.
- Design, build, test and maintain scalable and stable off the shelf application or custom built technology solutions to meet business needs. Act as a subject matter expert for Application Software developers and Engineers.
- Working on Real Time Integration of applications by using SIF Integration and JMS Queues.
- Used different components inPentaholike Database Lookup & Join, Generate rows, Calculator, Row normalizer &denormalizers, Java Script, Add constant, Add Sequence.
- Implemented best practices for architecture of enterprise data warehouse which supported reporting solutions based onPentahoplatform. The reporting platform was used globally by a very large user base
- Also provided all Database Object scripts for DBA team to deploy stage and prod DB environments.
- Identified and eliminated duplicates in datasets thorough IDQ 9.x components of Edit Distance and Mixed Field matcher. It enables the creation of a single view of customers.
- Good knowledge in Transaction Management in SIF Environment.
- Held meetings with business users to confirm business requirements.
- Created and Configured Sessions, Worklets and Workflows to load the data into target/s using Informatica Workflow Manager.
- Created Mapplets and Reusable Transformations to prevent redundancy of transformation usage.
- Done Data cleansing, single and cross table structure profiling, analysis on data, and analyze the patterns with Informatica Data Explorer and generating reports and logs.
- Used Autosys and Informatica Scheduler to schedule jobs for the files and other sources to be extracted and load to target EDW on a daily/weekly/monthly basis.
- Worked on writing Pl/Sql procedures in Oracle and captured those by using Pentaho stored Procedures.
- Generated Scorecards based on profile results
- Done single table structure profiling, cross table structure profiling.
- Created Rules on profiled data and used the same to data quality mappings.
- Responsible for Unit & Integration test environments and for data accuracy with consistency throughout its lifecycle.
- Implemented printing, emailing, scheduling, full screen functionality within Pentaho dashboard using CDF
- Designed and developed What-If analysis using JQuery and Pentaho Design Studio
- Worked on power exchange to access the data from different sources and to avoid manual coding
Environment: Pentaho 3.7.0, Pentaho Dashboard Designer 5.0.6, Informatica Power Center 9.5, Informatica Analyst9.0.1, SQL Server, Informatica Data Quality 9.6.0 & 9.5.1, IDQ9.X, Oracle 11g, UNIX, Power Exchange, MDM, SIF, Teradata, MS Access, PL/SQL, Autosys.
Confidential, Englewood, CA
Sr ETL InformaticaConsultant
Responsibilities:
- Responsible for writing requirements for automation of online contract management tool.
- Involved in designing MDM data model and created base objects, mappings, defined trust setting for sources, customized user exists, customized IDD applications.
- Performed match/merge and ran match rules to check the effectiveness of MDM process on data
- Involved in designing, Implementing the Inbound and Outbound interfaces to send data to and from the MDM System to the sources
- Involved in the UAT testing of the Items Data Mart price files tool automation project.
- Responsible for handling Supply Chain Management Data Warehouse and related data base and online solutions.
- Involved in maintenance of reporting tools and processes utilizing Data Warehouse data.
- Worked with user support group to in corporate pharmacy contracts in the SCM Contract Catalog.
- Responsible for generating pricing reports from Finance & Procurement Data Warehouse and Data Mart using Business Objects.
- Responsible for managing the online contract management repository and items data mart pricing information.
- Work on formulating the ETL rules using Informatica and Ab Initio.
- Used Informatica Power Center 9.0.1, Pentaho tool for migrating data from various OLTP databases to the data mart.
- Worked with different sources like Oracle, flat files, XML files, DB2, MS SQL Server
- CreatedPentahoJobs and transformations to load data from CSV, Excel files to MYSQL database
- Designed and developedPentahojobs and transformations to load data into dimensions and facts
- Developed ETL jobs to Extract, Transform and Load (ETL) the data by usingPentahoETL tool.
- Worked on Data Analytics/Visualization Project usingPentaho(ETL and Data Visualization Suite)
- Extracted data from Sales department to flat files and load the data to the target database
- Developed complex mappings using Informatica to load Dimension & Fact tables as per STAR schema techniques.
- Contribute to the entire implementation process including driving the definition of improvements based on business need and architectural improvements
- Extracted data from sources like fixed width and Delimited Flat files transformed the data according the business requirement and then loaded into Target Data mart.
- Created various Informatica mappings and mapplets to load the data mart. The mappings involved extensive use of transformations like Aggregator, Filter, Router, Expression, Joiner, Sequence generator.
- Configured the mappings to handle the updates to preserve the existing records using Update Strategy Transformation (SCD Type-2).
- Used IDQ for generation of various reports and graphs based on data used for reporting.
- Used Debugger to identify the errors in the mappings and fix them
- Performed unit testing to validate mappings and populate the database
- Used TOAD and SQL Plus to write queries and interact with Oracle database
- Implemented several different tasks (Session, Assignment, Command, Decision, Timer, Email, Event-Raise, Event-Wait, Control) in the workflow
- Involved in writing UNIX scripts and used them to automate the scheduling process
- Error Handling handled in Informatica Mappings & sessions and also through validation script.
- Co-ordinated with DBA Team, Functional Team and offshore teams.
- Automation of job processing, establish automatic email notification to the concerned persons.
- Written documentation to describe program development, logic, coding, testing, changes and corrections.
- Used SQL Trace, Analyze, Explain Plan Utilities, and Hints for the performance tuning
- Managed the Metadata associated with the ETL processes used to populate the data warehouse.
- Tested the data and data integrity among various sources and targets. Associated with Production support team in various performances related issues.
- Worked with business users and gather data cleansing, data reconciliation and data convergence requirements
- Involved in Designing and developing the OBIEE/Siebel Metadata Repository (.rpd) using OBIEE/Siebel Analytics Admin tool by importing the required objects (Dimensions and Facts) with integrity constraints into Physical Layer using connection pool, developing multiple Dimensions (Drill-Down, Hierarchies)& Logical Facts / Measures objects in Business Model Layer, and creating the Presentation catalogs in Presentation Layer.
Environment: Informatica Power Center 9.1,Pentaho 4.x, IDQ, MDM, Data explorer, Oracle 10g/11g,, SQL Server 2012, PL/SQL, Flat files, PLSQL Developer.
Confidential, Florida
Sr ETL InformaticaDeveloper
Responsibilities:
- Collaborated with business analysts and technical team for requirement gathering and business analysis and prepared high level design document to provide an overview of technical design specification system.
- Analyzed the existing application physical data model and suggested changes to data Model based on theETLand Referential Integrity gap requirements. AccommodatedETLMappings according to Database Management change requests. Developed Data Quality architecture forETLenvironment.
- Used Informatica PowerCenter 9.1 for extracting Oracle, flat files for Data Extraction Involved in the development of Informatica mappings and also tuned them for better performance.
- Created User Defined functions,reusable transformations to be re-used during the development life cycle
- Coordinated with Source System Ownersto analyze sources for data feeds, mappings andDefaults inthe DataandCreated folders,shared folders for shortcuts,groups, users and assigned permissions and privileges to groups and users using theInformaticaRepository Manager.
- Developed reusable TDF’s to load data from flat files and other data sources to the MDM HubData Quality (IDQ)
- Extensively usedInformaticaData Quality for applying several rules against data coming from mainframesand VSAM files for data cleansing.
- Maintained Development, Test and Production Repositories using Repository Manager. Also used Repository Manager to maintain the metadata, Security, Backup and Locks.
- Standardized parameter files to define session parameters such as database connection for sources targets, lastupdated dates for Incremental loads and many default values of fact tables.
- Performed tuning ofInformaticaMappings for optimum performanceof data loads and extractsand SQL overrides in place of homogeneous sources.Designed and coded rejected row handling process.
- Designed and implemented CDCbackup process for Mainframes.Designed data loading sequence and populated data into ODS, staging and warehouse with business rules following Data warehouse methodologies. Implemented SCD Type 1 and Type 2 to update the dimensional schema.
- Implemented Data Validationand Exception handling logic in the mapping to handle at runtime.
- Added enhancements such as mail functioning, success flag, pre and post session functions etc.
- Optimized the mappings using variousoptimization techniques and also debugged some existing mappings using the Debugger to test and fix theETLdefects.
- Provided detailed technical, process and support documentation like daily process rollback and detailed specifications and very detailed document of all the projects with the workflows and their dependencies.
- Responsible for best practices like naming conventions, Error Handling and Responsible for Performance Tuning at the Source, Targets,Transformations, Mappingsand Session Level.
- Involved in Unit Testing,System Testing, User Acceptance Testingto check whether the dataloadinto target are accuratewhich was extracted from different source systems according to the user requirements by generating several SQL test scripts, validating against test casesbased on the pre-defined test plans.
- Createddatalineagedocuments fordata flow andETLprocess based onInformaticamappings to support the project once it implemented in production.
Environment: InformaticaPower Center 9.1 (Designer, Repository Manager, Workflow Monitor, Workflow Manager), Autosys, Oracle 10g, DB2 V 9.1, PL/SQL,Flat Files, AQT,Erwin, Data quality, Ultra Edit, UNIX Scripting, AIX, Windows XP.
Confidential, Indianapolis, IN
ETL Developer
Responsibilities:
- Analyzed source data and gathered requirements from the business users.
- Developed approach paper according to the business rules.
- Prepared technical specifications to develop Informatica ETL mappings to load data into various tables confirming to the business rules.
- Developed mappings with transformations and mapplets confirming to the business rules.
- Preparing the Documentation for the mapping according to the designed logic used in the mapping
- Optimizing performance tuning at mapping and Transformation level
- Interacting with Onshore people and Database team if any issues
- Preparing Test Cases
- Processed session data using threads and various tasks (session, command etc.) and managed database connections and scheduled workflows.
- Performance tuning of mappings, transformations and sessions to optimize session performance.
- Tuned performance of Informatica session for large data files by increasing block size, data cache size, sequence buffer length and target based commit interval.
- Extensively used stored procedures and also worked with parallel processing.
- Created shared folders, local and global shortcuts to reuse metadata.
- Worked on issues with migration from development to testing.
- Worked with business analysts for requirement gathering, business analysis, and testing and project- coordination.
Environment: Informatica8.6, Oracle, SQL Server,Teradata, Erwin, Shell Scripts Windows NT, Unix
Confidential
ETL Developer
Responsibilities:
- Created Technical Design Specifications, Unit test document based on functional design specifications provided by Business Analyst
- Designed and developed ETL Processes based on business rules, job control mechanism using Informatica Power Center.
- Worked extensively on complex mappings using source qualifier, joiner, expressions, aggregators, filters, Lookup, update strategy, stored procedure transformations, etc.
- Used workflow monitor to monitor the jobs, reviewed session/workflow logs that were generated for each session to resolve issues, used Informatica debugger to identify issues in mapping execution.
- Re-engineered lots of existing mappings to support new/changing business requirements.
- Monitored production jobs on a daily basis and worked on issues relating to the job failure and restarted failed jobs after correcting the errors.
- Developed reusable transformations, mapplets, sessions, worklets to make Informatica code very modular and reuse as required
- Performed unit testing, system integration testing, and supported user acceptance testing.
- Performance tuned SQL statements, Informatica mappings, used Informatica parallelism options to speed up data loading to meet defined SLA
- Using Informatica Powercenter8.6 to make the changes to the existing ETL mappings in each of the environments.
- Collaborated with Project Manager, Tech Lead, Developers, QA teams and Business SMEs to ensure delivered solutions optimally support the of business outcomes.
- SCRUM and AGILE approach was used to solve defects and monitor daily progress.
- Supported Informatica, non-Informatica code migration between environments (DEV/QA/PRD)
- Developed PL/SQL procedures for processing business logic in the database and use them as a Stored Procedure Transformation.
- Developed Oracle PL/SQL Packages, Procedures, Functions and Database Triggers.
- Data Warehouse Data modeling based on the client requirement using Erwin (Conceptual, Logical and Physical Data Modeling).
- Dimensional Modeling for creation of Star Schema and Snow Flake Schema
Environment: Informatica Power Center 8.6/8.5, Repository Manager, Designer, Work Flow Manager, Oracle 9i/10g, SQL Server 2008/2005, Teradata, XML Files, Flat Files, CSV files, PL/SQL(Stored Procedure, Trigger, Packages), Erwin,, MS Visio, TOAD, Windows
Confidential
ETL Developer
Responsibilities:
- Analyzed business requirements and worked closely with various application teams and business teams to develop ETL procedures that are consistent across all applications and system.
- Wrote Informatica ETL design documents, establish ETL coding standards and perform Informatica mapping reviews.
- Extensively worked on Power Center Client Tools like Repository Admin Console, Repository Manager, Designer, Workflow Manager, and Workflow Monitor.
- Analyzed the source data coming from different sources (Oracle, DB2, XML, QCARE, Flat files) and worked on developing ETL mappings.
- Developed complex Informatica Mappings, reusable Mapplets and Transformations for different types of tests in research studies on daily and monthly basis.
- Implemented mapping level optimization with best route possible without compromising with business requirements.
- Created Sessions, reusable worklets and workflows in Workflow Manager and Scheduled workflows and sessions at specified frequency.
- Worked on fixing invalid Mappings, testing of Stored Procedures and Functions, and Integration Testing of Informatica Sessions.
- Responsible for the Performance tuning at the Source Level, Target Level, Mapping Level and Session Level.
- Worked extensively on SQL, PL/SQL, and UNIX shell scripting.
- Generated XML files to deliver to Thompson Reuters.
- Performed Data profiling for data quality purposes.
- Proven Accountability including professional documentation, and weekly status report.
- Performed Quantitative and Qualitative Data Testing.
- Documented flowcharts for the ETL (Extract Transform and Load) flow of data using Microsoft Visio and created metadata documents for the Reports and the mappings developed and Unit test scenario documentation for the mentioned.
Environment: Power Center 7.4, DB2, Oracle 9i, UNIX, Win XP Pro, TOAD.