Sr. Etl Informatica Developer Resume
Baltimore, MD
SUMMARY:
- Over 9 years of IT expertise in Analysis, Design, Development, Implementation, Testing and Production Support for Data warehousing applications.
- Experience in integration of various Operational Data Source (ODS) s with Multiple Relational Databases like Oracle, SQL Server, Teradata and Worked on integrating data from flat files like fixed width and delimited.
- Expertise in implementing Datamart and data warehouse applications and Significant Multi - dimensional(Star and Snowflake schema) and Relational data modeling experience, Data Flow Diagrams, Process Models, ER diagrams with modeling tools like ERWIN r7/r4/3.5.
- Demonstrated expertise in utilizing ETL tools Informatica power center 9x/ 8.6.1/8.1/7.1 /6.2 and PowerExchange 8.6.1/9x/ for developing the Data warehouse loads as per client requirement.
- Experience in MDM Hub configurations - Data modelling, Data Mappings, Data validation, Match and Merge rules, Hierarchy Manager, customizing/configuring Informatica Data Director.
- Experience in creating Base objects, staging tables, foreign key relationships, queries, packages, query groups and custom functions in Informatica MDM. Have knowledge on OBIEE and TABLEAU.
- Good experience in Data Extraction, Transformation, Loading from data sources like Teradata, Oracle 11g.10g.9i/8i, SQL Server2008R2/2008/2005, XML, Flat files, COBOL and VSAM files.
- Hands on experience on Mainframes and SAP.
- Also worked on Medicare domain in Confidential.
- Extracted data from excel files, high volume of data sets from data files, Oracle, DB2,SalesForce.com(SFDC) using Informatica ETL mappings/SQL PLSQL scripts and loaded to Data Store Area.
- Worked on CA7 scheduling tool for scheduling the Jobs.
- Hands on experience migrating Informatica mappings to different versions.
- Extensively worked on developing and debugging Informatica mappings, Mapplets, sessions and workflows.
- Extensively worked with Slowly Changing Dimensions (Type I, Type II and Type III).
- Experience in Designing Universes and development of reports both in Full client as well as in Web Intelligence.
- Worked on Performance Tuning Informatica Targets, Sources, Mappings and Sessions.
- Strong knowledge on Performance tuning issues while loading high volume of data and while generating reports.
- Well versed in developing complex SQL queries, unions and multiple table joins and experience with Views
- Experience in database programming in PL/SQL (Stored Procedures, Triggers and Packages)
- Experience in creating UNIX shell scripts for server monitoring, deployments, Synchronizing Source System to ETL Routines to automate the process and Experience with file transfer methods (FTP).
- Experience in active data ware housing on the Teradata platform, extended use of Teradata Parallel Transport, TPump, FastLoad, BTEQ and migrating legacy systems into Teradata.
- Experience in implementing test plans, test cases, test scripts, test procedures, assumptions, and validations based on design specifications for unit testing, system testing, expected results, preparing test data and loading for testing, error handling and analysis. Worked as Onsite co-ordinate at Confidential .
- Experience in migrating Informatica mappings/Workflows/sessions to Production Repository
- Experience in handling jobs monitoring and production support in a 24/7 environment
- Excellent Documentation Skills, Team problem solving ability, Analytical and Programming skills in High speed, Quality conscious and Multitasked environment.
- Have good knowledge on Microsoft Application tools i.e. MS Access, MS Excel, Pivots, ASP.
- Outstanding communication and interpersonal skills, ability to learn quickly, good analytical reasoning and high compliance to new technologies and tools.
TECHNICAL SKILLS:
ETL Tools: Informatica Power Center 9x/ 8.6.1/8.1/7.1 /6.2 .
Reporting Tools: Tableau and OBIEE
Data Modeling Tools: Erwin r7/r4/3.5.
Databases: Oracle 11g/ 10g/9i/8i, SQL Server 2005,Teradata 13v.
Database Tools: TOAD, SQL plus
Languages: SQL, PL/SQLOther tools Putty, SQL Developer, Toad and Winscp Operating System WIN2000/XP/VISTA, UNIX (Sun Solaris, AIX, LINUX)
Web Designing: HTML, Ms Office.
PROFESSIONAL EXPERIENCE:
Confidential, Baltimore,MD
Sr. ETL Informatica Developer
Responsibilities:
- Collaborated with Business Analysts, Data Analysts and assisted them with their data needs.
- Authored performance improvements across several workflows loading data from enrollment systems to downstream applications by using proven ETL tuning methods, which reduced the run times by about 300%.
- Defined new processes to help operation teams perform efficiently, by gathering information regarding failed jobs and promptly notifying the appropriate groups through emails. This helped in reducing the resolution times by 5 fold.
- Resolved issues related to CDC logic within workflows which feeds data into warehouses, enabling gathering of more accurate/efficient data.
- Created a unified process control log table for capturing the Log times across the workflows runs.
- Guided Informatica developers to convert PL/SQL procedures to mappings, by creating documents outlining the source to target mappings and defining the underlying data transformations by collaborating with business users and Oracle Developers.
- Administered changes to warehouse metadata and naming standards and helped streamlining process interactions with Data Architects and Informatica Admins.
- Conducted Peer reviews with the developers designing mappings and suggested changes appropriately when needed.
- Utilized Power-Exchange to read Oracle "redo" logs and capture such data for data analytics to enable them report accurate outcomes to Operational business users and Confidential executives.
- Performed Verification, Validation, and Transformations on the Input data before loading into target database.
- Involved in designing the process flow for extracting the data across various systems.
- As developer Designed, Developed and tested the Informatica Mappings which are designed as perbest practices for the development team to make the development phase more efficient and also serves as a medium to introduce the development standards that developer need to follow.
- Extensively used transformations like router, lookup, source qualifier, joiner, expression, sorter, XML, Update strategy, union, aggregator, normalizer and sequence generator.
- Created reusable mapplets, reusable transformations and performed Unit tests over Informatica code.
- Extensively used ETL processes to load data from various source systems such as SQL Server and Flat Files, XML files into target system SQL Server by applying business logic on transformation mapping for inserting and updating records when loaded.
- Expertise in UNIX/ system Integration testing Data matching between multiple databases as per business requirements.
- Performance tuning various mappings, Sources, Targets and transformations by optimizing caches for lookup, joiner, rank, aggregator, sorter transformation and tuned performance of Informatica session for data files by increasing buffer block size, data cache size, sequence buffer length and used optimized target based commit interval and Pipeline partitioning to speed up mapping execution time.
- Developed mapping parameters and variables to support SQL override.
- Responsible for creating plans for the code migration using SVN as a version control tool following security policy.
- Wrote UNIX shell Scripts & PMCMD commands for FTP of files from remote server and backup of repository and folder.
- Designed workflows with many sessions with decision, assignment task, event wait, and Event raise tasks, used informatica scheduler to schedule jobs.
- Used JCL scripts for scheduling the Informatica workflows.
- Responsible for providing daily status report for all Informatica applications to customer, Monitoring and tracking the critical daily applications & code migration during deployments.
- Responsible for reloads of Informatica applications data in production and closing user tickets and incidents.
- Responsible to design, develop and unit test the mappings.
- Performed Unit and Integration Testing and validates results with Business Analyst and end users.
- Conducting internal and external reviews as well as formal walk through among various teams and documenting the proceedings.
- Identify performance issues on the code which are performing badly and tune them to complete the jobs within the given SLA time.
- Provided Knowledge Transfer to the end users and created extensive documentation on the design,development, implementation, daily loads and process flow of the mappings.
Environment: Informatica PowerCenter 9.6.1 (Repository Server, Repository Manager, Designer, Workflow Manager and Workflow Monitor) and SQL Server 2008, SQL, UNIX Shell Scripts
Confidential, Cleveland, OH
Sr. ETL Informatica Developer
Responsibilities:
- Contributed in creation of the BRD/functional and technical design document after having multiple sessions with business users team.
- Performed Verification, Validation, and Transformations on the Input data before loading into target database.
- Involved in designing the process flow for extracting the data across various systems.
- Developed ETL routines using Informatica Power Center and created mappings involving transformations like Lookup, Aggregator, Ranking, Expressions, Mapplets, connected and unconnected stored procedures, SQL overrides usage in Lookups and source filter usage in Source qualifiers and data flow management into multiple targets using Routers.
- Extensively used ETL processes to load data from various source systems such as SFDC,SQL Server, Teradata and Flat Files, XML files into target system SQL Server by applying business logic on transformation mapping for inserting and updating records when loaded.
- Proficient in Performance tuning of multiple Informatica mappings to improve performance as the volume of Internet orders entered the system on a daily basis. The factors involved were PDO (Push down optimization), bulk loading and also adding indexes on the staging tables.
- Using the Power Exchange for Change Data capture (CDC) option to capture the data whenever the inserts, updates, and deletes underlying these events as soon as they occur and transfer in to multiple targets without intermediate queues or staging tables
- Created landing tables, base objects and stage and reference tables. Define foreign key relationships.
- Worked with PowerCenter team to load data from external source systems to MDM hub.
- Extensively used Informatica Workflow Manager and Workflow Monitor to develop, manage and monitor workflows and sessions.
- Also worked on VBA scripting for one task.
- Used the database partitioning and Informatica partitioning for better performance when working with the huge data.
- Worked on migration project from 9.5.1 to 9.6.1 for GFB (Green Field Bridge) Project.
- ETL code was migrated to GFB servers as per the ETL standards of 9.6.1.
- Used CA7 scheduling tool for scheduling the Informatica workflows.
- Responsible to design, develop and unit test the mappings.
- Migration from DEV to QA using Repository Manager.
- Performed Unit and Integration Testing and validates results with Business Analyst and end users.
Environment: Informatica PowerCenter 9.6.1/9.5.1 (Repository Server, Repository Manager, Designer, Workflow Manager and Workflow Monitor), MDM (Master Data Management), Oracle 11g, Toad, PL/SQL and SQL Server 2008, SQL, UNIX Shell Scripts
Confidential, Atlanta,GA
Sr. ETL Informatica Developer
Responsibilities:
- Worked closely with the Architect in extracting the data from sources system and Designed and developed the processes to extract, transform and load data into Oracle Database
- Involved in designing the ETL Extract from various sources like Oracle, Flat files, XML.
- Due to the new jurisdiction inclusion, large volume of the data and no data ware house worked on the preparation for the dimensional modeling of the warehouse using Erwin r7
- Used Informatica PowerCenter 9.1- Source Analyzer, Target Designer, Mapping Designer, Workflow Manager, Mapplets, and Reusable Transformations.
- Involved in designing the ETL Extract from various sources like Teradata, Flat files and load the data into target using the Teradata ODBC as well as Mload target connections and also involved in creating Stage Tables in Teradata.
- Designed and developed Informatica Mappings to load data from various Source systems like Files, Relational into the ODS (operational data store), DW and then to the Data Mart.
- Worked on enhancements for the existing mappings according to the requirements.
- Executed all the mappings and sessions in Development using workflow Manager
- Developed Mappings to load data from flat files through various data cleansing and data validation process.
- Changing the data types from EBSDIC to ASCI code for the data fields in the data files
- Responsible for changing the data fields to support the new ICD10 codes for Medicare industry.
- Used almost all the Transformations like Lookup, Aggregator, Expression, Router, Filter, Update Strategy, Stored procedure and Sequence Generator
- Designed Mapping document, which is a guideline for ETL Coding and implemented CDC, SCDI & SCDII Mappings
- Created ETL jobs for the PDAC and DME data ware houses and used history preserve, map operations, table comparison transforms to CDC changes
- Worked on various tickets w.r.t Informatica mappings.
- Automated UNIX shell scripts to verify the count of records added everyday due to incremental data load for few of the base tables in order to check for the consistency.
- Optimized and Tuned SQL queries and PL/SQL blocks to eliminate Full Table scans to reduce Disk I/O and Sorts.
- Successfully worked on the unit testing, integration testing in developing the Data conversion programs
- Documentation has been done for the mappings existing and created, breakfix and test cases
Environment: Informatica PowerCenter 9.1 (Repository Server, Repository Manager, Designer, Workflow Manager and Workflow Monitor), Oracle 11g, Toad, PL/SQL and SQL Server 2008, SQL, UNIX Shell Scripts, Teradata 13.
Confidential, Atlanta,GA
Senior ETL Consultant
Responsibilities:
- Designed and developed the processes to extract, transform and load data into the Data Warehouse
- Used AGILE Methodology
- Extracted data from of different relational databases like XML, Flat files, Teradata and Oracle
- Used Informatica PowerCenter 8.6 &9.1 Source Analyzer, Target Designer, Mapping Designer, Workflow Manager, Mapplets, and Reusable Transformations
- Extensively used almost all the Transformations like Lookup, Aggregator, Expression, Router, Filter, Update Strategy, Stored procedure and Sequence Generator
- Designed Mapping document, which is a guideline for ETL Coding and implemented CDC, SCDI & SCDII Mappings.
- Interacted with Teradata DBA team for creation of primary and secondary indexes on Data Warehouse tables.
- Designed and developed Informatica Mappings to load data from various Source systems like Files, Relational into the ODS (operational data store), DW and then to the Data Mart.
- Executed all the mappings and sessions in Development using workflow Manager
- Implemented Slowly Changing Dimension(SCD) Type 1 and Type 2 for inserting and updating Target tables for maintaining the history
- Used Mapplets and Reusable transformations were extensively wherever required
- Created Process Control and worked with Metadata Manager
- Used Workflow Manager for Creating, Validating, Testing and running the sequential and concurrent batches and Sessions and scheduling those using Autosys at specified time
- Organized data in the report Inserting Filters, Sorting, Ranking and highlighting data
- Created reports in table, cross table, 2-D, 3-D Column, Line, Area and Pie charts
- Used Shell Scripts to interact with Informatica Server.
- Generated ABAP program extract data from SAP ABAP systems to Oracle using file mode and stream mode in Informatica.
- Checked Sessions and error logs to troubleshoot problems and also used debugger for complex problem troubleshooting.
- Created and executed comprehensive unit test plans and assist with integrated system test.
Environment: Informatica PowerCenter 8.6 & 9.1 (Repository Server, Repository Manager, Designer, Workflow Manager and Workflow Monitor), Oracle 11g, TOAD, UNIX, PL/SQL, Teradata, SAP Netwaver 7300.1.3.1079.
Confidential, New Jersey
Informatica ETL Developer
Responsibilities:
- Involved in designing, developing and documenting of the ETL (Extract, Transformation and Load) strategy to populate the Data Warehouse from various source systems feeds using Informatica, PL/SQL scripts
- Designed and developed complex mappings in Informatica to load the data from various sources such as SQL Server, Flat files, Oracle, XML using different transformations such as, Source qualifier, Look up (connected and unconnected), Expression, Aggregate, Update strategy, Sequence generator, Joiner, Filter, Rank, and Router transformations.
- Extracted data from Heterogeneous source systems like Oracle, Teradata, SQL Server and flat files.
- Designed and developed mappings, defined workflows and tasks, monitored sessions, exported and imported mappings and workflows, backups, and recovery.
- Extensively worked with database and Informatica for performance tuning.
- Created and configured workflows, Worklets, and sessions to transport the data to target warehouse SQL Server tables using Informatica Workflow Manager.
- Created Mapping Parameters and Variables.
- Administrating User Privileges, Groups and Folders which includes creation, update and deletion.
- Migration of New and Changed Informatica objects across the environments using Folder to Folder and Deployment Group methods.
- Worked on Database level tuning and SQL Query tuning for the Data warehouse.
- Analyzed newly converted data to establish a baseline measurement for data quality
- Developed PL/SQL stored procedures and UNIX commands shell scripts for pre and post session commands and batch jobs.
- Executed sessions, both sequential and concurrent for efficient execution of mappings and used other tasks like event wait, event raise, email, command and pre/post SQL
- Worked with PMCMD command line program to talk with the Informatica server
- Performed extensive testing on the mappings and wrote queries in SQL to check if the data was loading to the dimension tables and fact tables properly.
- Used data coming from IBM Mainframe systems to stage in Oracle and then write to database.
- Identified end user data access and reporting needs and help business users towards defining detail requirements.
- Analyzed data and reporting requirements to recommend and design solutions through the creation of appropriate database structures, reports and query structures.
Environment: Informatica 8 .6, Oracle 9i, HP-UNIX, Flat Files, PL/SQL Developer and TOAD, Power Exchange 8.6, IBM Mainframe.
Confidential, Atlanta,GA
Oracle/ETL developer
Responsibilities:
- Analyzed and studied various Schemas for Implementation.
- Worked on Informatica tools - Repository Manager, Designer and Workflow Manager.
- Worked on all the Transformations like Lookup, Aggregator, Expression, Router, Filter, Update Strategy, Stored procedure, Sequence Generator.
- Debugging and validating the mappings and Involved in Code Review.
- Created and Scheduled Sessions and Batch Process based on demand, run on time, run only once using Informatica Server Manager.
- Performed activities including design of exception handling strategy and performance tuning in PL/SQL.
- Extensively used various Performance tuning Techniques to improve the session performance (Partitioning etc).
- Extensively used SQL loader to load data to tables.
- Extensively worked on correcting and reloading rejected files.
- Used the command line program Pmcmd to communicate with the Informatica Server.
- Developed unit test plans to test the designed mappings in various aspects; designed Informatica migration document and Implementation check lists to migrate the code from development environment to Alpha, Beta and Production environments.
- Completed documentation in relation to detailed work plans, mapping documents and high-level data models.
- Configured and used FTP by the Informatica Server to access source files.
Environment: Windows 2000, Oracle 9i, PL/SQL, JavaScript, Informatica (Power Center 8.6), HP- UX 10.20
Confidential, Wayne, NJ
ETL Developer
Responsibilities:
- Participated in business requirement walk through, design walk through and analyzed Business requirements.
- Performed Verification, Validation, and Transformations on the Input data before loading into target database.
- Involved in designing the process flow for extracting the data across various systems.
- Developed ETL routines using Informatica Power Center and created mappings involving transformations like Lookup, Aggregator, Ranking, Expressions, Mapplets, connected and unconnected stored procedures, SQL overrides usage in Lookups and source filter usage in Source qualifiers and data flow management into multiple targets using Routers.
- Extensively used ETL processes to load data from various source systems such as SQL Server, Teradata and Flat Files, XML files into target system SQL Server by applying business logic on transformation mapping for inserting and updating records when loaded
- Using the Power Exchange for Change Data capture (CDC) option to capture the data whenever the inserts, updates, and deletes underlying these events as soon as they occur and transfer in to multiple targets without intermediate queues or staging tables
- Extensively used Informatica Workflow Manager and Workflow Monitor to develop, manage and monitor workflows and sessions.
- Used the database partitioning and Informatica partitioning for better performance when working with the huge data.
- Responsible to design, develop and unit test the mappings.
- Migration from DEV to QA using Repository Manager..
- Performed Unit and Integration Testing and validates results with Business Analyst and end users.
- Documented each stage of the project and attended status meeting every week.
Environment: Informatica 8.6, Erwin 4.0, SQL Server 2008 R2, Oracle 11g, SQL, PL/SQL, Toad, Teradata.
Confidential, NYCETL Developer
Responsibilities:
- Involved in analyzing the data models of legacy implementations, identifying the sources for various dimensions and facts for different data marts according to star schema design patterns.
- Developed complex mapping using Source qualifier, Aggregators, Connected & unconnected lookups, Filters & Update strategy.
- Extensively used Various Data Cleansing and Data Conversion Functions in various transformations.
- Used Debugger to validate transformations by creating break points to analyze, and monitor Data flow.
- Tuned performance of Informatica Session by increasing block size, data cache size, sequence buffer length and Target based commit interval, and mappings by dropping and recreation of indexes.
- Worked along with the QA Team and provided production support by monitoring the processes running daily.
- Defined Target Load Order Plan for loading data into Target Tables.
- Implemented Slowly Changing Dimensions methodology and developed mappings to keep track of historical data
- Written SQL overrides in Source Qualifier and Lookups according to business requirements.
- Involved in troubleshooting the loading failure cases, including database problems.
- Responsible for Documentation of the Test cases, completed modules and the results of acceptance testing.
Environment: Informatica Power Center 7.1.1, Oracle 9i, MS SQL Server 2005, UNIX, PL/SQL, UNIX shell scripting, SQL*PLUS, SQL, TOAD, Reports, MS Excel, MS Access, Flat Files, XML.
Confidential, NYC
ETL Developer
Responsibilities:
- Extracted Data from Different Sources by using Informatica.
- Extensively used Informatica client tools Source Analyzer, Warehouse designer, Mapping designer, Mapplet Designer, Transformations.
- Cleanse the source data, Standardize the Vendors address, Extract and Transform data with business rules, and built Mapplets using Informatica Designer.
- Extracted data from different sources of databases. Created staging area to cleanse the data and validated the data.
- Designed and developed complex Aggregate, expression, filter, join, Router, Lookup and Update transformation rules.
- Developed schedules to automate the update processes and Informatica sessions and batches.
- Analyze, design, construct and implement the ETL jobs using Informatica.
- Implemented slowly changing dimensions methodology and developed mappings to keep track of historical data.
- Created Users, user groups, database connections and managed user privileges using supervisor.
- Created universe and reports.
- Extensively involved in capturing the incremental changes in the source systems for updating in the staging area and data warehouse respectively.
- Written SQL overrides in Source Qualifier and Lookups according to business requirements.
- Involved in creating desktop intelligence and web intelligence reports.
Environment: Informatica 6.2, UNIX AIX 4.2, SQL Developer, Oracle 9i and Windows XP