Sr Etl Informatica Developer Resu
ME
SUMMARY
- Around 8 Years of IT experience in Design, Development, Implementation, Administration, Troubleshooting and Support of ETL processes for Data Marts and large scale Data Warehouses.
- Expertise in building Enterprise Data Warehouses (EDW), Operational Data Store (ODS), Data Marts, and Decision Support Systems (DSS) using Multidimensional and Dimensional modeling (Star and Snowflake schema) Concepts.
- Significant Multi - dimensional and Relational data modeling experience, Data Flow Diagrams, Process Models, ER diagrams with modeling tools like ERWIN & VISIO.
- Experience in integration of various data sources with Multiple Relational Databases like DB2, Oracle, MySQL, SQL Server, Teradata, MS Access, and Worked on integrating data from Flat Files, COBOL files and XML Files.
- Extensively worked with ETL tool Informatica 9.x/ 8.6.1/8.1.1/7.1.3 - Power Center Client tools - Designer, Repository manager, workflow manager/monitor and Server tools - Informatica Server, Repository Server manager.
- Extensively worked on data transformations such as Source Qualifier, Joiner, Filter, Router, Expression, Lookup (Connected and Unconnected), Aggregator, Sorter, Normalizer, Update Strategy, Sequence Generator, XML Generator, Transaction Control and Stored Procedure transformations.
- Extensive experience in debugging mappings. Identified bugs in existing mappings/workflows by analyzing the data flow and evaluating transformations.
- Expertise in Coding, Review and Unit testing of Informatica mappings. Also an expert with SQL and was extensively involved in writing scripts for Data Analysis, Manual & Automated Testing.
- Experience in Informatica performance tuning. Tuned performance of Informatica Sessions for large data files by increasing block size, data cache size, sequence buffer length, partitioning and target based commit interval.
- Experience in Tuning of SQL Queries using Analyze and Explain Plan commands.
- Experience in designing and implementing partitioning to improve performance while loading large data volume.
- Extensive experience in implementation of Data Cleanup procedures, transformations Scripts, Triggers, Stored Procedures and execution of test plans for loading the data successfully into the targets.
- Experience in creating UNIX shell scripts and automated scripts for scheduled queue process and PMCMD commands.
- Experienced In working with various Scheduling tools like Autosys, Control-M, Informatica Scheduler and Cronjob.
- Worked with Pre-Session and Post-Session UNIX scripts for automation of ETL jobs. Also, Involved in migration/conversion of ETL processes from development to production.
- Worked with RDBMS like Oracle8i/9i/10g/11g, MS SQL Server and DB2.
- Experience in using BI Tools like Business Objects for Data Analysis and Reporting.
- Motivated to take independent responsibility as well as to contribute to be a productive team member. Strong Team building and mentoring skills and excellent Team leadership capability.
- Excellent analytical, programming, written and verbal communication skills with ability to interact with individuals at all levels.
TECHNICAL SKILLS
ETL Tools: Informatica Power Center 9.1/8.6/8.1.1/7.1.3 , Informatica Power Center, IDQ
Modeling Tools: Erwin 7.3, MS Visio.
Methodologies: Data Modeling - Logical, PhysicalDimensional Modeling - Star / Snowflake.
Business Intelligence Tools: Business Objects XI R 3/6.0/5.1/5.0. , Cognos 8BI/7.0, Sybase, OBIEE 10.1.3.x
RDBMS: Oracle 11g/10g/9i/8i, Teradata, MS SQL Server 2005/2008, DB2 UDB 7.1, MySQL, MS Access.
Programming Skills: SQL, PL/SQL, Unix Shell Scripting, Syncsort DMExpress, Transact SQL, Visual Basic 6.0/5.0, HTML, DHTML, XML,C, C++, Java.
Operating Systems: Win 95/98/2000/XP/7, HP-Unix 11/10/9, AIX, Sun Solaris 2.6/2.7.
Scheduling Tools: Autosys, Control-M, Tidal, Informatica Scheduling
PROFESSIONAL EXPERIENCE
Confidential, ME
Sr ETL Informatica Developer
Responsibilities:
- Actively involved in gathering requirements and acquiring application knowledge from Business Managers & Application Owners.
- Actively involved in theDesign and development of the STAR schema data model.
- Implementedslowly changingandrapidly changing dimensionmethodologies; createdaggregate fact tablesfor the creation of ad-hoc reports.
- Extensively involved in Data Extraction from Mainframe source, XML, Oracle, JMS message using Power Exchange when there was change in the source data sets.
- Extensively UsedChange Data Capture (CDC)to simplify ETL in data warehouse applications.
- Worked extensively with complex mapping using, Lookups, Expression, Filter, aggregator, Update Strategy, Sequence generator, XML Generator and more.
- Developed Informatica parameter files to filter the daily data from the source system. Created mappings in the designer to implement Type 2 SCD.
- Extensively used IDQ for Data Quality for data cleansing and data matching.
- Mentored Informatica developers on project fordevelopment, implementation, performance tuning of mappings and code reviews.
- Used SQL tools likeTOADto run SQL queries and validate the data in warehouse and mart.
- DevelopedInformatica mappings/mapplets, sessions, Workflowsfor data loads and automated data loads using UNIX shell scripts.
- Used various lookup caches likeStatic, Dynamic, Persistent and Non-Persistent in Lookup transformation.
- Responsible for Creating workflows and worklets. Created Session, Event, Command, Control Decision and Email tasks in Workflow Manager.
- Involved indebugging mappings, recovering sessionsand developingerror-handling methods.
- Successfullymigrated objectsto theproduction environmentwhile providing both technical and functional support.
- UsedSession Parametersto increase the efficiency of the sessions in the Workflow Manager.
- Designed and developedUNIX Scriptsto automate the tasks.
- Resolved memory related issues like DTM buffer size, cache size to optimize session runs.
- Closely Worked with Cognos developers and assisted them in developing Sql Queries, materialized views for using in Cognos.
Environment: Informatica Power Center 9.1/9.5, Power Exchange (CDC), IDQ, Oracle 11g, Flat files, Erwin - 7.0, TOAD 9.x, Cognos, PL/SQL, UNIX, FileZilla, Windows-XP, Autosys, Subversion and UltraEdit.
Confidential, TN
Sr. ETL Informatica Developer
Responsibilities:
- Involved in Business Requirements analysis and design, prepared and technical design documents.
- Used Erwin for logical and Physical database modeling of the staging tables, worked with the Data Modeler and contributed to the Data Warehouse and Data Mart design and specifications.
- Developed technical design specification to load the data into the data mart tables confirming to the business rules.
- Involved in design and development of complex ETL mappings and stored procedures in an optimized manner.
- Cleansed the source data, extracted and transformed data with business rules, and built reusable components such as Mapplets, Reusable transformations and sessions etc.
- Involved in loading the data from Source Tables to ODS (Operational Data Source) Tables using Transformation and Cleansing Logic using Informatica.
- Developed complex Informatica mappings to load the data from various sources using different transformations like source qualifier, connected and unconnected look up, update Strategy, expression, aggregator, joiner, filter, normalizer, rank and router
- Developed Informatica SCD type-I, Type-II and Type III mappings and tuned them for better performance.
- Developed mapplets and worklets for reusability.
- Developed workflow tasks like reusable Email, Event wait, Timer, Command, Decision.
- Implemented partitioning and bulk loads for loading large volume of data.
- Used Informatica debugging techniques to debug the mappings and used session log files and bad files to trace errors occurred while loading
- Involved in performance tuning of mappings, transformations and (workflow) sessions to optimize session performance.
- Created Materialized views for summary tables for better query performance.
- Extensively created shell scripts for various purposes like validation, control totals, ftp, and migration and running sql for framework.
- Implemented weekly error tracking and correction process using Informatica.
- Developed Documentation for all the routines (Mappings, Sessions and Workflows).
- Involved in scheduling the workflows through AutoSys and Job scheduler using UNIX
- Creating Test cases and detailed documentation for Unit Test, System, Integration Test and UAT to check the data quality.
Environment: Informatica Power Center 8.6/9.0.1, Oracle 10g, DB2 9.0, UNIX (AIX), WINSQL, Windows 7, Business Objects XI 3.1, PL/SQL, Flat files, MS SQL Server 2008, MS-Access, Autosys, Subversion, C #.net, Ultra Edit.
Confidential, MI
ETL Informatica Developer
Responsibilities:
- Interacted actively with Business Analysts and Data Modelers on Mapping documents and Design process for various Sources and Targets.
- Extensively worked on schema creations (Star and Snow flake schemas) in Data warehouse.
- Extracted data from wide variety of data Sources like Legacy System databases, Flat files, Relational Databases (Teradata and Oracle) and Heterogeneous sources.
- Created mapping documents for data loading into all Staging, ODS, Dimensions and Fact tables.
- Data Loaded into different Targets like Flat Files and Relational Databases (ORACLE).
- Created mappings to load data mart tables like Dimensions and Fact tables.
- Created mappings using various Transformations such as Source qualifier, Aggregator, Expression, Router, Filter, Rank, Look up, Joiner, Sequence Generator, and Update Strategy.
- Extensively used Re-usable Objects (shortcuts) like Sources, Targets in all mappings to handle metadata changes efficiently.
- Implemented unconnected lookups in ETL mappings to create foreign key relationship between Dimensions and Fact tables.
- Implemented Type1 and Type2 methodologies in ODS tables loading, to keep historical data in data warehouse.
- Extensively worked on creating the new set of composite primary keys on ODS tables to handle Type2 changes efficiently.
- Designed Incremental loading process to load data into staging tables.
- Created Worklets, Workflow and Tasks to schedule the loads at required frequency using Workflow Manager.
- Created reusable email tasks in Workflow manager for process exception handling.
- Debugged all expression and data validation problems in the mappings with debugger.
- Extensively worked on Performance tuning to increase the throughput of the data load (like read the data from flat file & write the data into target flat files to identify the bottlenecks).
- Created and tested AppWorx scripts to automate Job scheduling.
- Validated Informatica processes to check the data is populated correctly.
- Collecting the statistics for each load and implementing the exception handling as part of the load process.
- Maintenance/Support of the application, trouble shooting and Enhancements.
- Closely Worked with Cognos developers and assisted them in developing Sql Queries, materialized views for using in Cognos.
Environment: Informatica Power Center 8.1.1, Oracle 10g/9i Windows Server 2003, PL/SQL, SQL Developer, XML, PL/SQL Developer, Erwin 4.2, AppWorx 5.1.1, Cognos, Windows XP
Confidential, TX
Informatica Developer
Responsibilities:
- Used Erwin for logical and Physical database modeling of the warehouse, responsible for Database schemas creation based on the logical models.
- Used Informatica client tools - Source Analyzer, Warehouse designer, Mapping Designer, Mapplet Designer, and Transformation Developer for defining Source & Target definitions and coded the process of data flow from source system to data warehouse.
- Created new mappings and mapplets and also tuned them for better performance.
- Redesigned some of the existing mappings in the system to meet new functionality.
- Involved checking and comparing data between Source files and database.
- Responsible for preparing Unit testing and Migration Documents.
- Developed mappings in Informatica to load the data from various sources into the Data Warehouse, using different transformations like Joiner, Aggregator, Update Strategy, Rank, Router, Lookup, Sequence Generator, Filter, Sorter, and Source Qualifier.
- Used Workflow Manager for Creating, Validating, Testing and running the sequential and concurrent Batches and Sessions and scheduling them to run at specified time with required frequency.
- Implemented performance tuning logic on Targets, Sources, mappings, sessions to provide maximum efficiency and performance.
- Defined Target Load Order Plan for loading data into Target Tables.
- Used shell scripts for post session operations.
- Worked on database connections, SQL joins, cardinalities, loops, aliases, views, aggregate conditions, parsing of objects and hierarchies.
- Extensively worked in the performance tuning on Informatica mappings.
- Prepared Unit and Integration test cases and tested as per requirements.
Environment: Informatica Power Center 7.1.3 (Repository Manger, Designer, Workflow Monitor, Workflow Manager), Flat files, Oracle10g, Teradata V2R5, Windows NT, PL/SQL, Erwin 4.0,Toad, UNIX.
Confidential
Informatica Developer
Responsibilities:
- Developed ETL processes to load data from Flat files, SQL Server and Access into the target Oracle database by applying business logic on transformation mapping for inserting and updating records when loaded.
- Involved in standardizing the data being stored from various Business Units into the warehouse tables.
- Created complex and robust mappings and Mapplets using Mapping designer and Mapplets to generate different mappings for different loads.
- Fine-tuned existing Informatica mappings for performance optimization.
- Used Power Center Server Manager and workflow monitor to schedule and monitor different sessions of loading.
- Tuned performance of Informatica session for large data files by increasing block size, data cache size, sequence buffer length and target based commit interval.
- Implemented Join, Expression, Aggregate, Rank, Lookup, Update Strategy, Filter and Router Transformations in Mappings.
- Involved in writing the PL/SQL procedures and PL/SQL program units for data extraction, transformation and loading.
- Used Crontab to schedule and automate the session’s running process.
Environment: Informatica PowerCenter 7.1.3 (Repository Manger, Designer, Workflow Monitor, Workflow Manager), Flat files, Oracle, MS SQL Server 2005, Windows NT, PL/SQL, Erwin 4.0,Toad, UNIX, SQL*Plus, PL/SQL, Flat files, MS-Access, Control-M.
