Sr.informatica Etl/idq Developer Resume
Englewood, CO
SUMMARY:
- Over 6+ year's Extensive experience in using ETL methodologies for supporting Data Extraction, Data Migration, Data Transformation and developing Master Data using Informatica Power Center/IDQ.
- Created mappings in mapping Designer to load data from various sources using transformations like Transaction Control, Lookup (Connected and Un - connected), Router, Filter, Expression, Aggregator, Joiner and Update Strategy, SQL, Stored Procedure and more.
- Extensively worked with Teradata utilities like BTEQ, Fast Export, Fast Load, Multi Load to export and load data to/from different source systems including flat files.
- Hands on experience using query tools like TOAD, SQL Developer, PLSQL developer, Teradata SQL Assistant and Query man.
- Expertise in writing large/complex queries using SQL.
- Worked on Informatica Data Quality 9.1(IDQ) tool kit and performed data profiling, cleansing and matching and imported data quality files as reference tables
- Excellent Knowledge on Slowly Changing Dimensions (SCD Type1, SCD Type 2, SCD Type 3), Change Data Capture, Dimensional Data Modeling, Ralph Kimball Approach, Star/Snowflake Modeling, Data Marts, OLAP and FACT and Dimensions tables, Physical and Logical data modeling.
- Involved in the Analysis, Design, Development, Testing and Implementation of business application systems for Health care, Pharmaceutical, Financial, Telecom and Manufacturing Sectors.
- Excellent in designing ETL procedures and strategies to extract data from different heterogeneous source systems like oracle 11g/10g, SQL Server DB2 10, Flat files, XML, SAP R/3 etc.
- Good knowledge on data quality measurement using IDQ and IDE
- Extensive ETL experience using Informatica Power Center (Designer, Workflow Manager, Workflow Monitor and Server Manager) Teradata and Business Objects.
- Experience in designing and Developing Complex Mappings using Informatica Power Center with Transformations such as Lookup, Filter, Expression, Router, Joiner, Update Strategy, Aggregator, XML generator, XML parser, Stored Procedure, Sorter and Sequence Generator.
- Working experience using Informatica Workflow Manager to create Sessions, Batches and schedule workflows and Worklets, Re-usable Tasks, Monitoring Sessions
- Experienced in Performance tuning of Informatica and tuning the SQL queries.
- Proficient with Informatica Data Quality (IDQ) for cleanup and massaging at staging area.
- Performed the data profiling and analysis making use of Informatica Data Explorer (IDE) and Informatica Data Quality (IDQ).
- Designed and Developed IDQ mappings for address validation / cleansing, doctor master data matching, data conversion, exception handling, and report exception data.
- Hands-on experience across all stages of Software Development Life Cycle (SDLC) including business requirement analysis, data mapping, build, unit testing, systems integration and user acceptance testing.
- Experience in handling initial/full and incremental loads.
- Create database triggers for Data Security.
- Using DataFlux in data management software and business consulting services.
- Experience in SQL, PL/SQL and UNIX shell scripting.
- Hands on experience working in LINUX, UNIX and Windows environments.
- Expertise in scheduling workflows Windows scheduler, Unix and scheduling tools like CRTL-M & Autosys.
- Worked with Business Managers, Analysts, Development, and end users to correlate Business Logic and Specifications for ETL Development.
- Experienced in Quality Assurance, Manual and Automated Testing Procedures with active involvement in Database/ Session/ Mapping Level Performance Tuning and Debugging.
- Experience in support and knowledge transfer to the production team.
- Excellent Verbal and Written Communication Skills. Have proven to be highly effective in interfacing across business and technical groups.
TECHNICAL SKILLS:
ETL Tools: Informatica Power Center … x., Informatica Power Exchange 9.x, Informatica Data Quality (IDQ), SSIS, SSRS.
Data Modeling: Star Schema, Snowflake Schema, Erwin 4.0, Dimension Data Modeling.
Databases: … SQL … TOAD, Teradata … V2R6, Sybase, MS Access.
Scheduling Tools: Control-M, CA7 Schedule, Autosys, Informatica Scheduler.
Reporting Tools: Crystal Reports, OBIEE 11g R1 (11.1.5).
Programming: SQL, PL/SQL, Transact SQL, HTML, XML, C, C++, Korn Shell, Bash.
Operating Systems: Windows … DOS, UNIX and LINUX
Other Tools: SQL*Plus, Toad, SQL Navigator, Putty, MS-Office, SQL Developer.
WORK EXPERIENCE:
Sr.Informatica ETL/IDQ Developer
Confidential, Englewood, CO
Responsibilities:
- Analyze the business requirements and framing the Business Logic for the ETL Process and maintained the ETL process using Informatica Power Center.
- Experienced in Parsing high - level design specs to simple ETL coding and mapping standards.
- Extensively worked on Desktop to create Applications Objects, Reports and Dashboards (Documents & Scorecards).
- Generated reports using Advanced Metric objects, Filters, Prompts and also created Customized Templates to facilitate the End users to create customized reports by choosing Filters, Metrics and Report Attributes.
- Worked on Agile Methodology, participated in daily/weekly team meetings, guided two groups of seven developers in Informatica PowerCenter/Data Quality (IDQ), peer reviewed their development works and provided the technical solutions. Proposed ETL strategies based on requirements.
- Worked with team to convert Trillium process into Informatica IDQ objects.
- Extensively used the DQ transformations like Address validator, Exception, Parser, Standardizer, Solid experience in debugging and troubleshooting Sessions using the Debugger and Workflow Monitor
- Extensively worked on UNIX shell scripts for server Health Check monitoring such as Repository Backup, CPU/Disk space utilization, Informatica Server monitoring, UNIX file system maintenance/cleanup and scripts using Informatica Command line utilities.
- Extensively worked on CDC to capture the data changes into sources and for delta load. Used Debugger to validate the Mappings and gained troubleshooting information about the data and error conditions.
- Developing workflows with Worklets, Event waits, Assignments, Conditional flows, Email and Command Tasks using Workflow Manager.
- Proficient in System Study, Data Migration, Data integration, Data profiling, Data Cleansing / Data Scrubbing and Data quality
- Worked on Informatica Data Quality (IDQ) toolkit, analysis, data cleansing, data matching, data conversion, address standardization, exception handling, reporting and monitoring capabilities of IDQ.
- Coded Teradata BTEQ SQL Scripts to load, transform data, fix defects like SCD 2 date chaining, cleaning up duplicates.
- Experience in creation of ETL Mappings and Transformations using Informatica Power Center to move data from multiple sources into target area using complex transformations like Expressions, Routers, Lookups, Source Qualifiers, XML generator, XML Parser, Aggregators, Filters, Joiners.
- Tune ETL procedures and STAR schemas to optimize load and query Performance.
- Design and tested the dimensional tables, ODS tables.
- Built interface with existing Legacy system.
- Responsible in preparing Logical as well as Physical data models and document the same.
- Performed ETL code reviews and Migration of ETL Objects across repositories.
- Developed ETL's for masking the data when made available for the Offshore Dev. Team.
- Monitored day to day Loads, Addressed & resolved Production issues in an abrupt & timely manner and provided support for the ETL jobs running in Production in order to meet the SLA's.
- Involved in implementing change data capture (CDC) and Type I, II, III slowly changing Dimensions
- Developed functions and stored procedures to aid complex mappings
Environment: Informatica Power Center 10.x/9.6, Informatica Data Quality (IDQ) 9.6, Oracle 11g, Teradata, PL SQL, SQL developer, TOAD, Putty, Unix
Sr. Infomatica ETL Developer
Confidential, Houston, TX
Responsibilities:
- Assisted Business Analyst with drafting the requirements, implementing design and development of various components of ETL for various applications.
- Developed Metrics, Filters, Prompts to achieve the functionality of the canned reports and created advanced objects like Derived Metrics, Compound Metrics.
- Worked closely with ETL Architect and QC team for finalizing ETL Specification document and test scenarios.
- Design, develop, test and review & optimize Informatica MDM and Informatica IDD Applications.
- Involved in match/merge and match rules to check the effectiveness of MDM process on data.
- Worked with Informatica Data Quality 9.6.1 (IDQ) toolkit, Analysis, data cleansing, data matching, data conversion, exception handling, Score cards, reporting and monitoring capabilities of Informatica Data Quality IDQ 9.6.1.
- Imported Mappings and rules into power center for scheduling using Tidal.
- Extracted data from oracle database and spreadsheets, CSV files and staged into a single place and applied business logic to load them in the central oracle database.
- Designed and developed Informatica Mappings and Sessions based on user requirements and business rules to load data from source flat files and RDBMS tables to target tables.
- Worked in implementation of Profiling, Score Card, Classifier models, Probabilistic models, Human task and Exception record management as part of IDQ process.
- Migration of code between the Environments and maintaining the code backups.
- Designed and Developed IDQ mappings for address validation / cleansing, doctor master data matching, data conversion, exception handling, and report exception data.
- Integration of various data sources like Oracle, SQL Server, Fixed Width & Delimited Flat Files, DB2.
- Involved in the Unit Testing and Integration testing of the workflows developed.
- Extensively worked with Korn - Shell scripts for parsing and moving files and even for re-creating parameter files in post-session command tasks.
- Imported Source/Target Tables from the respective databases and created reusable transformations like Joiner, Routers, Lookups, Filter, Expression and Aggregator and created new mappings using Designer module of Informatica.
- Used the Address Doctor to validate the address and performed exception handling, reporting and monitoring the system. Created different rules as mapplets, Logical Data Objects (LDO), workflows. Deployed the workflows as an application to run them. Tuned the mappings for better performance.
- Working with database connections, SQL joins, cardinalities, loops, aliases, views, aggregate conditions, parsing of objects and hierarchies.
- Worked with end users along with Business Analysts to build reports and dynamic dashboards.
- Developed shell scripts for running batch jobs and scheduling them.
- Handling User Acceptance Test & System Integration Test apart from Unit Testing with the help of Quality Center as bug logging tool. Created & Documented Unit Test Plan (UTP) for the code.
- Involved in Production Support.
Environment: Informatica Power Center 9.6, Informatica Data Quality (IDQ) 9.5, Informatica MDM 9.6, Informatica BDE, Natezza, Oracle 11g, SQL Server, PL/SQL, Unix and WINSCP.
Sr. Informatica ETL Developer
Confidential, Phoenix, AZ
Responsibilities:
- Develop complex mappings by efficiently using various transformations, Mapplets, Mapping Parameters/Variables, Mapplet Parameters in Designer. The mappings involved extensive use of Aggregator, Filter, Router, Expression, Joiner, Union, Normalizer, Sequence generator, SQL and Web Service transformations.
- Demonstrated the ETL process Design with Business Analyst and Data Warehousing Architect.
- Assisted in building the ETL source to Target specification documents
- Built the Physical Data Objects and developed various mapping, mapplets/rules using the Informatica Data Quality (IDQ) based on requirements to profile, validate and cleanse the data. Identified and eliminated duplicate datasets and performed Columns, Primary Key, Foreign Key profiling using IDQ 9.5.1.
- Worked on Agile Methodology, participated in daily/weekly team meetings, guided two groups of seven developers in Informatica PowerCenter/Data Quality (IDQ), peer reviewed their development works and provided the technical solutions. Proposed ETL strategies based on requirements.
- Involved in match/merge and match rules to check the effectiveness of MDM process on data.
- Work on SQL coding for overriding for generated SQL query in Informatica.
- Involve in Unit testing for the validity of the data from different data sources.
- Design and develop PL/SQL packages, stored procedure, tables, views, indexes and functions. Experience dealing with partitioned tables and automating the process of partition drop and create in oracle database.
- Perform data validation in the target tables using complex SQLs to make sure all the modules are integrated correctly.
- Worked with Informatica Data Quality (IDQ) toolkit, Analysis, data cleansing, data matching, data conversion, exception handling, and reporting and monitoring capabilities of IDQ.
- Perform Data Conversion/Data migration using Informatica PowerCenter.
- Involve in performance tuning for better data migration process.
- Analyze Session log files to resolve error in mapping and identified bottlenecks and tuned them for optimal performance.
- Create UNIX shell scripts for Informatica pre/post session operations.
- Automated the jobs using CA7 Scheduler.
- Document and present the production/support documents for the components developed, when handing - over the application to the production support team.
- Created Data Model for the Data Marts.
- Used materialized views to create snapshots of history of main tables and for reporting puspose
- Coordinating with users for migrating code from Informatica 8.6 to Informatica 9.5.
- Monitored day to day Loads, Addressed & resolved Production issues in an abrupt & timely manner and provided support for the ETL jobs running in Production in order to meet the SLA's
- Used various transformations like Source Qualifier, Expression, Aggregator, Joiner, Filter, Lookup, Update Strategy Designing and optimizing the Mapping.
- Prepared SQL Queries to validate the data in both source and target databases.
Environment: Informatica 9.5/8.6, Informatica Data Quality (IDQ) 9.5, Oracle 11g, SQL server 2008 R2, SQL, T-SQL, PL/SQL, Toad 10.6, SQL Loader, OBIEE, Unix, Flat files, Teradata
ETL Informatica Developer
Confidential, Detroit, MI
Responsibilities:
- Logical and Physical data modeling was done using Erwin for data warehouse database in STAR SCHEMA.
- Worked on Agile Methodology, participated in daily/weekly team meetings, guided two groups of seven developers in Informatica PowerCenter/Data Quality (IDQ), peer reviewed their development works and provided the technical solutions. Proposed ETL strategies based on requirements.
- Worked with health payer related data such as customers, policy, policy transactions, claims.
- Generated weekly and monthly report status for the number of incidents handled by the support team.
- Designed and developed complex mappings by using Lookup, Expression, Update, Sequence generator, Aggregator, Router, Stored Procedure, etc., transformations to implement complex ETLlogics
- Worked with Informatica power center Designer, Workflow Manager, Workflow Monitor and Repository Manager.
- Used Source Analyzer and Warehouse designer to import the source and target database schemas, and the Mapping Informatica Designer to create complex mappings from Business requirements.
- Created various transformations like filter, router, lookups, stored procedure, joiner, update strategy, expressions and aggregator to pipeline data to Data Warehouse/Data Marts and monitored the Daily and Weekly Loads.
- Designed and developed various complex SCD Type1/Type2 mappings in different layers, migrated the codes from Dev to Test to Prod environment. Wrote down the techno - functional documentations along with different test cases to smooth transfer of project and to maintain SDLC.
- Experience in using Stored Procedures, TOAD, Explain Plan, Ref Cursors, Constraints, Triggers, Indexes-B-tree Index, Bitmap Index, Views, Inline Views, Materialized Views, Database Links, Export/Import Utilities.
- Developed and maintained ETL (Extract, Transformation and Loading) mappings to extract the data from multiple source systems like Oracle, SQL server and Flat files and loaded into Oracle.
- Developed Informatica Workflows and sessions for mappings using Workflow Manager.
- Deployed the Informatica code and worked on code merge between two different development teams.
- Identified the bottlenecks in the sources, targets, mappings, sessions and resolved the problems.
- Created Pre-& Post-Sessions UNIX Scripts to merge the flat files and to create, delete temporary files, change the file name to reflect the file generated date etc.
Environment: Informatica Power Center Designer 9.5/8.6, Informatica Repository Manager, Oracle10g/9i, DB2 6.1, Erwin, TOAD, Unix- SunOS, PL/SQL, SQL Developer, Teradata.