Sr Etl Informatica Developer Resume
Tulsa, OK
SUMMARY:
- Certified ETL Professional with 7+ years of IT experience in analysis, design, and development of Data warehousing applications.
- Experience in Data Warehouse/Data Mart development using ETL/ Informatica Power Center, IDQ and Power Exchange.
- Experience working in ETL methodologies for supporting data extraction, transformations and loading processing using Informatica Power Center.
- Successful implementation of several subject areas in projects using SSIS, SSRS and Informatica.
- Hands on experience on Create, update and maintain project documents including business requirements, functional and non - functional requirements, functional design, data mapping.
- Well acquainted knowledge in working with Informatica Power Center 9.x/8.x/7.x client tools (Designer, Repository manager, Repository Server Administrator console, Server Manager, Work flow manager, workflow monitor).
- Good understanding indatabaseanddata warehousingconcepts (OLTP & OLAP).
- Strong understanding of the Data modeling (Dimensional & Relational) concepts like Star-Schema and Snowflake Schema.
- Experience working with various Heterogeneous Source Systems like Oracle 11g/10g/9i/8i, SQL, PL/SQL, MS SQL Server 2008/2005, Flat files and Legacy systems.
- Experienced to Profile, Analysis, Standardize, Clean, Integrate, Score Carding, Marge & Match, and Reference Data from various source systems using Informatica Data Quality (IDQ) Toolkits.
- Extensive experience in using various Informatica Designer Tools like Source Analyzer, Transformation Developer, Mapping Designer, Mapplet Designer, Schedulers and Warehouse Designer.
- Extensively created Mapplets, common functions, reusable transformations, look-ups for better usability.
- Worked in designing and developing complex Mappings using transformations like Source qualifier, Aggregator, Expression, Connected & Unconnected lookup, Filter, Joiner, Sequence generator, Sorter, Router, Normalizer and Update Strategy.
- Experience in performing De-normalization, Cleansing, Conversion, Aggregation, Performance Optimization process.
- Involved in implementing in Slowly Changing Dimensions (SCD) using Informatica Power Exchange.
- Good understanding of views, Synonyms, Indexes, Joins and Sub-Queries. Extensively used Cursors and Ref Cursors.
- Expertise in designing and developing Test plans, Test Cases / Test Scenarios, Test Reports for both manual and automated tests and ETL testing on validating the data between source and target tables by writing complex SQL queries.
- Extensive experience in Tuning and scaling the procedures for better performance by running explain plan and using different approaches like hint and bulk load.
- Extensively used SQL, PL/SQL in writing Stored Procedures, Functions, Packages and Triggers.
- Experience in UNIX shell scripting and in Scheduling tools like Autosys
- Data modeling experience using Erwin tool.
- Strong experience to the entire Software Development Life Cycle (SDLC) and Agile Methodology.
TECHNICAL SKILLS:
ETL Tools: Informatica PowerCenter 9.x/8.x/7.x, (Source Analyzer, Warehouse Designer, Transformation Developer, Mapplet Designer, Mapping Designer, Repository Manager, Workflow Manager, Workflow Monitor and Informatica Server) ETL, Repository, Metadata, DataMart, FACT & Dimensions tables, Physical & logical data modeling, Data replicator
Reporting Tools: Oracle BI Business Intelligence (OBIEE 10.1.3.x, Siebel Analytics 7.x.),Business Objects, Cognos 8.4 (Awareness)
Data Modeling: Physical and Logical Data Modeling, Relational Modeling, Dimensional Modeling (Star Schema, Snow-Flake, Fact, Dimensions), Entities, Attributes, Cardinality, ER Diagrams, Erwin 7.0/4.1/5.1
Databases: Oracle 10g/9i/8.0, MS SQL Server 7.0/2000/2005, OLTP,Teradata
Programming: SQL, PL/SQL,SQL*Loader, Unix Shell Scripting, C, SQL Tuning/ Optimization
Other Tools: TOAD, Excel, Word, Autosys, Teradata, SQL- Developer, MS-Office, SSRS, SSIS, Autosys, Secure FTP (SSH).
Environment: UNIX, Windows 2000/NT, Win XP
PROFESSIONAL EXPERIENCE:
Confidential, Tulsa OK
Sr ETL Informatica Developer
Responsibilities:
- Worked with end users to understand the business requirements, designing the work flow, implementing and supporting on ongoing basis.
- Involved in analysis of source systems and identification of business rules.
- Responsible for developing, supporting and maintenance for the ETL (Extract, Transform and Load).
- Prepared high-level design document for extracting data from complex relational database tables, data conversions, transformation and loading into specific formats.
- Involved in Dimensional Modeling using Star schema and Snow Flake schema for faster, effective query processing and Business Analysis Requirements.
- Loaded data from OLTP Tables (which are in MS SQL Server) to Staging table (ORACLE database) and Staging table to OLAP Tables (ORACLE tables).
- Extensively used ETL to load Flat files, Oracle, XML files and legacy data as sources and Oracle as targets.
- Design and Develop ETL Mappings with Teradata scripts like BTEQ.
- Worked extensively on SQL, BTEQ Scripts and UNIX shell scripts.
- Developed Mappings to load data from various sources, using different transformations like Source Qualifier, Expression, Lookup (Connected and Unconnected), Aggregator, Update Strategy, Joiner, Filter and Sorter transformations.
- Worked on Data Extraction, Data Transformations, Data Profiling, Data Loading, Data Conversions and Data Analysis.
- Experience using Informatica IDQ for qualifying the data content and MDM to filter duplicate data as well as to deploy the project as well as Meta Data Management.
- Worked with Informatica Power center work flow manager to create sessions, work flows and work-lets.
- Worked on non-relational sources like Flat files and used secure FTP.
- Worked on Testing of City for Citi Payment Web Application which uses Restful Web services, XML, DOM, JSON and AJAX features..
- Developed IDD search queries to find unique investigators and Research facility
- Create and use match rules to restrict duplicate record creation through IDD and perform Search Match calls from external applications
- Successfully implemented IDD using hierarchy configuration and created subject area groups, subject areas, subject area child, IDD display packages in hub and search queries
- Worked on Informatica to load data from DB2 to Oracle
- Worked extensively on ETL process using Talend and SSIS.
- Develop reports using complex formulas and to query the database to generate different types of ad-hoc reports usingSSRS.
- Setting up of meta param(maintaning meta data of the jobs) for all the ETL's.
- Run ILM tool for analysis to find out sensitive data based on PII, Domains and metadata profiles defined in bank.
- Used agile methodology to design data model in an iterative and incremental manner with help of business and users.
- Implemented Agile for the development & testing activities.
- Created Informatica IDR jobs using Data replication console.
- Created Workflows and monitored Sessions to execute Informatica mappings
- Used Debugger within the Mapping Designer to test thedata flowbetweensource and targetand to troubleshoot the invalid mappings.
- Efficient in writing SQL Queries.
- Installed & Configured Multi-server MDM Hub on a JBOSS cluster on Dev Environment
- SOA was implemented where Data from 16 sources had to be extracted on regular intervals and to be transformed and migrated to an Oracle Data Warehouse. The MDM solution was implemented for this project.
- Control Data Masking processes from a central environment with a multithreaded engine designed to handle data masking for large data volumes.
- Monitor procedures for Data Masking of sensitive information with thorough auditing and reporting capabilities.
- Performance tuning of queries and PL/SQL code. Extensively used explain plan, trace and tkprof utilities
- Implementation of complex business rules in PL/SQL procedures and functions and implementation of those as user defined transformations in Oracle warehouse builder mappings
- Developed Packages, Procedures and functions in PL/SQL, wrote triggers for implementing data integrity
- Tested Data Masking rules before implementation to validate privacy policies.
- Written PL/SQL Procedures, Function, Package & UNIX Shell Scripts to perform database operations and pre & post session commands.
- Created complex mappings and transformations.
- Worked on SQL tools like TOAD and SQL Developer to run SQL Queries and validate the data.
- Schedule Informatica Jobs through Autosys scheduling tool.
- Developed many reports/dashboards Analytic views (Pivot Tables, Charts, Column Selector, and View Selector).
- Worked on power exchange to create data maps, pull the data from mainframe, and transfer into staging area.
- I am responsible to create JMS and JNDI connecting strings in the Workflow designer. I am having good knowledge in the JMS transformations.
- Extracted the JMS text messages from the Oracle Advance Queue (JMS Provider) through the JMS Adapters installed on Informatica PowerCenter Server.
- Attended POC of Informatica IDR
- Worked on setting project for REST and SOAP based Web services in SOAPUI.
- Used SOAPUIPRO 4.5 to test SOAP and Rest based web services applications for Target middleware
- Extensively involved in loading the data from oracle to Teradata database and validating it
- Used the Teradata components BTEQ, Fast export, Multiload etc to load the tables.
- Used Multi load connection to load data into Teradata tables
- Worked on OBIEE answers to build Dashboards with drill down capabilities.
- Fine-tuned Informatica jobs by optimizing all transformations.
- Assisted QA team to fix and find solutions for the production issues
- Prepared all documents necessary for knowledge transfer such as ETL strategy, ETL development standards, ETL processes, etc.
- Extracted source data from Oracle, Flat files, XML files using Informatica, and loaded into target Database.
- Developing new Web Services using JAX-WS technology along with use of SOAP 1.1, WSDL, XML 1.0, XSLT and XSD
- Implement, configure, and install OBIEE 11g components and Oracle WebLogic Server as well as the Informatica client and server in a stand-alone configuration or as part of the Enterprise.
- Performed unit testing and performance tuning for transformation and mapping.
- Prepared Weekly Status Reports (PSR) and shared with the Managers
- Production Support which involves solving user problems and Provided End User Training and Support.
- Identified issues with the product tool and interfaced with Informatica Support & Engineering team to resolve the same. Issues fixed related to IDD performance, SIF user exit issues and other critical functionalities would have certainly helped the product to enhance more and benefited other customers as well.
- Architected Informatica Data quality and Informatica Data Integration HUB environments.
- Provide estimates to project manager to build Informatica Data quality and Informatica Data Integration HUB environments.
- Installed and Configured Informatica Data Quality and Data Integration HUB on Linux Environment.
- Used SIF APIs such as Get, SearchQuery, CleansePut, SearchMatch, Merge and Unmerge to develop complex application to communicate with Hub Server and process the data from Base Object.
- Implemented SOAP Web Service using SIF APIs such EJB Siperian Client in order to use Get, SearchQuery and CleansePut functionality.
- Prepared User documentation to train users and functionality of each report
Environment: Informatica Power Center 9.5.1/8.6.1, Informatica IDR, Informatica Power Exchange, MDM, Oracle 10g, Teradata, IBM DB2, DAC,Teradata, IDD Flat files, Informatica SIF, MS-SQL Server 2005,XML, PL/SQL, SQL developer, Web Services, Business Objects,JMS, Erwin,XML, JSON,Jboss,ILM, UNIX Shell Script, Windows XP.
Confidential, Austin TX
Sr. ETL Informatica Developer
Responsibilities:
- Involved in Dimensional modeling (Star Schema) of the Data warehouse and used Erwin to design the business process, grain, dimensions and measured facts.
- Extracted the data from the flat files and other RDBMS databases into staging area andpopulated onto DataWarehouse.
- Extensively used Power Exchange to integrate the sources like Mainframe MVS, VSAM, GDG, DB2 and XML files.
- Developed UNIX Shell scripts for File Manipulation, FTP, Executing DB2 SQLs and archiving log files.
- Worked on FTP protocols in UNIX environment. Implemented few scripts which perform few data operations with files that we load into oracle platform.
- Forklifting data from the existing data warehouse in Oracle to Teradata environment using a realtime change data capture (CDC) tool DB Sync now called Informatica Data replicator.
- Attended POC of Informatica IDR.
- Creation of web site using PL/SQL web cartridge
- Back-End development, writing Packages, Procedures, Functions & Triggers in PL/SQL. SQL Tuning using Explain Plan, Trace and TKPROF utilities.
- Configured HP Open View monitoring to scrape the logs and send alerts using alarmpoint.
- Provided guidance and reviewed automation of data quality and data integration hub code migration.
- Hands on ETL Development (Talend) with support from onsite consultants on daily basis in Agile Scrum/Sprint environment.
- Experienced in the use of agile approaches, including Extreme Programming, Test-Driven development and Scrum.
- Configured Informatica data replication (IDR) fast clone.
- Installed & Configured Multi-server MDM Hub on a JBOSS cluster on Dev Environment
- Developed number of complex Informatica mappings, Mapplets, reusable transformation to implement the business logic and to load the data incrementally.
- Developed Informatica mappings by usage of Aggregator, SQL Overrides in Lookups, Source filter in Source Qualifier and data flow management into multiple targets using Router transformations
- Used Debugger to test the mappings and fixed the bugs.
- Used various transformations like Filter, Expression, Sequence Generator, Update
- Created sessions, configured workflows to extract data from various sources, transformed data, and loading into data warehouse.
- Worked with JMS text messages as a source system, which arrive in the form of XML payload and also implemented Mid-stream transformations such as XML parser transformation to parse the XML string.
- Extensively worked on XML sources, targets and JMS queue.
- Used Power Center server manager/Workflow manager for session management, database connection management and scheduling of jobs to be run in the batch process using Control M auto scheduling tool.
- Architected Metadata to manage ETL loads, wrote stored procedures, packages to manage the ETL metadata
- ILM tool for discovery and finding out sensitive data from database based on PII, PCI defined in metadata expressions.
- The implemented solution will move data from thousands of sources to thousands of targets. Dynamically created parameter files using ETL metadata and mappings, implemented incremental load architecture
- Worked on Testing of City for Citi Payment Web Application which uses Restful Web services, XML, DOM, JSON and AJAX features.
- Worked with other supporting teams such as SOA integration team to verify a record created or updated in database is reflected in all downstream systems
- Worked extensively on SQL, BTEQ Scripts and UNIX shell scripts.
- Worked on Informatica PowerCenter Tools- Repository Manager, Informatica Designer, Workflow Manager/ Monitor, Informatica Data Quality (IDQ) Developer and Analyst Toolkits.
- Migrated mappings, sessions, and workflows from Development to testing and then to Production environments.
- Published Web Service in order to by external client.
- Designed and developed outbound feeds using Services Integration Framework (SIF) and JMS Queues.
- Involved in massive data cleansing and data profiling of the production data load.
- Developing and maintaining Data Profiling mappings using Informatica to measure data quality of certain key fields.
- Analyzing MS-SQL Server Store procedures, Metrics and reports to "Source to Target" mapping, performed gap analysis and participated in data discovery session.
- Created multiple Type 2 mappings in the Customer mart for both Dimension as well as Fact tables, implementing both date based and flag based versioning logic.
- Monitor troubleshoots batches and sessions for weekly and Monthly extracts from various data sources across all platforms to the target database.
- Given Production support to resolve the issues.
- Involved in Performance tuning at source, target, mappings, sessions, and system levels.
- Used SQL server reporting services (SSRS) using multiple output formats.
- Migrated DTS objects to SQL Server Integrated Services (SSIS).
- Developed reusable TDF’s to load data from flat files and other data sources to the MDM Hub Data Quality (IDQ).
- Implement multiple user exits, validation rules, SIF API’s to customize IDD application and create business classified records.
- Write User Exits for validation errors and messages for save operation in IDD
- Worked with NAS and Infa Support in troubleshooting Hub and IDD issues.
- Implemented IDD for Pharma R&D model as per the Business requirements
- Sourced data from Teradata to Oracle using Fast Export and Oracle SQL Loader
- Created load scripts using Teradata Fast Load and Multi load utilities and procedures in SQL Assistant
- Tested the data and data integrity among various sources and targets. Associated with Production support team in various performance related issues.
- Developed UNIX shell scripts to move source files to archive directory.
- Used Informatica power connect to connect external Data bases.
- Involved in Unit, Integration, system, and performance testing levels
- Extensively used SQL* loader to load data from flat files to the database tables in Oracle.
- Worked on Informatica Power Center tools- Designer, Repository Manager, Workflow Manager, and Workflow Monitor.
- Created various data marts from data warehouse and generated reports using Cognos
- Developed Standard Reports, List Reports, Cross-tab Reports, Charts, Drill through Reports and Master Detail Reports Using Report Studio.
- For User Interface(UI),used Amazon EC2 web service to make look and feel better anad its very easy to access.
- Used concept of staged mapping in order to perform asynchronous Web Services request and response as part of Informatica Mappings .
- Developed web services workflows using informatica.
- Created Query prompts, Calculations, Conditions, Filters, Multilingual Reports Using Report Studio.
Environment: Informatica Power Center suite 8.6.1, Informatica IDR, Informatica power connect suite,Oracle10g, MDM, SQL Server, SQL, PL/SQL,SQL* Loader,JSON,Jboss, Teradata, Erwin, TOAD 9.5, Star Schema, UNIX Shell Scripts, Cognos8.x, Web Services, SIF,JMS, Flat files, Windows XP,XML, ILM, IDD, and MS-Office tools.
Confidential, Burbank, CA
ETL Informatica Developer
Responsibilities:
- Extensively used Informatica Power Center for Extraction, Transformation and Loading process.
- Worked on Informatica tools - Repository Manager, Designer, Workflow Manager and Workflow Monitor.
- Involved in Data Loading Sequence and Populated Data into Staging Area and Warehouse with Business Rules.
- Designed and developed various Mappings and Mapplets in Mapping designer and sessions and workflows in Workflow manager to extract data from SQL Server and load to Oracle database.
- Extracted the source definitions from various relational sources like Oracle and Flat Files.
- Developed transformation logic for different mappings using transformations like Source Qualifier, Joiner, Aggregator, Expression, Filter, Router, Lookup, Update Strategy, and Sequence Generator
- Developed reusable transformations, Mapplets and Worklets and utilized mapping parameters, session parameters, user defined functions to optimize the performance.
- Worked on different transformations like Source Qualifier, Joiner, Filter, Update Strategy, Lookup, Rank, Expression, Aggregator and Sequence Generator to load data into target database.
- Responsible for Data Staging Development and Deployment.
- Handled Slowly Changing Dimensions of Type1/ Type 2 to populate current and historical data to dimensions and fact tables in the Data Warehouse.
- Extensively used Stored Procedures, Functions, Triggers and Packages using PL/SQL for creating Connected and Unconnected Stored Procedure Transformations.
- Created workflows using Workflow manager for different tasks like sending email notifications, timer that triggers when an event occurs, and sessions to run a mapping.
- Utilized Informatica debugger for trouble-shooting and to test the data flow.
- Reviewed session log files to trace causes of bottlenecks and optimized them by tuning the transformation logic in mappings and SQL queries involved.
- Developed and Implemented UNIX shell scripts and scheduled different Informatica jobs.
- Created UNIX shell scripts and called as pre-session and post-session commands.
- Involved in Unit Testing and Integration Testing of the application.
- Documented the entire process. The documents included the mapping document, unit testing document and system testing document among other
Environment: Informatica Power Center 8.1, Oracle 10g, Flat files, UNIX Shell Scripting, PL/SQL, SQL Server, Toad.
Confidential, Houston, TX
ETL Informatica Developer
Responsibilities:
- Participated in reviews and meetings to evaluate documents, plans, code, requirements and specifications.
- Analyzed the source data coming from Oracle, Teradata and Excel files. Worked with Data Warehouse team in developing Dimensional Model.
- Worked closely with the user decision makers to develop the transformation logic to be used in Informatica.
- Designed and developed Star Schema and created Fact and Dimension Tables for the Warehouse using Erwin.
- Dealt with SSIS Import/Export wizard to move data in and out of SQL Server.
- Used Informatica Designer to create mappings using different transformations to move data to Data marts and Data Warehouse.
- Developed complex mappings in Informatica to load the data from various sources into the Data Warehouse, using different transformations like Source Qualifier, Expression, Lookup, Aggregator, Union, Joiner, Rank and stored procedure.
- Implemented Slowly Changing dimension (SCD) methodology for accessing the full history of accounts and transaction information.
- Worked with Teradata stand-alone load and unload utilities Mload and Fastload.
- Scheduled the Informatica workflows using the scheduler tool Autosys.
- Identified the Bottlenecks and resolved performance the Bottlenecks and implemented performance tuning logic on targets, sources, mappings, sessions to provide maximum efficiency and performance.
- Worked on Prompts to build Interactive Dashboards/reports with drill-down capabilities.
- Developed Analysis Studio views of analysis from dimensional modeled packages.
- Provided 24/7 Support for the Production that has Daily, Weekly and monthly refresh for production OLTP instance.
Environment: Informatica Power Center 8.1/7.1, Oracle 10g, Teradata V2R5, UNIX, Erwin 4.0, Toad, SQL Server 2005, SQL*Loader, Autosys, Cognos 8 BI.
Confidential
ETL Developer
Responsibilities:
- Understood the source systems and collected requirements from business users.
- Worked with analysts and data source systems experts to map requirements to ETL code.
- Analyzed the source data coming from different sources (Oracle, Flat files).
- Created mappings for cleansing, transforming and loading data into warehouse.
- Used various transformations like Source Qualifier, Expressions, Aggregator, Update Strategy, Sequence Generator, Router and Lookups.
- Involved in writing PL/SQL stored procedures and functions.
- Created Mapplets to facilitate ease and reuse of common mapping logic.
- Created sessions for mappings and utilized workflow manager & monitor to create, schedule and monitor workflows.
- Involved in Unit Testing for Created mappings.
- Involved in code review of Informatica mappings and sessions.
- Worked with UNIX shell scripts to run Informatica workflows.
- Involved in the process design documentation of the Data Warehouse Dimensional Upgrades.
Environment: Informatica PowerCenter 6.1, Oracle 8i, PL/SQL, Toad, Flat files, UNIX,MS Visio, Control M and Windows 2000.
