Sr. Etl/informatica Developer Resume
Baltimore, MD
PROFESSIONAL SUMMARY:
- Around 8 years of IT experience in Analysis, Design, Development and Deployment of technical solutions to business requirements. Extensively worked on Data Warehouse Full Life Cycle Projects.
- 6+ years of Strong Data Warehousing ETL experience using Informatics Power Center 10.1/9.6.1/9.5/9.1/9.0/8.6 (Workflow Manager, Workflow Monitor, Source Analyzer, Warehouse Designer, Transformation Developer, Mapping Designer, Informatica Server, Repository Manager). Implementations of change data capture using Power Exchange for daily loads. Experience in using Oracle 11g/10g for performing ETL functions using stored procedures.
- Experience in all the phases of ETL such as Extraction, Cleaning, Transformation and Loading using Informatica.
- Extensive experience and exposure on several areas of the data warehousing and Business including requirements gathering, data warehouse architecture design, development, quality planning & assurance, data analysis and implementation. Worked with TOAD for creation of Tables, Materialized views and normal views.
- Working knowledge with Informatica CDC for daily loads. Experience in doing Tuning of Teradata Queries using Explain plan. Worked in UNIX environment, file transfers and job scheduling.
- Strong knowledge of Entity - Relationship concept, Facts and dimensions tables, slowly changing dimensions and Dimensional Modeling (Star Schema and Snowflake Schema). Working with large databases and performance tuning.
- Involved in analysis, design, development, testing, implementation, and maintenance of various applications.
- Extracted data from various sources ranging from various RDBMS like Oracle, MS SQL Server, DB2, Teradata and Sybase, and Flat Files to load data into data marts and data warehouse.
- Worked on FACETS CTP (Claims Test Pro) and FACETS Testing. Performed data quality checks using data quality tools.
- Involved in Performance Tuning, maintaining Staging area, Backup and Recovery process, product support on various platforms. Efficient in Optimizing, Debugging and testing SQL queries and stored procedures.
- Excellent working knowledge of Shell Scripting and job scheduling on platforms like UNIX.
- Able to interact effectively with other members of the Business, Quality Assurance, Users and other teams involved with the System Development Life cycle. Working with PL/SQL stored procedures, packages, and triggers.
- Automation of the business process using Control M, Autosys and Tidal.
- Designed and coded application components in an Agile environment utilizing a test-driven development approach.
- Excellent analytical, functional, design and development skills with excellent communication skills and the ability to interface with the executives and perform independently as well as team environments.
- Resolving production issues for any scheduled jobs failures and reporting issues to the concerned teams.
TECHNICAL SKILLS:
ETL Tools: Informatica 8.6, 9.1, 9.5.1, 9.6.1, 10.1
DATABASES: Oracle 9i/10g/11g, SQL Server 2008, My SQL, Teradata, Redshift
Programming Languages: UNIX Shell Scripting, SQL
Scheduling Tools: Control M, Autosys
Environment: Windows XP/2000, UNIX, LINUX/Perl
Other Software: TOAD, Putty, WinSCP, SQL Developer, Teradata/BTEQ, HTML, Ruby, Java Script
Other Application: HP Quality Center 9/10, Citrix, SOAP and REST Services
Methodologies: E-R Modeling, Star Schema, Snowflake Schema
PROFESSIONAL EXPERIENCE:
Confidential, Baltimore, MD
Sr. ETL/Informatica Developer
Responsibilities:
- Requirement Gathering and Data Analysis of all supporting systems.
- Transfer the data into Redshift via S3 storage from the data Oracle DB .
- Designed Informatica mappings and data flows. Used Debugger wizard to troubleshoot data and error conditions.
- Understand Business Requirements and translate into Technical Specifications.
- To create SQL Workbench by using Jdbc driver and enter commands to transfer data into redshift which nothing but Database. Managed Amazon redshift clusters such as launching the cluster by specifying the nodes and performing the data analysis queries .
- Maintained staging area between source and target, performed all cleansing operations, aggregations etc.
- Extracted data from different source systems - Oracle, Teradata, DB2, My SQL, Redshift, Flat Files and XML Files.
- Developed ETL programs using Informatica Power center 10.1/9.6.1/9.5.1 to implement the business requirements. Involved in enhancements and maintenance activities of the Enterprise Data Warehouse.
- Communicated with business customers to discuss the issues and requirements.
- Used most of the Transformations available in Informatica - Source Qualifier, Filter, Router, Lookup (Connected & Un Connected), Expression, Update Strategy, Transaction Control and Sequence Generator.
- Prepared mapping specification document, which gives the data flow and transformation logic for populating each column in the data warehouse table. Good experience on FACETS CTP (Claims Test Pro) and FACETS Testing.
- Developed complex mappings using Lookup, SQL, Stored Procedure, and Filter while always striving to achieve the best performance. Translated business requirements into data warehouse design.
- Developed an ETL strategy to integrate disparate legacy sources to eliminate redundancy and create a single view of the Customer data for accurate business analysis. Developed and scheduled the Jobs using Autosys Scheduler.
- Using Informatica Power Center created mappings, sessions and workflows to load data from multiple Source databases and flat files into target Oracle. Designing ETL strategy for both Initial and Incremental & CDC Loads.
- Used Parameters, Variables and Parameter Files for various Database Relational Connections to eliminate migration issues. Developed Informatica processes to facilitate Daily, Weekly and monthly loading of data.
- Extensively worked on all the transformations like Filter, SQL, Aggregator, Expression, Router, Lookup, Update Strategy, Sequence generator, Rank, Union, Joiner, Source Qualifier, etc.,
- Used different transformations for Extraction/Transformation, data cleansing and loading data into staging areas and Presentation Tables. Worked on Perl templates which delivered content to various sites for customers.
- Effectively used Informatica parameter files for defining mapping variables, workflow variables, FTP connections and relational connections. Worked with connected and unconnected look-up for implementing complex logic.
- Has a very good knowledge of FACETS tool and Healthcare domain, Worked on the various modules like Subscriber/Member, Groups, Enrollment, Claims, Billing, Accounting, Provider, MTM and Utilization Management.
- Used UNIX Shell Scripts to automate daily and weekly runs and execute post session commands.
- Created sessions and workflows for processing and to populate the dimensions and facts in the star schema.
- Expertise in using Teradata Utilities BTEQ, M-Load, F-Load, TPT and F-Export in combination with Informatica for better Load into Teradata Warehouse. Worked extensively on SQL, PL/SQL and UNIX shell scripting.
- Involved in the scrum discussions and agile methodology of development of the process of the project.
- Developed unit test cases and ensured that the results are right before moving to QA and Production.
- Worked with QA team on daily basis to follow up on the bugs and made sure the code is bug free before migrating to Production. Wrote and maintained numerous system utilities and web-based applications with Perl.
- Worked on Ruby scripting language. Developed and tested features in an agile environment using Ruby.
- Exposure on NoSQL database and ability to design, develop, test, monitor and troubleshoot environment using Data Virtualization. Ability to follow functional ETL specifications and challenge business logic and schema design.
Environment: Informatica Power Center 10.1/9.6.1/9.5.1, Oracle 11g, PL/SQL, Teradata, UNIX, Shell Scripting, XML, Erwin r9.5.2/9.6, TOAD v12.0., Autosys, BTEQ, Control M, DataStage, FACETS, Perl, Ruby.
Confidential, San Ramon, CA
Sr. ETL/Informatica Developer
Responsibilities:
- Collaborate with Project Manager, Business analysts for requirements gathering, business analysis and designing of End to End solution. Wrote complex SQL Queries involving multiple tables with joins.
- Day to day interactions with Data Modelers and Business Analyst to understand the requirements and the impact of the ETL on the business. Created Unix Shell Scripts to automate sessions and cleansing the source data.
- Extracted data from Oracle database transformed and loaded into Oracle DB according to the business specifications. Developed mapping parameters and variables to support SQL override.
- Involved in Dimensional modelling (Star Schema) of the Data warehouse and used Erwin to design the business process, dimensions and measured facts. Wrote complex PLSQL scripts /functions/procedures/packages.
- Maintained stored definitions, transformation rules and targets definitions using Informatica repository Manager.
- Worked with transformations Source Qualifier, Update Strategy, XML transformation, SQL Transformation, Webservices, Java transformation, Lookup Connected and Unconnected
- Responsible for Designing Logical and Physical data modelling for various data sources on Confidential Amazon Redshift.
- Documentation of ETL process for each project and KT to Offshore and team.
- Worked on different tasks in Workflows like sessions, events raise, event wait, decision, e-mail, command, worklets, Assignment, Timer and scheduling of the workflow. Used Debugger to test the mappings and fixed the bugs. Used Type 1 SCD and Type 2 SCD mappings to update slowly Changing Dimension Tables.
- Involve in Creating ETL Data/Job flow Physical Solution Design Document.
- Involve in creating Oracle Objects like Table Structures, Stored Procedures, functions, cursor as a part of the release. Involve in Documenting ETL Design Document for test plans, test cases, test scripts, test procedures.
- Supporting User Acceptance Testing and Deployment Process.
- Supporting Change Request management and Production Support Task after Deployment.
- Confirm program operation by conducting tests; modifying program sequence and/or codes.
- Working with Supports in converting the client reporting requirements into technical design documents
Environment: Informatica Power center 9.6.1, Oracle 11/10g, SQL server 1.5.5, SSRS, PL/SQL, IDQ, LSF (Job scheduling), UNIX shell scripting, IIS 7.5 Web server, HP-QC.
Confidential, Charlotte, NC
Sr. ETL Informatica Developer
Responsibilities:
- Worked with Business Data Analysts (BDA) to understand the requirements for Data Mart development.
- Utilized all the features of Source Qualifier transformation such as filter, joiner, sorter and SQL override to the extend level Confidential the source level. Created Mapping parameters and Variables and written parameter files.
- Extensively worked with different transformations such as Expression, Aggregator, Sorter, Joiner, Router, Lookup, Filter and Union in developing the mappings to migrate the data from source to target.
- Extensively used Lookup transformation and Lookup Caches in looking the data from relational and Flat Files.
- Extracted data from various heterogeneous sources like Sybase, Flat Files and COBOL (VSAM) using Informatica Power center and loaded data in target database DB2. Used Normalize Transformation for Cobol (VSAM) sources.
- Extensively worked with session logs and workflow logs in doing Error Handling and trouble shooting.
- Developed complex SQL queries to develop the Interfaces to extract the data in regular intervals to meet the business requirements. Involved in doing Unit Testing, Integration Testing and Data Validation.
- Worked with the Control M scheduling team in scheduling Informatica Jobs as per the requirement and frequency.
- Implemented various Performance Tuning techniques by finding the bottle necks Confidential source, target, mapping and session and optimizing them. Involved in DWH up gradation for source system changes.
- Created UNIX shell scripts for various needs. Worked with the Debugger Wizard in debugging the mappings.
- Worked with External stored procedures for data cleansing purpose.
- Worked with the Cognos team in generating various reports. Involved in preparing the Migration Documents.
- Implemented Informatica Procedures and Standards while developing and testing the Informatica objects.
- Successful in Providing 24x7 On-call Support for Production databases.
Environment: Informatica Power Center 9.5.1, Sybase, DB2, Flat Files, Cobol (VSAM), Win SQL, Oracle 10g, Toad, Ultra Edit - 32, SQL Advantage, Control Center, Power Designer SQL Modeler, CDMA, MS-Visio, Cognos, UNIX, Windows.
Confidential, Dallas, TX
ETL/ Informatica Developer
Responsibilities:
- Used Informatica Power Center 9.5 for Extraction, Transformation and Loading data from heterogeneous source systems into the target data base. Scheduled various daily and monthly ETL loads using Control-M.
- Experience working with Business users and architects to understand the requirements and to pace up the process in meeting the milestone. Managed postproduction issues and delivered all projects within specified timelines.
- Perform impact analysis of the existing process of RRP-variant and designing the solution for automating input and output processes to/from RRP. Responsible for Performance tuning Confidential various levels during the development.
- Designed all the above projects and frameworks and lead the development teams to reach the project timelines within the budget. Expertise in UNIX shell scripting, FTP, SFTP and file management in various UNIX environments.
- Designed and developed the Informatica processes to send the data to retail web services (RWS) and capturing the response. Informatica Data Quality (IDQ 8.6.1) is the tool used here for data quality measurement.
- Working with global support technology relationship team to setup VDIs with the required software packages for ETL development for offshore team. On boarding the offshore team with training.
- Identified and eliminated duplicates in datasets thorough IDQ 8.6.1 components of Edit Distance, Jaro Distance and Mixed Field matcher, it enables the creation of a single view of customers, help control costs associated with mailing lists by preventing multiple pieces of mail.
- Work on the performance improved areas. Debug the issues and coming up with the proper solutions which will reduce the process times. Effectively communicates with other technology and product team members.
- Created mappings by cleansing the data and populate that into Staging tables, populating the staging to Archive and then to Enterprise Data Warehouse by transforming the data into business needs & Populating the Data Mart.
- Extensively used Informatica Power Centre tools and transformations such as Lookups, Aggregator, Joiner, Ranking, Update Strategy, Mapplet, connected and unconnected stored procedures / functions / SQL overrides usage in Lookups / Source filter usage in Source qualifiers.
- Created Pre/Post Session and SQL commands in sessions and mappings on the target instance.
- Extracted/loaded data from/into diverse source/target systems like SQL server, XML and Flat Files.
- Identified performance issues in existing sources, targets and mappings by analyzing the data flow, evaluating transformations and tuned accordingly for better performance.
- Used stored procedures to create a standard Time dimension, drop and create indexes before and after loading data into the targets for better performance. Used of Persistent cache to reduce session processing time.
- Developed shell scripts, PL/SQL procedures, for creating/dropping of table and indexes of performance for pre and post session management. Responsible for migrating workflows from development to production environment.
- Worked using Parameter Files, Mapping Variables, and Mapping Parameters for Incremental loading.
Environment: Informatica Power center 9.5/8.6.1, Oracle 11/10g, SQL server 2008, LINUX, IDQ, LSF (Job scheduling), PL/SQL, UNIX shell scripting, IIS 7.5 Web Server, SAS Enterprise guide and MS Visual studio (TFS) for version control, Control M.
Confidential
ETL/Informatica Developer
Responsibilities:
- Worked with various transformations like Source Qualifier, Look up (connected and unconnected), Expression, Aggregate, Update Strategy, Sequence Generator, Joiner, Filter, Rank and Router transformations.
- Involved in the development of Informatica mappings and tuned for better performance.
- Extensively used ETL to load data from flat files to Oracle. Analyzed the source system of ETL Maps.
- Prepared mapping specification document, which gives the data flow and transformation logic for populating each column in the data warehouse table. Adjusted in Data Model and SQL scripts to create and alter tables.
- Worked extensively on SQL, PL/SQL and UNIX shell scripting. Designed and developed the fact/dimension entities.
- Compared actual results to expected results and suggested changes to mappings owned by others.
- Worked on new data model to form single security master for all the Data Marts and retrofit the existing and new securities in the FACT tables. Performed the tuning of ETL SQLs, Designed ETL mapping based on Existing ETL logic.
- Designed and developed IDQ mappings for address validation / cleansing, doctor master data matching, data conversion, exception handling, and report exception data.
- Designed and Developed ETL jobs to extract data from Salesforce replica and load it in data mart in Amazon Redshift.
- Working with Redshift to create tables by SQL Workbench.
- Extracted the data from the flat files and other RDBMS databases into staging area and populated onto Data warehouse. Used Type 1 and Type 2 SCD mappings to update slowly Changing Dimension Tables.
- Used Session parameters, Mapping variable/parameters and created Parameter files for imparting flexible runs of workflows based on changing variable values. Co-ordination with Client Business & Systems team for QA.
- Worked as a fully contributing team member with independent planning & execution responsibilities.
Environment: Informatica Power center 9.5/9.1, Netezza 7.1, Oracle 10g/11g, SQL, PLSQL, Oracle SQL Developer, HP Quality center, MS Office, Oracle OBIEE 10g 10.1.3.4.1/11 g, and Linux.
Confidential
Informatica Developer
Responsibilities:
- Designed and maintained logical and physical enterprise data warehouse schemas using Erwin
- Integrated different systems using Informatica server configuration. Extracted data from Flat files, Oracles Server, MS-Access and Loaded data into Oracle database using Informatica.
- Created Source definitions, Target definitions, Mappings, Transformations, Reusable Transformations, Mapplets using Informatica Designer tool which includes Source Analyzer, Warehouse Designer, Transformation Developer, Mapping Designer and Mapplet Designer. Used Star Schema approach for designing of Data Warehouse.
- Worked extensively on different types of transformations like source qualifier, expression, filter, aggregator, rank, update strategy, lookup, stored procedure, and sequence generator, joiner Transformation.
- Created sessions, database connections and batches, Scheduled and monitored transformation processes using Informatica Server Manager. Translated business requirements into data warehouse design.
- Used Informatica repository manager to backup and migrate metadata in development, test and production systems.
Environment: Informatica Power Center 9.5.1/9.1.1/8.6, BO, UNIX, SQL, PL/SQL, TOAD v11.6/ v12.0, Oracle 10g.
