Etl Consultant Resume
Plano, TexaS
SUMMARY
- 10 years of IT experiencein Analysis, Design, Development, Implementation, Testing and Supportof Data Warehousing and Data Integration Solutions using Informatica Powercenter.
- 7 years of experience in using Informatica PowerCenter ( 7.1.3/8.6.1/9.0.1 ).
- 1+ years of experience in Reporting tool COGNOS ( 10.2.2 and 11).
- 2 + year of experience in Talend Open studio and Talend Integration Suite .
- Knowledge in Full Life Cycle development of Data Warehousing.
- Have extensively worked in developing ETL program for supporting Data Extraction, transformations and loading using Informatica Power Center.
- Experience with dimensional modeling using star schema and snowflake models.
- Understand the business rules completely based on High Level document specifications and implements the data transformation methodologies.
- Created UNIX shell scripts to run the Informatica workflows and controlling the ETL flow.
- Developed OLAP applications using Cognos 8BI - (Frame Work Manager, Cognos Connection, Report Studio, Query Studio, and Analysis Studio) and extracted data from the enterprise data warehouse to support the analytical and reporting for Corporate Business Units.
- Strong with relational database design concepts.
- Designed and developed various PL/SQL stored procedures to perform various calculations related to fact measures.
- Converted the PL/SQL Procedures to Informatica mappings and at the same time created procedures in the database level for optimum performance of the mappings.
- Implement PL/SQL requirements or rules into the ETL tool.
- Developed Informatica mappings and also tuned them for better performance with PL/SQL Procedures/Functions to build business rules to load data.
- Involved in migration of the mapps from IDQ to power center.
- Designed developed and implemented Master Data Management solution Customer Party MDM Domain using MDM 9.6.1.
- Extensively worked with Informatica performance tuning involving source level, target level and map level bottlenecks.
- Excellent experience working on Talend ETL and used features such as Context variables, Database components like tMSSQLInput, tOracleOutput, tmap, tFileCopy, tFileCompare, tFileExist file components, ELT components etc.
- Strong business understanding of verticals like Banking, Brokerage, Insurance, Mutual funds and Pharmaceuticals.
- Independently perform complex troubleshooting, root-cause analysis and solution development
- Experience on multi-threading, data structures, algorithms, object oriented design, and design patterns.
- Ability to meet deadlines and handle multiple tasks, decisive with strong leadership qualities, flexible in work schedules and possess good communication skills.
- Team player, Motivated, able to grasp things quickly with analytical and problem solving skills.
- Comprehensive technical, oral, written and communicational skills.
TECHNICAL SKILLS
Operating Systems: Windows, Linux, HP-UX
Software / Applications: MS XP, MS 2000, MS Word, MS Excel, MS AccessOutlook, PowerPoint
Database: SQL Server 2008/2005/2000 , Oracle 10g/9i/8i
ETL: Informatica PowerCenter 7.1.3/8.6.1/9.0.1 Informatica Power Exchange 8.6.1Modeling Talend 5.1.1, Framework Manager, PowerPlay Transformer
OLAP/BI Tools: Cognos 10 Series
Languages: Java, HTML, XML, SQL, PL/SQL.
Web/Apps Servers: IBM Web Sphere 4x, Sun iPlanet Server 6.0., IIS, Tomcat
Tools: TOAD, Visio, Eclipse
PROFESSIONAL EXPERIENCE
Confidential, Plano, Texas
ETL Consultant
Responsibilities:
- Involved in gathering and analyzing the requirements and preparing business rules.
- Worked with Informatica power center Designer, Workflow Manager, Workflow Monitor and Repository Manager.
- Developed and maintained ETL (Extract, Transformation and Loading) mappings to extract the data from multiple source systems like Oracle, SQL server and Flat files and loaded into Oracle.
- Developed Informatica Workflows and sessions associated with the mappings using Workflow Manager.
- Involved in creating new table structures and modifying existing tables and fit into the existing Data Model.
- Extracted data from different databases like Oracle and external source systems using ETL tool.
- Involved in debugging Informatica mappings, testing of Stored Procedures and Functions, Performance and Unit testing of Informatica Sessions, Batches and Target Data.
- Developed Mapplets, Reusable Transformations, Source and Target definitions, mappings using Informatica 9.5.1.
- Generated queries using SQL to check for consistency of the data in the tables and to update the tables as per the Business requirements.
- Used Oracle to write SQL queries that create/alter/delete tables and to extract the necessary data.
- Involved in Performance Tuning of mappings in Informatica.
- Good understanding of source to target data mapping and Business rules associated with the ETL processes.
- Used IDQ tool for profiling, applying rules and develop mappings to move data from source to target systems.
- Applied the rules and profiled the source and target table's data using IDQ.
- Cleanse and Scrub the Data in uniform data type and format applying MDM Informatica and IDQ tools and Load to STAGE and HUB tables and then to the EDW and Finally to Dimension and rollup/aggregate the data by the business grains into the FACT tables.
- Validate data quality, transformation logic and requirements as part the BRD and fixed defects that assigned through ALM.
- Involved in daily meetings to update the daily activities and progress on tasks.Involved with testing Team to understand the defects and fixes code. developing Dashboards Reports in Cognos 11
- Generated various List Reports, Grouped Reports, Cross tab Reports, Chart Reports, Drill-Down and Drill-Through Reports.
- Generated Complex reports in Cognos 11 report studio including Drill Down reports from DMR modeled Frame work model.
- Created Dashboards to present critical company data in a single report.
- Created list reports & cross tab reports using cognos 11.
- Provided updates to Project Manager and other team members on development,testing activities. Attended daily agile standup meetings.
Environment: Informatica9.5.1, Oracle 11g, Unix,Tibco, SAP Success Factors, CognosBI11 Reporting, Informatica IDQ, MDM.
Confidential, Boston, MA
ETL Consultant
Responsibilities:
- Involved to understand the Business requirements with Business Analysts and stakeholders.
- Involved to design the blue print and approach Documents for high level development and design of the ETL applications.
- Developed complex ETL mappings to load dimension and fact tables.
- Worked with type 1 and type 2 dimensional mappings to load data from source to target.
- Worked on agile methodology and JIRA based stories.
- Designed blueprint and approach documents for each story and take approvals from the business analysts to design the ETL mappings.
- Developed mappings, sessions, workflows and run the jobs.
- Used reusable transformation from shared folder to implement the same logic in different mappings.
- Worked on unit testing and prepared unit test documents and uploaded in JIRA to review.
- Involved with testing team to resolve the issues while testing ETL applications.
- Resolved the testing issues and conducted meeting with testing team to understand the business requirements and how to test the applications based on business and technical prospective.
- Involved in moving the ETL jobs from development to test environment.
- Involved in the design, development and testing of the PL/SQL stored procedures, packages for the ETL processes.
- Involved in extensive performance tuning by determining bottlenecks using Debugger at various points like targets, sources, mappings, sessions level
- Participated inweeklystatus meetings, and conducting internal andexternal reviews as well as formal walk through among various teams and documenting the proceedings.
Environment: Informatica9.5.1, Oracle 11g, Unix, DT Studio, Informatica PowerExchange.
Confidential, Tampa, FL
ETL Consultant
Responsibilities:
- Involved to understand Business requirements with Business Analysts.
- Designed Function Specification Documentation as per previous generic Framework designs for all on boarding Contexts in RADAR Application Portal.
- Involved to understand Meta Data driven Framework design and Process Workflows.
- Involved in design and development of complex ETL mappings.
- Created context specific views on top of fact tables depending on Reporting Requirements.
- Validated files uploaded through Portal, loaded in to staging, dimension and fact tables.
- Coordinated with offshore team to develop the context specific applications.
- Involved to verify unit test case scenarios, performance issues, defect fixes in SIT and UAT environment
- Coordinated with support team to deploy the code in QA, UAT and Prod and fixes the issues during deployment phase.
Environment: Informatica9.5.1, Oracle 11g, DB2,UNIX, Autosys, Cognos, Qlickview
Confidential, Gardner, KS
Informatica Developer
Responsibilities:
- Design, Development and Documentation of the ETL (Extract, Transformation & Load) strategy to populate the Data Warehouse from the various source systems.
- Worked on Informatica 9.0.1 client tools like Source Analyzer, Warehouse Designer, Mapping Designer, Workflow Manager and Workflow Monitor.
- Involved in design and development of complex ETL mappings.
- Implemented partitioning and bulk loads for loading large volume of data.
- Worked on dimensional modeling containing three phases i.e., conceptual, physical and logical modeling.
- Developed Mapplets, Worklets and Reusable Transformations for reusability.
- Identified performance bottlenecks and Involved in performance tuning of sources, targets, mappings, transformations and sessions to optimize session performance.
- Identified bugs in existing mappings/workflows by analyzing the data flow and evaluating transformations.
- Monitored jobs in work flow monitor to resolve critical issues.
- Experienced in release management and deployment of code..
- Performance tuning by session partitions, dynamic cache memory, and index cache.
- Implemented update strategies, incremental loads, Data capture and Incremental Aggregation.
- Extensively worked on various Look up Caches like Static, Dynamic, Persistent, and Shared Caches.
- Developed workflow tasks like Email, Event wait, Event Raise, Timer, Command and Decision.
- Created Stored Procedures in PL/SQL.
- Used PMCMD command to start, stop and ping server from UNIX and created UNIX SHELL PERL scripts to automate the process.
- Created UNIX Shell scripts and called as pre session and post session commands.
- Developed Documentation for all the routines (Mappings, Sessions and Workflows).
- Analyzed application requirements and provided recommended design and studied the current system to understand the existing data structures.
- Participated actively in user meetings and collected requirements from users.
- Used Informatica Power Center for extraction, transformation and loading (ETL) of source data on heterogeneous Database sources like Oracle, SQL Server & flat files.
- Designed and developed a number of complex mappings using various transformations like Source Qualifier, Aggregator, Router, Joiner, Union, Expression, Lookup (Connected & unconnected), Filter, Update Strategy, Stored Procedure, Sequence Generator and used reusable transformations as well as mapplets.
- Worked with Workflow Manager for the creation of various tasks like Worklets, Sessions, Batches, Event Wait, E-mail notifications, Decision and to Schedule jobs.
- Extensively used the Slowly Changing Dimensions-Type II in various data mappings to load dimension tables in Data warehouse.
- Administered the repository by creating folders and logins for the group members and assigning necessary privileges using Informatica Repository Manager.
- Was responsible for the version control and up-gradation.
- Involved in the creation of partitions in Mapping to improve the performance of Informatica sessions.
- Involved in extensive performance tuning by determining bottlenecks using Debugger at various points like targets, sources, mappings, sessions or system. This led to better session performance.
- Wrote UNIX Shell Scripts and pmcmd command line utility for automating Batches and Sessions using ESP Workload manager.
- Involved in Production Scheduling to setup jobs in order and provided 24x7 production support.
- Involved in trouble shooting and resuming failed jobs.
- Developing Teradata Utility scripts like FastLoad, MultiLoad to load data from various source systems to Teradata.
- Creating BTEQ (Basic Teradata Query) scripts to generate Keys.
Environment: Informatica Power Center 9.0.1/Informatica Power Center 8.6.1, Putty, Oracle 10g/9i, SQL, Teradata, PL/SQL, Shell Scripts, Windows XP, Unix.
Confidential, Louisville, KY
ETL Informatica Developer
Responsibilities:
- Developed ETL programs using Informatica to implement the business requirements.
- Communicated with business customers to discuss the issues and requirements.
- Created shell scripts to fine tune the ETL flow of the Informatica workflows.
- Used Informatica file watch events to pole the FTP sites for the external mainframe files.
- Production Support has been done to resolve the ongoing issues and troubleshoot the problems.
- Performance tuning was done at the functional level and map level. Used relational SQL wherever possible to minimize the data transfer over the network.
- Effectively used Informatica parameter files for defining mapping variables, workflow variables, FTP connections and relational connections.
- Involved in enhancements and maintenance activities of the data warehouse including tuning, modifying of stored procedures for code enhancements.
- Effectively worked in Informatica version based environment and used deployment groups to migrate the objects.
- Used debugger in identifying bugs in existing mappings by analyzing data flow, evaluating transformations.
- Effectively worked on Onsite and Offshore work model.
- Pre and post session assignment variables were used to pass the variable values from one session to other.
- Designed workflows with many sessions with decision, assignment task, event wait, and event raise tasks, used informatica scheduler to schedule jobs.
- Reviewed and analyzed functional requirements, mapping documents, problem solving and trouble shooting.
- Performed unit testing at various levels of the ETL Applications.
Environment: Informatica 8.6.1, SQL Server 2008 R2, LINUX
Confidential, Chicago, IL
ETL TalenD developer
Responsibilities:
- Worked with Data Mapping Team to understand the source to target mapping rules.
- Analyzed the requirements and framed the business logic for the ETL process using talend.
- Involved in the ETL design and its documentation.
- Developed Jobs in Talend Enterprise edition from stage to source, intermediate, conversion and Target
- Worked on Talend ETL to load data from various sources to Oracle DB. Used tmap, treplicate, tfilterrow,tsort, tWaitforFile and various other features in Talend.
- Worked on Talend ETL and used features such as Context variables, Database components like tMSSQLInput, tOracleOutput, file components, ELT components etc
- Followed the organization defined Naming conventions for naming the Flat file structure, Talend Jobs and daily batches for executing the Talend Jobs.
- Worked on Context variables and defined contexts for database connections, file paths for easily migrating to different environments in a project.
- Implemented Error handling in Talend to validate the data Integrity and data completeness for the data from the Flat File
- Tuned sources, targets and jobs to improve the performance
- Used Talend components such as tmap, tFileExist, tFileCompare, tELTAggregate, tOracleInput, tOracleOutput etc.
- Participated in weekly end user meetings to discuss data quality, performance issues. Ways to improve data accuracy and new requirements, etc.
- Involved in migrating objects from DEV to QA and testing them and then promoting to Production.
- Followed the organization defined Naming conventions for naming the Flat file structure, Talend Jobs and daily batches for executing the Talend Jobs.
- Responsible for developing, support and maintenance for the ETL (Extract, Transform and Load) processes using Talend Integration Suite.
- Involved in automation of FTP process in Talend and FTPing the Files in Unix .
- Created Talend Development Standards.
- Extracted data from Oracle as one of the source databases.
- Optimized the performance of the mappings by various tests on sources, targets and transformations.
- Used customized Java code called routines with tJava, tJavaRow, tJavaFlex to enables to enter personalized Java code in order to integrate it in Talend program.
- Used Eclipse as IDE tool to develop the Java code.
- Understanding the Enterprise Java Beans, Servlets, JSP, JSF, JavaScript, JQuery, Oracle, HTML, and CSS toIntegrating the java Routines in Talend.
Environment: TalenD 5.1.1, Oracle11g,UNIX,Eclipse
Confidential, San Jose, CA
ETL Developer
Responsibilities:
- Used Informatica Power Center for (ETL) extraction, transformation and loading data from heterogeneous source systems into target database.
- Created mappings using Designer and extracted data from various sources, transformed data according to the requirement.
- Involved in extracting the data from the Flat Files and Relational databases into staging area.
- Mappings, Sessions, Workflows from Development to Test and then to UAT environment.
- Developed Informatica Mappings and Reusable Transformations to facilitate timely Loading of Data of a star schema.
- Developed the Informatica Mappings by usage of Aggregator, SQL overrides usage in Lookups, source filter usage in Source qualifiers, and data flow management into multiple targets using Router.
- Created Sessions and extracted data from various sources, transformed data according to the requirement and loading into data warehouse.
- Used various transformations like Filter, Expression, Sequence Generator, Update Strategy, Joiner, Router and Aggregator to create robust mappings in the Informatica Power Center Designer.
- Imported various heterogeneous files using Informatica Power Center 8.x Source Analyzer.
- Developed several reusable transformations and mapplets that were used in other mappings.
- Prepared Technical Design documents and Test cases.
- Involved in Unit Testing and Resolution of various Bottlenecks came across.
- Implemented various Performance Tuning techniques.
Environment: Informatica 8.1.1 Power Center, Oracle 9i, Windows NT,DB2.
Confidential, Newark, NJ
ETL Informatica Developer
Responsibilities:
- Involved in design, development and maintenance of database for Data warehouse project.
- Involved in Business Users Meetings to understand their requirements.
- Designed, Developed and Supported Extraction, Transformation and Load Process (ETL) for data migration with Informatica 7.X.
- Created complex mappings which involved Slowly Changing Dimensions, implementation of Business Logic and capturing the deleted records in the source systems.
- Worked extensively with the connected lookup Transformations using dynamic cache.
- Worked with complex mappings having an average of 15 transformations.
- Created and scheduled Sessions, Jobs based on demand, run on time and run only once.
- Monitored Workflows and Sessions using Workflow Monitor.
- Performed Unit testing, Integration testing and System testing of Informatica mappings.
- Coded PL/SQL scripts.
- Wrote UNIX scripts, perl scripts for the business needs.
- Coded Unix Scripts to capture data from different relational systems to flat files to use them as source file for ETL process.
- Created Universes and generated reports on using Star Schema.
Environment: Informatica PowerCenter 7.1.3, Oracle, UNIX
Confidential, Dearborn, MI
Cognos Developer
Responsibilities:
- Developed models in Framework Manager.
- Published packages and managed the distribution / setup of the environment.
- Used Query Studio for creating Ad-hoc Reports.
- Created complex and multi-page reports using Report Studio.
- Performed migration from Impromptu to Reportnet.
- Used Schedule Management in Cognos Connection.
- Performed Bursting Reports and Multilingual Reports using Report Studio.
- Developed Layout, Pages, Object Containers and Packages using Report Studio.
- Created reports using ReportNet with multiple Charts and Reports.
- Responsible for assigning user Sign-Ons for the new users.
- Provided guidance to report creators for enhancement opportunities.
- Created Multidimensional Cubes using PowerPlay and published on the UpFront Portal using PowerPlay Enterprise Server.
- Developed PowerPlay Cubes, used multiple queries, calculated measures, customized cube content and optimized cube creation time.
- Fine-tuned the Cubes and checked the database space issue and cube growth periodically.
- Responsible in the creation of new User Groups and User Classes using Access Manager.
Environment: CogonsBI (Frame work manager, Cognos Connection, Report Studio, Query Studio), SQL server 2005.