Sr. Etl/bi Developer Resume
North Chicago, IL
SUMMARY
- Over 9 years of experience in designing, developing and maintaining large business applications such as data migration, integration, data warehouse and Testing.
- 8 years of strong experience in data warehousing and application development using Informatica with extensive experience in designing the Mappings, Mapplets, Tasks, Workflows and scheduling the Workflows/Sessions using Informatica PowerCenter 9.5/9.1/8.6/8.1/7.2/7.1
- Professional understanding of Software Development Life Cycle (SDLC).
- Experience in designing Fact & Dimension Tables, Physical & Logical data models using ERWIN 4.0 and Erwin methodologies like Forward & Reverse Engineering.
- Experience in integration of various data sources like Teradata, Oracle, SQL Server, XML, Flat files and DB2.
- Experience with Informatica and Teradata utilities in Extraction, Transformation and Loading (ETL).
- Experience in Teradata with TPT, Fast Export, Fast Load, Multi Load, BTEQ.
- Experience in creating Informatica mappings for push down optimization in order to load Teradata tables.
- Experience in complex PL/SQL packages, functions, cursors, triggers, views, materialized views and T - SQL.
- Expert in troubleshooting and debugging at different stages like database, workflows, mappings.
- Experienced in performance tuning of large warehouse jobs (Database level fine tuning, Sql optimization, Workflow/session/mapping optimizations).
- Knowledge in Installation and configuration of Informatica server with oracle and able to handle the Informatica administrator tasks like Configuring DSN, creating Connection Strings, copying & moving mappings, workflows, creating folders etc,.
- Experience in Implementing Round Robin, Hash, Key Range and Pass through Partitioning at the Informatica level for the tables being loaded with huge amount of data.
- Experience with Type 1, Type2, Type3 Slowly Changing Dimensions.
- Experience in writing UNIX shell scripts.
- Experience in Defining, Scheduling and Monitoring informatica workflows using Autosys and Informatica Schedulers.
- Experience in design and development of Business Intelligence reports using Cognos Framework Manager and Cognos report studio.
- Experience in developing Discoverant Hierarchies using Accelrys Discoverant Manufacturing Analytics tool, to enable business users with access to manufacturing process and quality data.
- Experience includes thorough domain knowledge of Pharmaceutical, Retail, Utility and Telecom Industry.
- Enthusiastic and goal-oriented team player possessing excellent communication, interpersonal skills and leadership capabilities with high level of adaptability.
TECHNICAL SKILLS
Data warehousing: Informatica PowerCenter 9.5/9.1/8.6/8.5/8.1/7.1 , IBM Cognos 10.1.1, OLAP, OLTP, Star & Snowflake Schema, FACT & Dimension Tables, Physical & Logical Data Modeling, Erwin 4.0, Biovia Discoverant Manufacturing Analytics.
Databases: Oracle 11g/10g/9i, TeraData 14/13/12, SQL Server 2008/2005, My SQL, MS-Access, DB2 8.0/7.0
Languages: SQL, PL/SQL, T-SQL, UNIX Shell Scripting, Perl Scripting, HTML, XHTML, Java Scripting.
Operating System: HP-UX, Sun Solaris, LINUX, Windows XP.
Other Tools: Autosys, Control M, Remedy, Clear Case, Clear Quest, HP Quality Center.
DB Programming &Tools: RDBMS, Joins, Indexes, Views, Functions, Triggers, Procedures, SQL*Plus, SQL*Loader, Export/Import, BTEQ, Fast Load, Mload, TPT, Explain plan.
PROFESSIONAL EXPERIENCE
Confidential, North Chicago, IL
Sr. ETL/BI Developer
Responsibilities:
- Highly involved in end to end implementation of BI projects from creating the ETL to extract and load data from source systems to the integrated warehouse, Creating reporting layer database views and developing Discoverant hierarchies for user reporting purpose.
- Responsible for technical integrity within the application/subsystem.
- Involved in the ongoing delivery of migrating client mini-data warehouses or functional data marts from oracle environment to Teradata.
- Involved in creating staging Tables, Indexes, Sequences, Views and performance tuning to load into tables, analysing tables, proper indexing and dropping.
- Developed FastLoad, MultiLoad mapping utilities to load data from various data sources and legacy systems to Teradata.
- Developed Unix Shell Scripts for invoking the Informatica mappings and BTEQ Teradata procedures as part of the ETL Control and email notifications.
- Used Informatica Power Center (ETL) to load the data to Data warehouse Systems.
- Implemented Full/Source/Target push down optimization techniques in Informatica in order to extract and load high volume tables.
- Implement Teradata TPT API operators (load, update) in informatica to extract and load data to Teradata tables.
- Created parameter files for the workflows and mappings for various applications to use different environments like Development, Model Office (Testing) and Production.
- Interacted with business users to understand the manufacturing BI Analytic requirements.
- Developed Discoverant hierarchies to support users with manufacturing process analysis.
- Used Workflow Manager for Creating, Validating, Testing and running the workflows and Sessions and scheduling them to run at specified time.
- Implemented performance tuning with the Transformations, Sessions and on the Source Databases to load the data efficiently in to the target.
Environment: Informatica PowerCenter 9.5, Teradata 13/14, SuSe Linux, Oracle 11g/10g, SQL Assistant, Toad for Data analytics, SQL Developer 2.1/3.1, HP Quality Center, Autosys, Unix Shell Scripting, BTEQ, Fast Load, Mload, Oracle SQL, Cognos Framework manager 10.1.1, Cognos Report Studio, Accelrys Discoverant 4.1/4.3.
Confidential
Sr. Informatica Developer
Responsibilities:
- Work proactively with the business users to understand the functional requirements of the project and have a good understanding of the downstream LoopQual application.
- Develop Technical design document in accordance with Confidential standard documentation process.
- Develop complex ETL (Extract Transform and Load) code using Informatica PowerCenter tool to pull the data from MARTENS application and NDFOS database.
- Develop ETL mappings to extract data from fixed width flat files, DB2 and Oracle databases and load into Teradata database.
- Developed a standard ETL framework to enable the reusability of similar logic across the board using mapping variables, parameters and functions.
- Extensively use various Informatica Designer transformations like Source Qualifier, Filter, Joiner, Lookup, Router, Aggregator, Transaction control, Union, and Expression to develop ETL Code.
- Modify/Enhance the existing code based on the change in functional requirements.
- Create relational connections in the workflow manager and provide access to the users.
- Create ODBC connections to import relational structures from the Oracle database to Informatica mapping designer.
- Write SQL Queries against Oracle and Teradata Database to unit test the ETL code and validate data against the Source systems.
- Performances tune the code both at informatica and database level to in order to load high volumes of data within the specified load window.
- Write Unix shell scripts to run Informatica PMCMD commands, Automate the ETL process.
- Create autosys jobs to schedule and monitor informatica workflows and shell scripts.
- Write shell scripts to validate the source files and consolidate files received from MARTENS application belonging to multiple regions into a single file.
- Work extensively on Informatica Workflow Manager and Workflow monitor tool to Execute and monitor the ETL Code.
- Coordinate with the testing team for defect resolution in System and QA test phases of the project and access HP Quality Center tool to access, resolve and update the defects raised by testing team.
- Schedule Automatedworkflowswithin informatica and provide pro-active support after go live.
Environment: Informatica PowerCenter 8.6/9.1 (Mapping Designer, Workflow Manager, Workflow Monitor), UNIX SunOS, Teradata 13, Oracle 10g, SQL Developer 2.1/3.1, HP Quality Center, Autosys, Unix Shell Scripting, Oracle SQL.
Confidential
Informatica PL/SQL Developer
Responsibilities:
- Participated in the development and documentation of all ETL related activities, environmental specifications, ETL strategy, recommendations on tool selection, and code migration.
- Gathering, understanding and documenting the requirements and Data needs of downstream applications.
- Documentingthedetailed functional and technical designdocuments for the downstream applications.
- Design andDevelopETL scripts in Informatica PowerCenter and Oracle pl/sql store procedures for the data flow between ContractSphere data hub and the downstream applications.
- Extracted data from Flat files and Oracle and loaded them into Teradata.
- Transformed bulk amount of data from various sources to Teradata database by using BTEQ scripts.
- Transferred data using Teradata utilities like SQL Assistant, Fast Export and Fast Load.
- Designed, developed and architected the ETL process using Informatica PowerCenter 9.1, Oracle SQL and shell scripting.
- Involved extensively in creating Informatica Mappings.
- Involved in development and maintenance of Informatica mappings, workflows and tasks, Created reusable objects.
- Developed control files for SQL * Loader and PL/SQL scripts and BTEQ scripts for Data Extraction, Transformation, Loading and Mapping, loading data into interface tables from source system and validating the data.
- Involved in Performance Tuning of the mappings, sessions and determining the performance bottlenecks.
- Did Unit Testing and data validation.
- Created Migration and deployment instructions documents to deploy the code from one environment to another as part of release management.
- Documented the Test plan, test cases and test scripts for the downstream interfaces.
- Execute the test scripts in System test and UAT and document the test results for business approval.
- Documenting and uploading the test cases and test results in HP Quality Center.
- Tracking, solving and reporting the defects, escalating to appropriate teams using HP Quality Center.
- Coordinate with the change management team on moving and deploying the code from one environment to other and document the deployment instructions in detail.
- Schedule Automatedworkflowfor each interface and provide pro-active support after go live.
Environment: Informatica PowerCenter 9.1/8.6, Oracle 10g/11g, Teradata 12/13, Unix Shell Scripting, SQL, SQL Assistant, Fast Export, Fast load, Toad, SQL loader, SQL Plus, DB Export/Import, Windows XP, HP Quality Center 10.00.
Confidential
Sr. ETL Informatica Developer
Responsibilities:
- Interacted with Business Users to gather the Requirements and business logics for the new interfaces.
- Followed the SDLC process for adding new interfaces to the existing data warehouse.
- Analyzed source systems (Oracle, XML, Teradata and flat files) from third party vendor, these were the source to the Informatica interfaces used to load data to the target systems.
- Defined to implementing the required business transformation rules and logic for ETL design and development using Informatica Power Center as ETL tool.
- Implemented business rules for ETL using combination of transformations in Informatica mappings, UNIX shell scripting, BTEQ and Oracle SQL PL/SQL Stored Procedure components for data conversion.
- Used BTEQ scripts to submit SQL queries to Teradata DB.
- Used Teradata Utilities like Fast Load, Multi Load to load the Teradata tables.
- Created reusable transformations and Mapplets to import in the common mappings to avoid complexity in the mappings using Informatica designer.
- Responsible for coordinating with the offshore and doing the regression and End to End testing.
- Responsible for Enhancing the code developed and there by addressing the performance Issues.
- Implemented the Round Robin, Hash, Key Range and Pass through Partitioning at the Informatica level for the tables being loaded with huge amount of data into oracle tables.
- Responsible for creating the migration documents to migrate the code from one environment to other.
- Written the technical specifications document and data mapping document.
- Created a design document for data flow process from different source systems to target system.
- Implemented the process for assessing and reviewing interface and data integration design and source code as well as for validating interface results.
- Developed UNIX shell scripts for validating the source files, creating list files, wrapper scripts for Oracle SQL, PLSQL.
- Interfaces are built and automated with Informatica ETL tool and shell scripting.
- Created and Documented ETL Test Plans, Test Cases, Test Scripts, Expected Results, Assumptions and Validations.
- Scheduled the Workflows and monitored them. Provided Pro-Active Production Support after go-live.
Environment: Informatica Power Center 8.6.1/8.1, UNIX Sun Solaris, Windows XP, Teradata 12, Fast Load, Multi Load, BTEQ, Oracle 10g/11g, TOAD, Control M, Erwin, Shell Scripting, Informatica Versioning, Business Objects, Clear Case, Clear Quest.
Confidential
ETL Developer
Responsibilities:
- Used Informatica Workflow Manager to create, schedule, execute and monitor sessions, worklets and workflows.
- Created new mappings according to business rules to extract data from different sources, transform and load target databases.
- Debugged the failed mappings and fixed them.
- Conducted Database testing to check Constrains, field size, Indexes, Stored Procedures, etc.
- Defects were tracked, reviewed and analyzed.
- Modified the mappings according to the new changes and implemented the persistent cache in several mappings for better performance.
- Implemented various Performance Tuning techniques on Sources, Targets, Mappings, and Workflows.
- Involved in writing stored procedures and shell scripts for automating the execution of jobs in pre and post sessions to modify parameter files, prepare data sources.
- Identified the issues in sources, targets, mappings and sessions and tuned them to improve performance.
- Created and used reusable mapplets and worklets to reduce the redundancy.
- Developed robust Informatica mappings and fine-tuned them to process lot of input records.
Environment: Informatica PowerCenter 7.1, Oracle9i, Toad, SQL, PL/SQL, Solaris, Ms-Access