Snr. Etl Developer Resume
Chicago, IL
PROFESSIONAL SUMMARY:
- Over 7+ years of experience in data warehouse Development, Testing, Deployment, Maintenance and Production Support of Data Warehousing Business Intelligence ETL.
- Proficient in using Informatica Power Center (9.6x/9.5/8.6) for developing the Data warehouse loads with work experience focused in Data Integration as per client requirement.
- Highly proficient in integrating data with multiple Databases involving Teradata, Oracle, My SQL, SQL Server, DB2, Mainframe and Flat Files like Delimited, Fixed width.
- Strong in database programming using PL/SQL and SQL with creation of packages, stored procedures, functions, triggers, materialized views, cursors and performance tuning of SQL.
- Experience in Data Analysis, Data Validation, Data Cleansing, Data Verification and identifying data mismatch. Experienced in writing test cases, test scripts, test plans and execution of test cases reporting and documenting the test results.
- Experience in UNIX environment, file transfers and job scheduling.
- Installing and Configuring of Informatica MDM Hub Console, Hub Store, Cleanse and Match Server, Address Doctor, Informatica Power Center applications.
- Extensively worked on integrating various data sources - Oracle, SQL Server, DB2, Teradata, Netezza, Sybase, XML files and Flat files.
- Experience in Dimensional Modeling (Erwin), Star / Snowflake Schema, Fact / Dimension Tables, Business Process Analysis, Production support, Data cleansing, Data analysis and Performance tuning of sources, targets, mappings sessions and SQL’s.
- Strong in scheduling ETL load using utilities like Control M, Tivoli, Austosys.
- Developed complex Mappings in Informatica using various Transformations like Source Qualifier, Joiner, Aggregator, Update Strategy, Rank, Router, Java, Lookup - Connected & Unconnected, Sequence Generator, Filter, Sorter, Stored Procedure transformation etc.
- Proficiency in data warehousing techniques for SLOWLY CHANGING DIMENSIONS phenomenon, surrogate key assignment, Normalization & De-normalization, Cleansing, Performance Optimization along with the CDC (Change Data Capture).
- Experienced in working both Waterfall & Agile Methodologies.
- Good experience in performing and supporting Unit testing, System Integration testing(SIT), UAT.
- Experience working with offshore and onsite co-ordination.
- Able to work independently and collaborate proactively & cross functionally within a team.
- Good team player with ability to solve problems, organize, prioritize multiple tasks, with excellent analytical, communication and presentation skills.
TECHNICAL SKILLS:
Operating System: UNIX, IBM AIX 4.3/4.2, Windows7/NT/2000/XP
Database and utilities: Oracle 9i/10g/11g, MS SQL Server, Teradata V2R6, 12.0, 13.0 Teradata SQL Assistant, BTEQ, Sybase, Erwin 3.5/4.0, IBM DB2, Business Objects.
Informatica Tools: Informatica Power Center 9.6/9.5/8.6/8.1/7.1, Informatica B2BDT, Power exchange, Informatica Data Analyzer.
Database Tools: SQL developer, TOAD
Programming Languages: SQL, PL/SQL, TSQL, Unix Shell Scripting, XML, C, C++, C#, Cobol, Java Script, NZSQLOther Tools: WLM, Autosys, Control-M, Crystal Reports, OBIEE, Tableau, Rational Clear Case, Rational Clear Quest, Tivoli.
PROFESSIONAL EXPERIENCE:
Confidential, Chicago, IL
Snr. ETL developer
Responsibilities:
- Experience in Extraction, Transformation and Loading of data from different heterogeneous source systems like Oracle 10g/11g, Teradata, DB2, Flat files, CSV files and Microsoft SQL Server into Oracle target Data Warehouse.
- Created UNIX Shell Scripts for retrieving files from FTP server, achieving the source files, Concatenating files and finally to deliver them to remote shared drive
- Preparing Low Level Requirements documents as well as High level/detailed level design documents for Data warehouse modelling and ETL processes.
- Created STM mapping as per the requirements of the Technical specification documents.
- Estimates and planning of development work using Agile Software Development.
- Created complex mappings that involved implementation of Business Logic to load data in to staging area.
- Extensively worked on Informatica Power Center Transformations such as Source Qualifier, Lookup, Filter, Expression, Router, Normalizer, Joiner, Update Strategy, Rank, Aggregator, Stored Procedure, Sorter, Sequence Generator and XML Source Qualifier.
- Extracted data from Facets data model in Oracle using PLSQL and SQL Server then used Teradata for data warehousing.
- Wrote UNIX shell Scripts & PMCMD commands for invoke workflows and FTP of files from remote server and backup of repository and folder.
- Performed unit testing for the Informatica mappings and UNIX scripts developed, Created and executed unit test plans based on system and validation requirements and Assisted Testing team in creating test plan and test cases.
- Optimizing Performance Tuning at source, target, mapping and session level
- Participated in weekly status meetings and conducting internal and external reviews as well as formal walk through among various teams and documenting the proceedings.
Environment: InformaticaPowerCenter9.6/9.5, Oracle12c/11g, IBM DB2, Teradata SQL, IBM DtataStudio, SQL Developer,SQL, Erwin, PL/SQL (Stored Procedures, Triggers, Packages), UNIX shell Scripting, Linux, Windows 10
Confidential, Pittsburg, KS
Informatica Developer
Responsibilities:
- Involved in database development by creating Oracle PL/SQL Functions, Stored Procedures, Triggers, and Packages
- Working on multiple projects using Informatica as ETL tool to extract data from IBM DB2, Oracle11and flat file systems performed massive data cleansing applied all the business rules and loaded into Target system.
- Worked with Business Users and Business Analyst for requirement gathering and business analysis.
- Extensively worked with Data Analyst and Data Modeler to design and to understand the structures of the Fact and Dimension tables and Source to Target Mapping.
- Used IDQ analyst tool to correct the bad table records, reprocessed the records in Analyst.
- Created custom reports using various tools including Crystal Reports.
- Extracted, Transformed and Loaded data into Oracle database using Informatica mappings and complex transformations (Aggregator, Joiner, Lookup, Update Strategy, Source Qualifier, Filter, Router and Expression).
- Implemented Slowly Changing Dimensions Type-1, Type-2 and Type-3 approach for loading the target tables.
- Tuned Performance of Informatica session for large data files by increasing block size, data cache size, sequence buffer length and target-based commit interval.
- Prepared release notes to build DEV, SIT, UAT, PERF and PROD environments and handed them over to Integration and UNIX teams.
- Enhanced the code as per requirement changes and resolved the Production issues.
- Used Unix Command and Unix Shell Scripting to interact with the server and to move flat files and to load the files in the server. Used PMCMD commands in pre and post session to populate the parameter files and to execute the tasks.
- Designed and developed UNIX shell scripts as part of the ETL process to automate the data load processes to target.
Environment: Informatica Power Center 9.6, IDQ 9.6, Informatica Analyst Tool, Oracle Data Integrator, Flat file, TOAD, UNIX scripting, Windows XP Professional, Hyperion, Microsoft DTS packages
Confidential, Chicago, IL
Sr.Informatica Developer
Responsibilities:
- Involved in gathering and reviewing business requirements. Involved in designing the specifications, Design Documents, Data modeling and design of data warehouse.
- Analyzing the technical documentation and concluding the design of the ETL loads.
- Extracting the data from the Relational Databases, Flat files using ETL process.
- Interacted with the Business Users & Enterprise Data Architects in the analysis & design of conceptual and logical data model that is required for solid MDM implementation & ensuring that it meets the business requirements and supports the products capabilities.
- Responsible for definition, development and testing of processes/programs necessary to extract data from operational databases, Transform and cleanse data, and Load it into data warehouse using Informatica Power center.
- Worked extensively on different types of Transformations like source qualifier, expression, filter, aggregator, rank, update strategy, lookup, stored procedure, and sequence generator, joiner Transformation.
- Worked on Performance tuning of the ETL processes. Optimized/tuned queries in source qualifier, Lookup transformations in mappings for better performance and efficiency.
- Used Informatica Repository Manager to backup and migrate Repository in development, test and production systems.
- Administered & scheduled batches/sessions using server manager. Modify/Migrate the Informatica mappings (XML) from the Development to Test Server and Production server.
- Created sessions, database connections and batches, Scheduled and monitored transformation processes using Informatica Server Manager.
- Worked on all phases of data warehouse development life-cycle, ETL design and implementation, and support of new and existing applications.
- Resolving performance issues by understanding the Bottles necks at various levels and tuning them for better performance.
- Creating project plans, design and development Building a data model according to business needs by interacting with data architect.
- Setting up sessions to schedule the loads at required frequency using Power Center, Workflow manager, PMCMD and using scheduling tools.
Environment: Informatica MDM 9.5.0, Informatica MDM Data Director 9.1.0, Informatica Data Quality (IDQ) 9.5.0, Informatica Power Center 9.1.0, AQT 9.0, Erwin, JBoss, HP Quality Center 9.2, Windows.
Confidential, Atlanta, GA
Informatica Developer
Responsibilities:
- Used update strategy to effectively migrate data from source to target.
- Designed ETL Process using Informatica to load data from Oracle, Flat Files to target Oracle Data Warehouse.
- Interacted with the business community and database administrators to identify the Business requirements and data realties.
- Created various Transformations as per the business logic like Source Qualifier, Normalizer, Lookup, Stored Procedure, Sequence Generator, Router, Filter, Aggregator, Joiner, Expression and Update Strategy.
- Wrote stored procedures, functions, Packages and used in many Forms and Reports.
- Wrote database triggers for automatic updating the tables and views.
- Involved in designing of Testing plan (Unit Testing and System Testing).
- Performance tuning was done at the functional level and map level. Used relational SQL wherever possible to minimize the data transfer over the network.
- Tested scripts by running workflows and assisted in debugging the failed sessions.
- Improving Workflow performance by shifting filters as close as possible to the source and selecting tables with fewer rows as the master during joins.
- Used persistent caches whenever data from workflows were to be retained.
- Used Connected and Unconnected lookups whenever appropriate, along with the use of appropriate caches.
- Perform Maintenance, including managing Space, Remove Bad Files, Remove Cache Files and monitoring services.
- Set up Permissions for Groups and Users in all Development Environments.
- Involved in the team meetings and providing status report to project manager.
Environment: Informatica Power Center 8.6.1/9.0.1, Oracle 10g, Flat Files, OBIEE, PL/SQL, UNIX, Autosys, ERWIN, TOAD, UNIX Shell Scripting.
Confidential
Informatica/ SQL Developer
Responsibilities:
- Extensive user interface to gather requirements and perform business analysis.
- Extensively worked with Transformations like Aggregate, Joiner, Lookup, Rank, Sorter, Sequence generator, Union, Filter, Router, Update Strategy.
- Analyzed business requirements and worked closely with the various application teams and business teams to develop ETL procedures that are consistent across all applications and systems.
- Participated in converting requirements to detailed design.
- Profiled source systems to identify Data gaps and Data quality.
- Created technical specifications for all mappings and interfaces.
- Unit Testing of mapping/sessions and batches.
- Analyzed the source systems to create a road map for the ETL process.
- Designed and developed the Informatica Mappings for source system data extraction; data staging, transformation, validation, and error handling.
- Designed testing procedures and test plans for mappings, workflows, and interfaces.
- Developed schedule processing scripts using Autosys scheduler.
- Managed Change control implementation and coordinating daily, monthly releases and reruns.
- Performance Tuning of the process at the mapping level, session level, source level, and the target level.
- Extensively used Mapplets for use in mappings thereby saving valuable design time and effort.
- Extensively worked with various Look up Caches like Static, Dynamic, Persistent, and Shared Caches.
- Involved in Scheduling the Informatica sessions using the workflow manager to automate the loading process, import and export data from Production to development box for testing.
- Worked extensively with the business Intelligence Team to in corporate any changes that they need in the delivered files
Environment: Informatica Power Center 8.6/9.0.1/, Business Objects, UNIX, SQL, PL/SQL, TOAD v11.6/ v12.0, Oracle 10g.
Confidential
Jr. ETL Informatica/ Database Developer
Responsibilities:
- Creating the Mappings and involved in Extraction, Transformations and Loading.
- Worked on Informatica Source Analyzer, Mapping Designer and used various Transformations such as the Source Qualifier, Aggregators, Lookup, Update strategy, Router, Filters & Sequence Generator, and Joiner.
- Creating and testing sessions.
- Extracted data from various heterogeneous sources like Oracle, SQL Server, DB2 and Flat Files.
- Provided solution the Data Quality and Data Cleansing tracks for the MDM project.
- Extensive Use of SQL Overrides and substituted them in place of multiple transformations.
- Involved in doing error handling, debugging and troubleshooting Sessions using the Session logs, Debugger and Workflow Monitor.
- Worked on identifying Mapping Bottlenecks and improved session performance through error handling.
- Worked on Mapplets and created parameter files wherever necessary to facilitate reusability.
- Created Unix Shell Scripts to automate sessions and cleansing the source data.
- Used transformations for data joins, complex aggregations.
- Responsible for Improving Query and session performance.
- Created complex mappings using Lookup, Aggregator and Router transformations for populating target table in efficient manner
- Worked extensively on transformations like Filter, Router, Aggregator, Lookup, Update Strategy, Sequence generator and joiner transformations.
- Created launched & scheduled sessions and batches using Server manager.
- Define mappings slowly changing dimensions (SCD Type), and slowly growing Targets.
Environment: Informatica Power Center 8.6.1, Oracle 9i, PL/SQL, DB2, Win NT, UNIX, Flat Files, SQL loader, MDM, Unix shell Scripting, Putty and WinSCP.