Etl/informatica Design/developer Resume
Minneapolis, MN
SUMMARY
- Over seven years of IT experience in design, development, testing and maintenance of data warehouse and operational data systems for commercial banking, investment banking and insurance clients.
- Seven years of experience wif Informatica Power Center 7.x/ 8.x/9.x and various tools used to design, develop and maintain ETL/Data Movement/Data Migration/Data Synchronization Application in varied environments.
- Used Informatica Power Center 9.x/8.x/7.x to create and edit Transformations, Mappings, Tasks, Sessions and Workflows to extract data from various types of sources, transform according to predefined logic, and Load into Target database in required formats.
- Worked wif different systems as source and target, including Oracle 10/11g, DB2, Postgre SQL, SQL Server 2000/2005/2008 , flat file, XML, SalesForce.com, and Mainframe.
- Worked on several types of data, including characters, number, CLOB, BLOB, date/time and spatial and different transformation logics, including various string functions, aggregation, lookup, join, filter and logic test, etc.
- Used Parameter (file) and variables on different levels for input, output, calculation, connection and settings.
- Used the Batch file and Shell Script to run the Workflow by Pm cmd Utility and scheduled the ETL jobs using tools, such as Informatica Scheduler, Control - M and CA Workload Automation
- Debug by using different data tracing levels, designed the error handling logic and composed the Unit Test and Integration Test documents.
- Performance tuning in levels across mapping to database or by techniques such as Partitioning, Pushdown Optimization or by integrated approach such as data staging and ETL batch control.
- Solid SQL development skills for Oracle 10/11g, DB2, Postgre SQL, SQL Server 2000/2005/2008 and Salesforce.com, including DDL, DML, Indexing, Data Auditing, Triggers and Stored Procedures, by using tools, such as SQL Server Management Studio, TOAD, SQL Developer and Spring Source Tool.
- Experienced wif Unix/Linux operations and programing for file manipulation and Bash Shell and Kernel Shell scripting, by using Putty and Win SCP.
- Proficient in Logical and Physical Date Modeling for Data Store, Data Mart and Data Warehouse (Star Schema, Snow Flake Schema, FACT & Dimension Tables), CDC and SCD’s Type1, Type2 and Type3 updating.
TECHNICAL SKILLS
Languages: SQL, PL/SQL, T-SQL, Kernel/Bash Shell Scripting
ETL Tool: Informatica Power Center 9.x/8.x/7.x
Database: Oracle 11g/10g/9i/8i, SQL Server 2000/2005/2008 , DB2, Postgre SQL, Salesforce.com
Operating Systems: Windows 7/2003/2000/NT/XP/98/95, UNIX/linux
Data Modeling: Erwin, Oracle Data Modeler, ERstudio
Other Tools: TOAD, SQL *Plus, PL/SQL Developer, SQL Developer, Spring Source Tool, Putty, WinSCP, SQL Server Management Studio
PROFESSIONAL EXPERIENCE
ETL/Informatica Design/Developer
Confidential, Minneapolis, MN
Responsibilities:
- Analyzed system architecture, studied wif project work flow, and set up all the tools and access.
- Reviewed code and researched ETL process.
- Developed performance assessment of data synchronization using T-SQL and SQL Server Management Studio.
- Used Windows Batch Scripting to run SQL Script by Osql Utility to generate assessment reports and send via email.
- Used CA Workload Automation to schedule Job running daily.
- Using Store Procedures to do the Changed Data Capture and ETL batch control.
- Load attachment file to Salesforce.com using Apex data loader.
- Used Normalizer Transformation to generate parameter file.
- Took the responsibility of production support.
Environment: Informatica Power Center 9.0.1, SQL server 2008, Salesforce.com, XML, CA Workload Automation, Lotus Notes, Windows XP professional, Oracle 10g, PL/SQL Developer 6.0.
ETL/Informatica Design/Developer
Confidential, Bloomington, IL
Responsibilities:
- Analyzed system architecture, studied wif project work flow, and set up all the tools and accesses.
- Implemented the Unite Test and Integration Test, and tan wrote the test documents.
- Worked wif business analysts and DBA to understand requirements of data movement, including the business rule, technical rule, volume and frequency.
- Used Spring Source Tool to query the source database (DB2) and target database (PostgreSQL).
- Used Microsoft Word and Visio to write the data Pop/Sync (population and synchronization) Low Level Design and High Level Design Documents.
- Adopted EDBLoader for data bulk load in huge volume data population and Full Comparison logic of Informatica mapping for synchronization.
- Used PostGIS to deal wif spatial data for PostgreSQL database.
- Developed Informatica mappings for Salesforce data integration wif logic, such as lookup, load validation and reprocess.
- Worked wif BMC Middleware Management and XML Parse Transformation of Informatica to mock-up and extract data from the Queues and Messages.
- Implemented the business rules by using Expression, Lookup, Joiner, Aggregator, Filter and Update strategy Transformations.
- Loaded and queried data in Salesforce.com and captured the successful and error files of data loading.
- Recorded the error records generated due to the load failure and loaded into the an Exception Table (DB2) to prepare for reprocess.
- Parameterized all the inputs, outputs, directories and connection string by using parameter file and table across the project to mapping levels.
- Composed the Shell Script to run the Workflow by Pmcmd Utility and scheduling the the jobs using Control-M
- Manipulated files in Linux using Putty and WinSCP.
- Had the Knowledge Transfer session wif off-shore team and review meeting of design and code wif clients.
Environment: Informatica Power Center 9.1.0, DB2, PostgreSQL, Salesforce.com, XML, Kernel Shell Script, Control-M, Lotus Notes, Windows 7 professional, Linux, Putty, WinSCP, Spring Source Tool, BMC Middleware Management.
Informatica Developer
Confidential, NY
Responsibilities:
- Worked wif business analysts and used methods, such as Information Package and Joint Application Development (JAD), to communicate wif employees in AIG’ financial and IT departments, and do the requirement gathering, analysis and documentation.
- Researched on existing system, documents and industry research materials and make advises to supplement and optimized the requirement document.
- Worked wif data analysts and DBA to design the data model of Data warehouse and Operation Data Store (Stars Schemas and Snow Flake Schema), using ERwin, Oracle Data modeler and Target Designer of Power Designer.
- Analyzed the sources including Oracle, SAP R/3 and Flat file, and used Power Center and Power Exchange to create the source definitions.
- Create mappings to load into the dimension tables, facts tables and aggregated fact tables from staging area by using Transformations including Source Qualifier, Lookup, Filter, Aggregator, Sorted Procedure, Expressions, etc.
- Used PL/SQL Store Procedure to populate the date dimensions.
- Created and Executed workflows and Worklets using Workflow Manager to load the data into the Target Database in project wide standards by using different tasks including Session, Command, Decision, Event Wait, Email and Assignment.
- Use Command Task and Shell Script to communicate the Integration Service in Unix server.
- Used tools and methods, such as Session log and Debugger to validate the workflow and mappings, identify bottle-necks, and troubleshoot information about data and error conditions.
- Involved in performance tuning of the ETL process by addressing various performance issues on the source side and Informatica side, such as using sorted data and Pipeline Partitioning.
- Extensively worked on Mapping Variables, Mapping Parameters, Workflow Variables and Session Parameters and parameterization.
- Designed and implemented the Incremental loads, including SCD type-1, 2 and 3, by create mappings wif Lookup, Expression and Update Strategy transformations, etc.
- Implemented the Unite Test and Integration Test, and tan wrote the test documents.
Environment: Informatica Power Center 9.1.0, Power Exchange, Oracle 11g/10g, SAP R/3, SQL Developer, PL/SQL, Bash Shell Script, Windows 7 professional, Unix/Linux
Informatica Developer
Confidential, NY
Responsibilities:
- Worked wif DBA, data analysts to study on the legacy data and new third party data feed, and compose reports on the ETL strategic plan.
- Worked wif Informatica Power Center Data Profile Option to analyze the data structure in source systems.
- Extensively work on Flat file (Delimited, and Fixed width) and MS-Excel as sources
- Using Erwin to design and reorganize both the Logical and Physical data model.
- Use SQL*loader to execute SQL script and to the data bulk load.
- Use various functions in Expression Transformation and Aggregate transformation to do the implement Data Cleaning and Aggregation
- Designed and Used Mapplet based on the client’s own rule to standardizing data format.
- Worked wif data type such as CLOB, BLOB to migrate passages and graphic data.
- Worked wif Web service as sources and used XML Parse Transformation to load data into Flat file or Relational DB.
- Created Mappings for Full load and also for the Incremental Load of the data.
- Mostly utilized the SQL override and Lookup SQL override for filtering the data according to the requirement.
- Used IDE for data analysis, Data Migration and understanding the different patterns of the data.
- Unit testing and Stress testing was done on each mapping separately for performance tuning and verifying the data.
- Used Informatica Pushdown Optimization to push the transformation logic and SQL query down to database to enhance the performance.
- Worked on development and testing environment and tan migrated my workflows to the production environment.
- Involved in peer review, formal review and Quality Control review sessions.
- Provided test queries for the QA team for the validation of the data.
- Designed restart recovery logic and also defined point of Commit Activities for highly volume loads.
Environment: Informatica Power Center 8.5/Oracle 10g, Windows XP professional, SQL, PL/SQL, and SQL Developer, TOAD, XML
ETL Developer
Confidential, Cleveland, OH
Responsibilities:
- Involved in extraction of Data from source systems (Oracle), transformation in the stage database and finally into new data stores.
- Worked wif the Joiner, Router and Update Strategy Transformation to implement data synchronization.
- Used functions in Expression transformation to implement Changed Date Capture Logic.
- Used unconnected and Connected Look Up transformations to retrieve information based on key values.
- Use source filter to fetch data from Teradata Database as predefined rules.
- Performed error handling of sessions by using terse, normal, verbose initialization and verbose data tracing levels. Performed error handing using session logs.
- Manipulated files in UNIX using Putty
- Migrated to the test environment and production environments.
- Used Microsoft Project Professional 2007 to organize the tasks, receive instructions and reporting.
Environment: Informatica Power Center 8.1.1, Oracle 10g, Teradata Database 12, SQL *Loader and TOAD, PL/SQL, SQL Developer, UNIX (server), PUTTY.
Informatica Developer
Confidential, Oakland, CA
Responsibilities:
- Analyzing the source data coming from various databases and files and working wif business users and developers to develop the data Model.
- Worked wif Data modeler in developing STAR Schemas and Snowflake schemas.
- Extracting data from Oracle and Flat file, Excel files sources and performed joiner, Expression, Aggregate, Lookup, Stored procedure, Filter, Router transformations and Update strategy transformations to transform and load data into the target systems.
- Created reusable Mailing alerts, events, Tasks, Sessions, reusable worklets and workflows in Workflow manager.
- Scheduled the workflows at specified frequency according to the business requirements and monitored the workflows using Informatica Scheduler and Workflow Monitor.
- Fixing invalid Mappings, Debugging the mappings in Designer and did Unit and Integration Testing of Informatica Sessions, Worklets, and Workflows.
- Used SQL Developer for source and target database activities.
Environment: Informatica Power Center 7.1, SQL Developer, Oracle 9i, SQL, Linux, and Windows NT.
SQL Developer/DBA
Confidential
Responsibilities:
- Scheduling meetings wif the users to gather the business analysis reporting requirements.
- Used Oracle Data Modeler to do the physical data modeling
- Wrote DDL to create tables, indexes and constraints.
- Wrote SQL for applications.
- Did the data auditing and performance tuning
- Set of FTP process for file transfer.
- Mocked up data and testing
Environment: Oracle 9i, Windows NT/2000, SQL developer, Oracle Data Modeler