Etl Sr. Consultant / Architect Resume
Atlanta, GA
SUMMARY:
- Over 19+ years of professional experience in Software Development Life Cycle (SDLC), Data warehousing and the implementation of various Business applications. Over 12+ years of Informatica ETL Development. Have a wide variety of experiences in various capacities across different industries such as Telecom, Sales, Hire Purchase, Manufacturing, Finance, Ship Board Management, Airline, Credit Cards and sensitive data Industry.
- Extensive working knowledge in Data warehouse ETL activities using Informatica 10.1/9.*/ 8.6/8.5/8.1/7.1 /6.2.
- Working knowledge of Informatica Data Quality (IDQ) and Informatica Data Explorer (IDE)
- Working knowledge of Hadoop.
- Working knowledge of Informatica Administration like installation, troubleshooting, maintaining user/group privileges and migrating objects from Dev to QA and QA to Production using Repository Manager export/import.
- Working knowledge of Informatica Master Data Management (MDM)
- Working knowledge of Salesforce.
- Proficient in Oracle 11g/ 10g / 9i / 8i / 7.x / 6.x, OLAP/OLTP, Data Mart, Data warehousing, SQL Server, MySQL, Teradata 14, Teradata SQL Assistant 12.0, Netezza, Vertica and Oracle Data Base Administration.
- Proficient in Data warehouse ETL activities using SQL, PL/SQL, PRO*C, SQL*LOADER, C, Data structures using C, Unix scripting, Python scripting and Perl scripting.
- Proficient with Star schema and Snowflake schema Data warehouse models using Confidential / W. H. Inmon methodologies.
- Working knowledge in Oracle Backup and recovery, imports and exports, performance - tuning, creation of Oracle objects, analyzing objects and monitoring and estimating the table space for oracle tables and indexes.
- 2+ years of Experience on Oracle Warehouse Builder 10g R2.
- 2.5+ years of experience in DataStage 8.
- 7+ years of experience in data modeling using ERwin.
- My work authorization is US citizen.
TECHNICAL SKILLS:
Hardware: SUN Sparc Ultra-enterprise Server, HP9000 Series UNIX server, SGI3200 UNIX server and IBM RISC 6000 Iris server.
Database: Oracle 11g/10g/9i/8i/7.x/6.0/5.0, Hadoop, Teradata 13/14, Netezza 7, Vertica 7.1, MS-Access, SQL Server
Data warehouse and WEB Development Tools: Informatica PowerCenter 10.1/9.6/8.1/7.1/6.2 , Python, JAVA, PERL, HTML, Servlets and JSP.
Client Server Development Tool, Programming Languages and Designing tools: UNIX, Sun Solaris-OS, AIX, Windows vista/ Windows XP/ Windows 98/ Windows95, MS-Windows/MS-DOS Developer 2000 (ORACLE FORMS 4.5 & ORACLE REPORTS 2.5), SQL*Plus, PL/SQL, SQL*FORMS 3.0, Pro*C, SQL Loader and Oracle database Triggers and packages, C, Pascal, Data structures and algorithms using C, Unix Shell scripts, Python scripts, Linux scripts, Perl scripts, XML, RML, SQL Navigator, Microsoft Query, TOAD & Oracle Procedure Builder, Git, Visual Source Safe (VSS), PVCS (Polytron Version Control System) and DTS (Defect Tracking System), ERwin, Microsoft Visio
WORK EXPERIENCE:
Confidential, Atlanta, GA
Environment: Informatica PowerCenter 10.1/9.6, IDQ, ERwin, Hadoop, MDM, Oracle 11g/ MySQL, Vertica, TeraData, Linux, Erwin, Tableau, ODI 11.*, DataStage 8, Salesforce, RML, XML, Git, Lua.
ETL Sr. Consultant / Architect
Responsibilities:
- Designed/modified the warehouse design for the database tables using ERwin 8.*.
- Created Tableau Reports and Dashboards to help the top management make important decisions on our DW data.
- Working with HDFS, Hive, Pig, Spark, Scala and other Hadoop technologies in an effort to migrate the CDW from Oracle to Big Data.
- Created a file delete module using shell scripts to delete all unwanted directories which are not in use.
- Performed match n merge for Informatica MDM project to maintain the Customer's Master Data.
- Performance tuned the mappings using various techniques including session partitioning.
- Developed Informatica maps with web services and xml.
- Developed some DataStage mappings.
- Developed Informatica cloud mappings to keep the data synchronized with Salesforce.
- Used Master Data Management (MDM) to club various source records, merge them and derive master records from it.
- Worked on Teradata utilities - BTEQ, Multi-Load to load data into the Teradata Target database.
- Developed SQL, PL/SQL procedures, functions and packages and unit tested them.
Confidential, Atlanta, GA
Environment: Informatica PowerCenter 9.6/10.1, IDQ, ERwin, Hadoop, MDM, Oracle 11g/ MySQL, Vertica, TeraData, Linux, Erwin, ODI 11.*, DataStage 8.
ETL Sr. Consultant / Architect
Responsibilities:
- Designed/modified the warehouse design for the database tables using ERwin.
- Worked on Salesforce Apex Data Loader to export data out of Salesforce and import it into the Data warehouse using Informatica mappings.
- Worked on Tableau Reports and Dashboards to help the top management make important decisions on our DW data.
- Worked with HDFS, Hive, Pig, Spark, Scala and other Hadoop technologies.
- Used SQL transformation to execute a dynamic query stored for each row in a table.
- Performed match n merge for Informatica MDM project to maintain the Manheim's Customer Master Data.
- Automate a UNIX scripts to be called from various sessions to call another WF that captured the corrections to various Manheim Auction sites.
- Performance tuned the mappings using session partitions.
- Worked on Teradata utilities - BTEQ, Multi-Load to load data into the Teradata Target database.
Confidential, Atlanta, GA
Environment: Informatica PowerCenter 9.6.1, IDQ, Hadoop, Salesforce, MDM, Netezza &*, Teradata 13/14, Vertica 7.1.*, Linux, Oracle 11g, Erwin, Tableau, OBIEE 11.*, DAC, ODI 11.*, DataStage 8.
ETL Sr. Consultant / Architect
Responsibilities:
- Designed/modified the warehouse design for the database tables using ERwin 8.*.
- Used Java transformation to split a record into multiple records.
- Worked on Apex Data Loader to import csv data from warehouse to Salesforce.
- Worked with HDFS, Hive, Scala, Pig, Spark and other Hadoop technologies.
- Automated building a normalizer table dynamically with all column names for the table coming from user XL spreadsheet.
- Automate the scores table addition of new columns and building summary around them.
- Developed various Tableau Reports and Dashboards for the Confidential end users.
- Used Netezza queries, extensively to deliver final results to the user community.
- Performance tuned various Netezza queries and Informatica jobs.
- Worked on Teradata utilities - BTEQ, Multi-Load to load data into the Teradata Target database.
- Worked on Fast Export utility of Teradata to run the Extracts (Extracting the data from tables and writing to flat files).
- Developed Informatica cloud mappings to keep the data synchronized with Salesforce.
- Developed bunch of UNIX shell scripts/pearl scripts and automated their runs per schedule using CRONTAB.
- Scheduled Informatica/ OBIEE jobs using DAC scheduling tool.
- Used Master Data Management (MDM) to club various source records, merge them and derive master records from it for their Customer MDM.
- Developed SQL, PL/SQL procedures, functions and packages and unit tested them.
Confidential, Alpharetta, GA
Environment: Informatica PowerCenter 9.1, Linux, Oracle 11g, Erwin, Tableau, OBIEE 11.1.1.7.1 , DAC, SSAS cubes, HPCC, ECL.
ETL Lead/ Architect/ Admin / Support
Responsibilities:
- Used First Logic to parse name and addresses.
- Performed performance tuning of Informatica maps and SQL programs.
- Unit testing and migrating the Informatica objects to prod.
- Built lot of UNIX shell programs.
Confidential, Atlanta, GA
Environment: Informatica PowerCenter 9.1, Linux, Oracle 11g, Erwin, OBIEE 11.1.1.6, DAC
ETL Lead/ Architect/ Admin / Support
Responsibilities:
- Building lot of mapping enhancement to make Data Prep a better product.
- Used IDQ to standardize lots of different rules like Name parsing, Global address validation, phone number validation, country currency validation and credit card validations.
- Led 6 other team members on the project.
- Performed performance tuning of Informatica maps and SQL programs.
- Performed unit testing and code reviews.
- Working on OBIEE reports to generate reports for business users.
- Built lot of UNIX shell programs.
- Configured DAC to schedule Informatica jobs.
Confidential, Atlanta, GA
Environment: Informatica PowerCenter 9, Linux, Oracle 11g/ Erwin, DAC
ETL Lead
Responsibilities:
- Developed type 1 and type 2 PL/SQL procedures to efficiently load various dimensions.
- Led 2 other team members on the project.
- Performed performance tuning of Informatica maps and SQL programs.
- Developed high level ETL data flow using VISIO.
- Worked with Business Analysts in gathering Business requirements.
- Configured DAC jobs to schedule Informatica jobs.
- Performed unit testing and code reviews.
Confidential, Atlanta, GA
Environment: Informatica PowerCenter 9.1, OBIEE, DAC, Teradata V2R6, UNIX Oracle 11g/ Erwin
Lead ETL Developer
Responsibilities:
- Designed the Data warehouse using Confidential methodologies.
- Developed Technical docs/ Business requirement docs by reverse Engineering Informatica maps, PL/SQL programs developed by former developers. developers.
- Used IDQ to standardize lots of different rules like Name parsing, Address parsing and country currency validation.
- Built IDQ blocks for implementing different business rules.
- Created oracle tables/indexes as required for the CATS/OTM data in the data warehouse.
- Installed DAC and scheduled Informatica jobs form it.
- Led 2 on shore and 4 offshore developers on the project.
- Performed code reviews for my team.
- Provided guidance to the team for performance tuning/ troubleshooting.
- Designed and developed entire CATS datawahouse and OTM data warehouse for ETL implementations.
- Used the utilities of Teradata - BTEQ, Multi-Load to load data into the Teradata V2R6 Target database.
- Used the Fast Export utility of Teradata to run the Extracts (Extracting the data from tables and writing to flat files).
- Tested the SQL queries using Teradata SQL Assistant 12.0 as part of the ETL process.
- Designed and developed the error handling routines.
- Designed, developed, unit tested and documented various type 2 mappings like Parts/Locations/Project.
- Developed SQL, PL/SQL programs and unit tested them.
- Performed performance tuning of Informatica maps for more efficient loads.
- Developed efficient sql, pl/sql programs and also used with/merge statements for efficient on the fly upsert strategies.
Confidential, Atlanta, GA
Environment: Informatica PowerCenter 8.6, Unix, Oracle 10g/SQL Server 2008/ Erwin
Lead ETL Developer
Responsibilities:
- Designed the Data warehouse using Confidential methodologies.
- Developing the source deletes logic for the entire warehouse.
- Designed, developed, unit tested and documented various type 2 mappings for the Apollo Stage five area.
- Mentored other developers on Informatica 8.6 and reviewed their code.
- Performed performance tuning of Informatica maps for more efficient loads.
- Developed PL/SQL procedures, functions and packages and unit tested them.
- Designed and developed complete ETL solutions on different projects.
Confidential, Atlanta, GA
Environment: Informatica PowerCenter 8.6/8.5/ Unix/Oracle 10g r2/ Oracle warehouse Builder (OWB)/ Teradata/ Erwin
ETL Lead/Informatica Admin
Responsibilities:
- Managing two other resources on this project.
- Developed SQL, PL/SQL programs and unit tested them.
- Designed the ETL processes using OWB 10gR2 to load data from multiple sources into the stage area and the Central Data Warehouse.
- Developed mappings using OWB for data loading. Created Process flows, scheduled, monitored sessions and performance tuned them.
- Helping other Informatica resources trouble shoot any problems they might have.
- Assigning work to other resources and making sure the project is delivered on time.
- Installation of Informatica 8.5 on staging/ LAB box.
- Worked with Teradata utilities like BTEQ, Multi-Load to load data into the Teradata V2R6 Target tables.
- Used the Fast Export utility of Teradata to run the Extracts into flat files.
- Troubleshooting of various errors while installation/ production run/ Data issues.
- Design modifications of the BioSense Data model using Erwin.
- Loading XML messages received from various hospitals across the nation into Database using JMS JBOSS queues/Informatica.
- Added new maps like Message Observation to the BioSense process.
- Used source side, target side and full pushdown optimization to improve session performance.
- Involved in Informatica Admin work like installation, migrating workflows and mappings from Dev to staging/ Lab Box/Production using Repository Manager and managing user and group privileges on Informatica Folders.
- Performance tuning various maps and SQL statements to have a better throughput of data received from various hospitals across the nation.
- Developed Korn Shell scripts to move, archive source/ target files.
- Developed some PL/SQL procedures for mass deletes/updates.
- Developed OBIEE RPDs.
- Developed reports using OBIEE Answers.
Confidential, Alpharetta, GA
Environment: Informatica PowerCenter 8.5/8.1/7.1/ Oracle 10g/9i, Unix, Teradata, ERwin
ETL Lead
Responsibilities:
- Performed source data analysis before development and interaction with Business Analysts.
- Created Technical specification and Source to Target mapping documents.
- Used various maps/session performance tuning techniques including parallel pipeline session partitioning.
- Designed and developed ETL architecture for Real Property database in 3NF.
- Performed historical/incremental loads on Real Property database.
- Developed reusable transformations, mapplets and worklets to reduce development efforts whenever possible.
- Used First Logic Name and Address parsers in lot of maps.
- Developed and unit tested reusable transformations for name and address parsing.
- Developed CROSS error handling logic/ reprocess generic map to load manually rectified error data for any court.
- Developed slowly changing dimension mappings.
- Developed complex LANDFLIP report for FBI to give them a list of property owners who flipped their properties to minimize taxes.
- Developed Death Master report to let the Government know about the Dead people in the country to avoid SSN frauds.
- Developed various transformations in the mappings like Source Qualifier, Expression, Union, Filter, Sorter, Aggregator, Joiner, Lookup, Router, Sequence generator, Transaction Control, Update Strategy, Stored procedure, External Procedure and Normalizer transformations.
- Unit tested and peer tested the mappings and workflows and fixed the bugs.
- Designed and developed Bankruptcy customer outputs (PADR/Express financial) and was responsible in providing them monthly output files promptly in required output formats.
- Encrypted and secured FTP the sensitive public data to both internal and external customers.
- Used the $$PushdownConfig Mapping Parameter to do source-side, target-side, or full pushdown optimization at different times, depending upon the database workload.
- Debugged maps using Debugger and Transformation’s verbose data.
- Developed command tasks, email tasks, decision tasks and timer tasks in Workflow manager.
- Created Unit testing, QA migration and Production Turnover documents.
- Involved in Informatica Admin work like migrating workflows and mappings from Dev to QA and QA to Production using Repository Manager and managing user and group privileges on Informatica Folders.
- Followed development standards like Confidential ’s object naming conventions, short cuts to sources, targets, source anchors, target anchors and a brief documentation on each transformation that I developed.
- Involved in production support for nightly loads.
Confidential, Atlanta, GA
Environment: Informatica PowerCenter/PowerMart 7.1 Oracle 8i/9i, ERwin 3.5
Lead ETL Developer
Responsibilities:
- Designed, developed and unit tested type 1 and type 2 mappings to load the data in Confidential star schema.
- Developed and unit tested the main Accounts fact table of this data warehouse.
- Developed an accounts persistent cache mapping to improve the performance across all other type 2 mappings.