Etl Developer Resume
Charlotte, NC
Summary:
- Around 6 years in every stage of Software Development Life Cycle (SDLC)/Data warehouse development life cycle involving Requirement Gathering/Analysis, Design, Development, Testing, Deployment and Production Support
- Extensively worked on data extraction, Transformation and loading data from various sources like Oracle, Flat files, Teradata.
- Experience in coding using SQL, TOAD, PL/SQL procedures/functions, triggers and exceptions.
- Experience in working with Oracle, SQL Server, Netezza, DB2, and Teradata databases.
- Hands on experience with Informatica Data Quality (IDQ) tools for Data Analysis / Data Profiling
- Experience working with scheduling tools Control - M, Autosys.
- Expertise in OLTP, OLAP, System Study, Analysis.
- Expert in Data Warehousing Concepts and Business Intelligence
- Experience with Teradata utilities FastLoad, MultiLoad, BTEQ scripts.
- Worked on IDQ Analyst for Profiling, Creating rules on Profiling and Scorecards. Designed IDQ mappings which is used as Maplets in Power center Worked extensively on Informatica Data Quality Versions 9.x
- Used SQL, PL/SQL in writing Stored Procedures, Functions, Packages and Triggers.
- Experience in Exception Handling strategies to capture errors and referential integrity constraints of records during loading processes to notify the exception records to the source team.
- Expert in performance tuning in Informatica PowerCenter and Teradata.
- Worked on all SDLC methodologies and importantly Agile methodology.
- Experience in UNIX, writing UNIX shell scripts for Informatica pre & post session operations.
- Expertise in Teradata SQL Assistant in creating databases, users, tables, triggers, macros, views, stored procedures, functions, Packages, volatile and GTT tables, joins and hash indexes in Teradata database.
- Proficient in implementing various new components like increasing the DTM Buffer Size, Database Estimation, Incremental Loading, Incremental aggregation, Validation Techniques, and load efficiency.
- Strong on Exception Handling Mappings for Data Quality, Data Cleansing and Data Validation.
- Extensive experience in using Change Data Capture (CDC) to simplify ETL in data warehouse applications.
- Good understanding of Hadoop architecture and Hands-on experience with Hadoop components such as HDFS, Hive, Scala etc.
- Hands on experience in big data technologies such as Hadoop, Hive, HBase, MapReduce, and HDFS.
- Excellent knowledge using Mapplets, parameters and variables to implement object orientation techniques and facilitate the reusability of code.
- Proficient in using Workflow Manager to create and run batches for different applications.
- Knowledge in developing UNIX scripts as pre/post-session commands to schedule loads, through SQL-loader utility.
- A team player with strong communication, interpersonal, analytical and logical abilities, capable of picking up new skills quickly.
- Possess knowledge SQL server reporting services, Business Objects and Informatica
TECHNICAL SKILLS:
Data Warehousing: Informatica Power Center 9.x/8.x, Power Exchange Change Data Capture (CDC), Data cleansing, OLAP, ROLAP, MOLAP, SQL*Plus, SQL*Loader
Data Modeling: Dimensional Data Modeling, Data Modeling, Star Schema Modeling, Snow-Flake Modeling, FACT and Dimensions Tables, Physical and Logical Data Modeling
Databases: Teradata, Oracle 11g/10g, Netezza, MS SQL Server, MS Access 2000
Programming: SQL, PL/SQL, Visual Basic 6.0/5.0, HTML, C, UNIX Shell Scripting, Hadoop
Environment: Unix, LINUX, Windows 95/98/NT/2000/XP
Professional Experience:
Confidential , Charlotte, NC
ETL Developer
Responsibilities:
- Involved in understanding the Requirements of the End Users/Business Analysts and developed strategies for ETL processes.
- Loading the OLTP data into the Warehouse OLAP and built the Re-Usable Mappings using Informatica PowerCenter.
- Created Sessions and Workflows to help schedule nightly loads and process data from all source terminal Data Collection points.
- Created various Documents such as Source-To-Target Data Mapping Document, Unit Test Cases and Data Migration Document.
- Used Teradata as source as well as targets.
- Used Tpump, Mload, Fload and BTEQ scripts utilities on Teradata.
- Used Tpump, fastload, mload configured through Informatica to load Teradata tables.
- Used HP service manager (change management) for code migration from different environments.
- Extensively used pre-session and post-session variable assignment for simulating multi-threading scenarios for Load balancing and performance improvement.
- Used Constraint Based loading & Target load ordering to efficiently load tables with PK-FK relation in the same mapping.
- Extensively used Parameter file to override Mapping parameter, Mapping Variables, Workflow Variables, Session Parameters, FTP Session Parameters and Source-Target Application Connection parameters.
- Wrote Shell scripts and Stored Procedures for regular Maintenance and Production Support to load the warehouse in regular intervals and to perform Pre/Post Session Actions.
- Partners with the business to prioritize and deliver items received from the product owner
- Involved in performance tuning of the process at mapping, session, source level and at target level and in writing hive queries (HQL) and Hadoop map reduce jobs.
- Proactively manages relationships with stakeholders through effective communication
- Ensures stability, capacity and resiliency of the production environment
- Has awareness of the domain roadmap to provide credible updates to the business and other groups
- Multi-skilled across the range of team functions (analysis, design, coding and testing disciplines).
- Effective people skills with the ability to work on a SCRUM team
- Experienced practitioner who raises the value delivery performance level of the entire team.
- Leadership skills and ability to communicate and influence the team and various constituents up, down and across the organization
Environment: Informatica Power Center 9.6/9.1, Teradata 14.10/14, Oracle 11g/10g, fixed width files, TOAD, SQL Assistant, Unix, Korn Shell Scripting, Hadoop, Autosys, SAS, Business Objects, Flat Files.
Confidential, Morristown, NJ
Sr. ETL / Teradata Developer
Responsibilities:
- Involved in understanding the Requirements of the End Users/Business Analysts and developed strategies for ETL processes.
- Extracted data from DB2 database on Mainframes and loaded it into SET and MULTISET tables in the Teradata database by using various Teradata load utilities. Transferred large volumes of data using Teradata FastLoad, MultiLoad, and T-Pump.
- Architected and developed FastLoad and MultiLoad scripts developed Macros and Stored procedures to extract data, BTEQ scripts to take the date range from the database to extract data.
- Created JCL scripts for calling and executing BTEQ, FastExport, Fload, and Mload scripts.
- Responsible for requirements gathering for an enhancement requested by client. Involved in analysis and implementation for an Intranet Based Information Management Information System.
- Provided maintenance and support of Online and Batch Programs using COBOL, DB2, CICS, and JCL.
- Writing queries using SPUFI to extract data from various DB2 Views for reporting purpose
- Used all the cleansing function in Informatica power center and Informatica IDQ.
- Extensively used standardizer, tokenizer, data profiling in IDQ.
- Converting the Table data from DB2 region to TERADATA region using FASTLOAD and MULTILOAD Utilities.
- Responsible for Coding, Unit Test Plans, Unit Test Results, Functional Testing and Regression Testing.
- Synchronizing all regions PCR, Unit and System while migration changes from lower region to acceptance.
- Wrote several DB2 Stored Procedure scripts to implement the business logic.
- Handling Ad-Hoc Report Requests.
- Reviewing programs for QA and Testing.
- Developed Teradata BTEQ scripts to implement the business logic and work on exporting data using Teradata FastExport.
- Wrote highly complex SQL to pull data from the Teradata EDW and create AdHoc reports for key business personnel within the organization.
- Experience in loading data into Netezza db using NZLOAD utility.
- Created data models for information systems by applying formal data modeling techniques.
- Strong expertise in physical modeling with knowledge to use Primary, Secondary, PPI, and Join Indexes.
- Designed Fact tables and Dimension tables for star schemas and snowflake schemas using ERWIN tool and used them for building reports.
- Performed reverse engineering of physical data models from databases and SQL scripts.
- Provided database implementation and database administrative support for custom application development efforts.
- Performance tuning and optimization of database configuration and application SQL by using Explain plans and Statistics collection based on UPI, NUPI, USI, and NUSI.
- Developed OLAP reports and Dashboards using the Business intelligence tool - OBIEE.
- Involved in comprehensive end-to-end testing- Unit Testing, System Integration Testing, User Acceptance Testing and Regression.
- Provided 24/7 On-call Production Support for various applications and provided resolution for nighttime production job abends, attend conference calls with business operations, system managers for resolution of issues.
Environment: Informatica 9.1(Designer, Repository Manager, Workflow Manager, Workflow Monitor), Informatica IDQ, Oracle 10G, Teradata 13, Netezza, UNIX, Citrix, Toad, Putty, PL/SQL Developer
Confidential, Mclean,VA
ETL Developer
Responsibilities
- Worked with the business team to gather requirements for projects and created strategies to handle the requirements.
- Worked on project documentation, which included the Functional, Technical and ETL Specification documents.
- Experienced in using Informatica for data profiling and data cleansing, applying rules and develop mappings to move data from source to target systems
- Worked on building the Teradata Data Warehouse from Oracle using Informatica Power Center
- Designed and implemented ETL mappings and processes as per the company standards, using Informatica Power Center.
- Extensively worked on complex mappings, which involved slowly changing dimensions.
- Developed several complex mappings in Informatica a variety of PowerCenter transformations, Mapping
- Parameters, Mapping Variables, Mapplets& Parameter files in Mapping Designer using Informatica Power Center.
- Worked extensively on Informatica transformations like Source Qualifier, Expression, Filter, Router, Aggregator, Lookup, Update strategy, Sequence generator and Joiners.
- Debugged mappings by creating a logic that assigns a severity level to each error, and sent the error rows to error table so that they can be corrected and re-loaded into a target system.
- Deployed reusable transformation objects such as Mapplets to avoid duplication of metadata, reducing the development time.
- Implemented performance and query tuning on all the objects of Informatica using SQL Developer.
- Extensively used Change Data Capture (CDC) to simplify ETL in data warehouse applications.
- Worked in the ETL Code Migration Process from DEV to QA and Pre-PROD.
- Created the design and technical specifications for the ETL process of the project.
- Used Informatica as an ETL tool to create source/target definitions, mappings and sessions to extract, transform and load data into staging tables from various sources.
- Responsible for mapping and transforming existing feeds into the new data structures and standards utilizing Router, Lookups Using Connected, Unconnected, Expression, Aggregator, Update strategy & stored procedure transformation.
- Worked on Informatica Power center tool - Source Analyzer, Data Warehousing Designer, Mapping Designer & Mapplets, and Transformations.
- Worked with SQL*Loader to load data from flat files obtained from various facilities.
- Worked on loading of data from several flat files to Staging using Teradata MLOAD, FLOAD and BTEQ.
- Worked with the Release Management Team for the approvals of the Change requests, Incidents using BMC Remedy Incident tool.
- Worked with the infrastructure team to make sure that the deployment is up-to-date.
- Provided 24x7 production support when necessary.
Environment: Informatica Power Center 9.0.1/9.1.0 ,Power Exchange 9.0.1/9.1.0 , Oracle 11g, SQL, Teradata 13, UNIX, Autosys, BMC Remedy Incident Tool, Ultra Edit
Confidential
Informatica ETL and Teradata developer
Responsibilities:
- Coordinated with BI Architect and Technical Lead on the Project requirements.
- Created high and low level design documents.
- Prepared ETL Specifications based on the design and high level logical flow provided by BI Architect.
- Created scripts to create new tables, views, queries using Teradata SQL Assistant.
- Developed Teradata BTEQ Scripts / Informatica mappings, workflows and sessions as per ETL specifications.
- Implemented different transformations like Source Qualifier, Expression, Aggregator, Joiner, Filter, Lookup, and Update Strategy Designing and optimized the Mapping.
- Performed performance tuning and space utilization optimizations for the application.
- Performed Unit, Integration, Performance testing.
- Co-ordinated with support teams to deploy code in stage and production environments
Environment: Informatica PowerCenter 9.1, Teradata 13, Oracle 10g, SVN, UNIX, Teradata SQL Assistant.
