We provide IT Staff Augmentation Services!

Sr Etl Developer Resume

4.00/5 (Submit Your Rating)

Union, NJ

SUMMARY

  • Around 6 years of professional experience in Information Technology with extensive experience in development of various projects using Data Warehousing tools like Informatica and databases like Oracle, SQL Server and Teradata, UNIX and Windows platforms.
  • Excellent background in gathering business requirements and translate them into technical specifications to develop ETL and Reporting solutions.
  • Good Knowledge of Inmon and Kimball methodologies, Star and snowflake schemas in Data warehouse design.
  • Developed effectively different type of SCD’s (Slowly Changing Dimensions) based on the specifications.
  • Worked on Oracle Database supporting OLTP and Data Warehouses.
  • Experience in generation of Tables, views to convert logical data models to physical data models.
  • Experience in identification of Facts, Measures, Dimensionsand hierarchies for OLAP models.
  • Performed Columnar Partitions on all the tables, join indexes and built tables, views using UPI, NUPI, USI, NUSI and PPI.
  • Utilized Columnar oriented database storage for its promise to speed performance by reducing disk I/O and improve data compression.
  • Utilized Teradata Columnar (CP) for improving the query performance, Reduction of disk space.
  • Experience as an ETL developer using Informatica Power Center which includes Source analyzer, warehouse designer, mapping designer, mapplet designer, transformation designer and developer, Repository manager, Workflow manager and Workflow monitor.
  • Experience in Data Conversion and Migration from Legacy systems to Relational databases and web applications.
  • Experience in Teradata RDBMS using Fastload, Tpump, and Fastexport, Multiload and Teradata SQL Assistant and BTEQ utilities.
  • Development of scripts for loading the data into the base tables in EDW and to load the data from source to staging and staging area to target tables using Fast Load, Multiload and BTEQ utilities of Teradata.
  • Expertise in collection and documentation of the source - to-target mapping requirements andbusiness rules.
  • Worked with push down optimization in Informatica.
  • Implemented Performance Tuning Techniques and Error Handling at various levels like source and Target mappings.
  • Comfortable with both technical and functional applications of RDBMS, Data Mapping, Data Management, Data transportation and Data Staging.
  • Experience in Stored Procedures, PL/SQL, SQL, Packages, Triggers, Functions and Query optimization.
  • Good understanding on SDLC process and agile methodologies and also involved end to end implementations of DWH projects usingDWH toolsInformatica power center.
  • Good team player, strong interpersonal and communication skills combined with self-motivation initiative and positive attitude.
  • Experience in Unit Testing, System Testing and code Migration activity from Dev to QA and QA To production through Serena tool.
  • Scheduling the automated jobs for daily, weekly and monthly jobs using UNIX Shell scripts for Autosys scheduling.
  • Daily standup meetings with onsite managers.
  • Experience with various source and target systems like flat files, XML’s, COBOL files, Web Services etc.

TECHNICAL SKILLS

ETL TOOLS: Informatica Power center 9.6/9.5x/9.x/8.x., IDQ, MDM.

Data Modelling: Erwin 4.2/3.x, MS Visio

Teradata Utilities: Fast Load, Multiload, Fast Export, Tpump, SQL Assistant, Teradata Parallel Transport utility (TPT), BTEQ, MPP

Operating Systems: UNIX(Sun Solaris), Windows, LINUX

Languages: C, Teradata SQL, Oracle SQL, PL/SQL

Databases: Oracle 8.0/8i/9i/10g, SQL Server, Teradata V2R5/14.10/13.

Scripting Languages: UNIX Shell Scripting, Perl Scripting

Others: Eclipse, GIT, Putty, WinSCP, Microsoft Office, Microsoft Visio, DB2 Control Center, GIT, Crystal Reports, TOAD, Auto Sys, Mathematica, SQL*Plus.

PROFESSIONAL EXPERIENCE

Confidential - Union, NJ

Sr ETL Developer

Responsibilities:

  • Interacted with business users, analysts to gather, understand, analyze, program and document the requirements of Data Warehouse.
  • Developed, Tested, Migrated Mappings, Workflows for enhancement and implementation of new business processes.
  • Translated business requirements into data mart design.
  • Used Source Analyzer and target Designer to import the source and target database schemas, and the mapping designer to map source to the target.
  • Focused on new system and tools with minimal supervision and trained Project Architecture to team members.
  • Created a BTEQ script for pre population of the work tables prior to the main load process.
  • Created Primary Indexes (PI) for both planned access of data and even distribution of data across all the available AMPs. Created appropriate Teradata NUPI for smooth (fast and easy) access of data.
  • Developed the Teradata Macros, Stored Procedures to load data into Incremental/Staging tables and then move data from staging to Journal then move data from Journal into Base tables.
  • Very good understanding of Database Skew, PPI, Join Methods and Join Strategies, Join Indexes including sparse, aggregate and hash.
  • Analyzed data and implemented the multi-value compression for optimal usage of space and improved I/O reads.
  • Worked on Teradata RDBMS using FASTLOAD, MULTILOAD, TPUMP, FASTEXPORT, MULTILOAD, Teradata SQL and BTEQ Teradata utilities.
  • Designed the ETL processes using Informatica to load the data from sources like DB2, XML and Flat Files to target Flat Files and from DB2 to DB2 and from Flat Files to Flat Files (Delta process).
  • Developed the Teradata Macros, Stored Procedures to load data into Incremental/Staging tables and then move data from staging to Journal then move data from Journal into Base tables.
  • Used the PL/SQL procedures for Informatica mappings for truncating the data in target tables at run time.
  • UsedError Handlingto capture error data in tables for handling nulls, analysis and error remediation Process.
  • Written complex SQLs using joins, sub queries and correlated sub queries. Expertise in SQL Queries for cross verification of data.
  • Very good understanding of Database Skew, PPI, Join Methods and Join Strategies, Join Indexes including sparse, aggregate and hash.
  • Used extensively Derived Tables, Volatile Table and GTT tables in many of the ETL scripts

Environment: Teradata 14.10, Informatica Power Center 9.5.6, UNIX, Oracle 11g, SQL*plus, SQL, TOAD, PL/SQL Developer, SQL Developer.

Confidential - Riverwood, IL

ETL Developer/Informatica

Responsibilities:

  • Extensively worked in the performance tuning of the programs, ETL Procedures and processes. Coded Database triggers, functions and stored procedures and written many SQL Queries.
  • Writing scripts for data cleansing, data validation, data transformation for the data coming from different source systems.
  • Querying a subset of rows based on constraints on one or more partitioning columns in Teradata environment.
  • Worked mostly on Lookup, Aggregator, and Expression Transformations to implement complex logics while coding a Mapping.
  • Developed code to load the data from Flat File to stage and stage to DWH.
  • Developed mappings with ORACLE as target and formatting the target data according to the requirement.
  • Assisted senior developers in developing stored procedures, functions for ETL applications.
  • Implemented slowly changing dimensions (SCDs) methodology to keep track of historical data.
  • Extensively Used Perl Scripting to schedule the Informatica Jobs.
  • Worked with Memory cache for static and dynamic cache for the better throughput of sessions containing Rank, Lookup, Joiner, Sorter and Aggregator transformations.
  • Migrating objects between different Environments using XML Export/Import (using Repository Manager).
  • Extensively used Informatica XML transformations like XML Source Qualifier, XML Parser and XML Generator to load data from XML files to DWH.
  • Created Tidal jobs to schedule Informatica Workflows. Executed workflows using Tidal scheduler.
  • Used the PL/SQL procedures for Informatica mappings for truncating the data in target tables at run time.
  • Developed reusable Mapplets to include the Audit rules.
  • Working with Power Center Versioning (Check-in, Check-out), Querying to retrieve specific objects, maintaining the history of objects.
  • Solely responsible for the daily loads.
  • Generated queries using SQL to check for consistency of the data in the tables and to update the tables as per the requirements.
  • Creating stored procedures and sequences to insert key into the database table.
  • Guided the testing team and the development team and monitored the Implementation.
  • Provided support for the Nightly jobs.

Environment: Informatica Power Center 9.x, Oracle 11g, 10g, Teradata 13/14, DWH, PL/SQL Developer, Windows XP and UNIX.

Confidential - Richardson, TX

ETL Developer

Responsibilities:

  • Designed the project in such a way that there are 2 phases, SDE and SIL, as per the BI standards at Informatica level.
  • Responsible for creating Technical Design documents, Source to Target mapping documents and Test Case documents to reflect the ETL process.
  • Utilized Columnar oriented database storage for its promise to speed performance by reducing disk I/O and improve data compression.
  • Implemented Block level compression on cold data.
  • Created Primary Indexes (PI) for both planned access of data and even distribution of data across all the available AMPs. Created appropriate Teradata NUPI for smooth (fast and easy) access of data.
  • Implemented full pushdown Optimization (PDO) for Semantic layer implementation for some of the complex aggregate/summary tables instead of using the ELT approach.
  • Created Sessions, Reusable Sessions, Reusable Worklets and workflows in Workflow Manager and Scheduled workflows and sessions at specified frequency.
  • Development of scripts for loading the data into the base tables in EDW and to load the data from source to staging and staging area to target tables using Fast Load, Multiload and BTEQ utilities of Teradata.
  • Used SQL to query the databases and do as much crunching as possible in Teradata, using very complicated SQL Query optimization (explains plans, collect statistics, data distribution across AMPS, primary and secondary indexes, locking, etc.) to achieve better performance.
  • Created checkpoints, phases to avoid dead locks and tested the graphs with some sample data then committed the graphs and related files into Repository from sandbox environment.
  • Analyzed Session Log files in case the session failed to resolve errors in mapping or session configurations.
  • Performed application level DBA activities creating tables, indexes and monitored and tuned Teradata BETQ scripts using Teradata Visual Explain utility.
  • Troubleshooting the loading failure cases, including database problems.
  • Prepared Documents like Technical Design Doc, Production Support Doc, and Deployment Doc.

Environment: Teradata14, Informatica Power Center 9.x, Teradata utilities, Fastload, Multiload, Tpump, Teradata SQL Assistant, UNIX, Oracle 10g, SQL, TOAD, ERWIN, Informatica Data Quality (IDQ), Putty Linux Shell Scripting.

Confidential - Hoffman Estates, IL

ETL Developer/Informatica

Responsibilities:

  • Responsible for requirements gathering for an enhancement requested by client. Involved in analysis and implementation for an Intranet Based Information Management Information System.
  • The Teradata EXPLAIN facility, which describes to end-users how the database system will perform any request.
  • Used Unstructured Data Transformation (UDT) to call the data transformation service (DTS) created in the Informatica Developer by using DataProcessor Transformation.
  • Performed Query Optimization with the help of explain plans, collect statistics, Primary and Secondary indexes. Used volatile table and derived queries for breaking up complex queries into simpler queries.
  • Streamlined the Teradata scripts and shell scripts migration process on the UNIX box.
  • Used Informatica Power Center Workflow manager to create sessions, batches to run with the logic embedded in the mappings.
  • Developed PL/SQL procedures and UNIX Shell Scripts.
  • Created complex mappings in Power Center Designer using Aggregator, Expression, Filter and Sequence Generator, Update Strategy, Union, Lookup, Joiner, XML Source Qualifier and Stored procedure transformations.
  • Created the detail design documents like LLD, HLD and RTM after analyzing the business and the databases.
  • Analysis and evaluation of alternatives to formulate the Implementation strategy, Estimation of the software development effort.
  • Created Mapplets and used in different Mappings.
  • Involved in Unit Testing and Integration testing.
  • Informatica upgradation validation from 7.6 to 8.6.1.
  • Provided on-call production support for various applications and provided resolution for night time production job, attend conference calls with business operations, system managers for resolution of issues.

Environment: Teradata 13.x, Informatica Power Center 8.x/7.x, SQL Loader, PL/SQL, Oracle 10g, TPT and MS Visio, TOAD.

Confidential

Application Developer

Responsibilities:

  • Involved in Performance testing of the workflows/Mapping, which helped in analyzing its performance before moving into production.
  • Assisted senior developers in developing stored procedures, functions for ETL applications
  • Implemented slowly changing dimensions (SCDs) methodology to keep track of historical data.
  • Worked on performance tuning of user queries, execution of frequently used SQL operations and improved the performance.
  • Created mappings, workflows using Informatica Power Center to load the data to oracle tables.
  • Assisted in developing the triggers to handle history and audit data for production environment.
  • Created users, roles, profiles and Objects and system rights.
  • Created Understanding documentation and Release Testing documentation on the tickets handled, and documented the issues found in a central repository.
  • Also used the Informatica Data Exchange to connect to the Main frames source and extract the data.
  • Interacted with people from various teams in the Project like Oracle DBAs', Maestro Schedulers, Spec. Creators, Reporting, and UNIX etc. to aid in the smooth functioning of the Project flow.
  • Gathered and documented information from ETL team.
  • Assisted Team lead and other developers in ETL documentation.
  • Worked with business analysts to identify mapping specifications.
  • Created the ETL test plans and implemented the unit and integration testing.
  • Involved in the standardization of processes to archive flat files and for loading indicator files

Environment: Informatica Power Center 7.x, SQL Tools, Oracle, PL/SQL, Business Objects, Linux, Windows XP.

We'd love your feedback!