Sr. Etl Developer Resume
NY
SUMMARY
- Overall 8+ years of overall experience in complete Software Development Life cycle (SDLC) including Estimations, Gathering requirement, Analysis, Design, Development, Unit Testing, System Testing and implementation of Data warehousing projects.
- Extensively worked as a Teradata Developer and involved mainly in building Teradata warehouse.
- Proficient in data warehousing techniques for Data cleansing, Slowly Changing Dimension phenomenon’s (SCD’s), Change Data Capture (CDC).
- Experience in integration of various data sources from Databases like Teradata, Oracle, SQL Server, and text files.
- Expert in Scheduling tool WLM (work Load manager).
- Excellent knowledge and experience in documents like BSD, TSD & Mapping documents.
- Extensively involved in identifying performance bottlenecks in targets, sources and transformations and successfully tuned them for maximum performance using best practices.
- Experience in documenting Design specs, Unit test plan and deployment plan.
- Extensive knowledge with Teradata SQL Assistant. Developed BTEQ scripts to Load data from Teradata Staging area to Data Warehouse, Data Warehouse to data marts for specific reporting requirements. Tuned the existing BTEQ script to enhance performance.
- Strong Knowledge in Relational Database Concepts, Entity Relation Diagrams, Normalization and De Normalization Concepts.
- Extensive experience with Data Extraction, Transformation, and Loading (ETL) from disparate data sources like Multiple Relational Databases (ORACLE … Teradata 14/13 , Netezza , UDB DB2 , Mainframes , SQL server 2012, SAP, Sybase, Informix, MySQL, Flat Files, MQ series and XML, Flat files .
- Developed effective working relationships with client team to understand support requirements, develop tactical a strategic plan to implement technology solutions, and effectively manage client expectations.
- Regularly evaluate processes and make recommendations to improve efficiency.
- Experience with Agile, Scrum and Project Management Methodologies and good knowledge in Designed Mappings using B2B Data Transformation Studio.
- Involves frequent dialogue with Technical Program Directors, Technical Architects, Release team and Project Managers.
- Used informatica power center to Extract, Transform and Load data into Netezza Data Warehouse from various sources like Oracle and flat files.
- Attend and participate in meetings that pertain to assigned responsibilities.
- Expertise in Problem solving and Tracking Bugs during the production failure.
- Expertise in SQL Server Integration Services (SSIS) and SQL Server Reporting Services (SSRS) with good knowledge on SQL Server Analysis Services (SSAS).
- Experience in writing UNIX korn shell scripts to support and automate the ETL process.
- Technical expertise in ETL methodologies, Informatica 6.x/7.x/8.x/9.x - Power Center, Power Mart, Client tools - Mapping Designer, Workflow Manager/Monitor and Server tools - Informatica Server Manager, Repository Server Manager, and Power Exchange.
- Worked on WebService Call through Informatica by generating and testing the incoming XML using external Freeware called SOAP UI.
- Expertise in testing the applications and creating test cases for Unit Testing, Integration Testing and make sure the data extracted from source is loaded into target properly in the right format.
- Experience in ETL data loading from OLTP Database to OLAP (OBIEE) Database.
- Very good understanding of Reporting tools like Cognos, Tableau and Business Objects.
- Good Analytical and strong interpersonal and good communication skills.
TECHNICAL SKILLS
ETL Tools: Informatica Power center 7.x/8.x/9.x
Scripting Languages: UNIX Shell Scripting, Java Scripting
Versioning Tools: WinSCP, JIRA, GIT
Databases: Teradata, Oracle & SQL Server
Data Modeling: Erwin 4.0/3.5,MS Visio
Languages: SQL, Unix Shell scripting, Teradata SQL Assistant, PL/SQL, C, JAVA
Scheduling: WLM, Maestro and Crontab
Operating Systems: Win XP, 7, 8 and 10, UNIX, Linux
Migration Tools: GitHub, Gerrit Jenkins, Nexus
Methodologies: Agile, Scrum, Waterfall
PROFESSIONAL EXPERIENCE
Confidential, NY
Sr. ETL Developer
Responsibilities:
- Involved in full Software Development Life Cycle (SDLC) - Business Requirements Analysis, preparation of Technical Design documents, Data Analysis, Logical and Physical database design, Coding, Testing, Implementing, and deploying to business users.
- Involved in gathering business requirements, logical modelling, physical database design, data sourcing and data transformation, data loading, SQL and performance tuning.
- Implemented a Data Quality Solutions, which includes Standardization and Matching of Source data using IDQ.
- Worked in setting up Informatica Data Quality (IDQ), Informatica Data Exchange IDE and Data Masking softwares.
- Expertise in writing scripts for Data Extraction, Transformation and Loading of data from legacy systems to target data warehouse using BTEQ, FastLoad, MultiLoad, and Tpump.
- Defining the schema, staging tables, and landing zone tables, configuring base objects, foreign-key relationships, complex joins, and building efficient views.
- Performed Query Optimization with the help of explain plans, collect statistics, Primary and Secondary indexes. Used volatile table and derived queries for breaking up complex queries into simpler queries. Streamlined the Teradata scripts and shell scripts migration process on the UNIX box.
- Worked on Informatica Power Center tools - Designer, Repository Manager, Workflow Manager, and Workflow Monitor.
- Developing as well as modifying existing mappings for enhancements of new business requirements mappings to load into staging tables and then to target tables in EDW. Also created Mapplets to use them in different mappings.
- Exposure to Informatica B2B Data Exchange that allows to support the expanding diversity of customers and partners and their data with capabilities that surpass the usual B2B solutions
- Working on different tasks in Workflows like sessions, events raise, event wait, e-mail, command, worklets and scheduling of the workflow.
- Using various transformations like Filter, Expression, Sequence Generator, Update Strategy, Joiner, Stored Procedure, and Union to develop robust mappings in the Informatica Designer.
- Creating sessions, configuring workflows to extract data from various sources, transforming data, and loading into enterprise data warehouse.
- Running and monitoring daily scheduled jobs by using Work Load manager for supporting EDW (Enterprise Data Warehouse) loads for History as well as incremental data.
- Investigating failed jobs and writing SQL to debug data load issues in Production.
- Interacting with the Source Team and Business to get the Validation of the data.
- Writing SQL Scripts to extract the data from Database and for Testing Purposes.
- Supported the code after postproduction deployment.
- Involved in Transferring the Processed files from mainframe to target system.
- Familiar with Agile software methodologies.
Environment: Teradata v14, UNIX, Teradata SQL Assistant, BTEQ, FastLoad, MultiLoad, Tpump, Informatica Powercenter 9.5, Agile.
Confidential, Schaumburg, IL
ETL Developer
Responsibilities:
- Migrated data from Informatica Powercenter Designer and using transformations like Source Qualifier, Expression, Filter, Router, Joiner, Sequence developer, Update Strategy, Lookup, Sorter, Aggregator, Normalizer, XML Source Qualifier, Stored Procedure etc. for extraction, transformation and loading of data.
- Worked on Netezza as relational Source data base which is dimensional model to generate the existing BO reports.
- Assisted in support functions and maintenance of Netezza data warehousing applications as per program requirements.
- Created complex jobs and implemented Slowly Changing Dimensions (Type 1, Type 2 and Type 3) for data loads.
- Extensively worked with Netezza database to implement data cleanup, performance tuning techniques.
- Extensively used Erwin for Logical and Physical data modeling and designed Star Schemas.
- Extensively Used Environment SQL commands in workflows prior to extracting the data in the ETL tool.
- Worked with Teradata utilities like BTEQ, Fast Export, Fast Load, Multi Load to export and load data to/from different source data base Netezza.
- Created databases, tables, triggers, macros, views, stored procedures, functions, Packages, joins and hash indexes in Teradata database.
- Expertise using ERWIN for Data modeling and Database design.
- Worked with Informatica Power Exchange for Netezza and migrating the data using Talend Studio into Teradata.
- Worked with the B2B Operation console to create the partners, configure the Partner management, Event Monitors and the Events.
- Hands on Experience Business Intelligence experience using Business Objects.
- Migrated reports from Business Objects to Tableau.
- Providing Data warehouse solutions in Informatica using Power Center and data modeling with ERWIN tool.
- Used Erwin tool for physical and logical data modeling.
- Used Informatica power center to Extract, Transform and Load data into Netezza Data Warehouse from various sources like Oracle and flat files. Used Talend extensively for profiling the data and accessing the data quality of the source data.
- Created and Configured Workflows, Worklets, and Sessions to transport the data to target warehouse Netezza tables using Informatica Workflow Manager.
- Migrated Informatica folders, mappings from one environment to another and in the process of change control using Talend and yaml files.
- Created jobs in Talend Studio in the development environment and tested in QA and moved into Production environment as well.
- Created and used volatile tables for testing purposes.
- Involved in Code Reviews & Unit Testing for the ETL code developed.
- Proficient in designing and deployment SSIS packages using various transformations such as Slowly Changing Dimension, Multicast, Merge Join, Lookup, Conditional Split, Aggregate, Derived Column, Sort, Multi-Cast, Union, and Data Conversion Transformations.
Environment: Teradata v13/v14, Netezza, ERWIN, ETL tool, Informatica, Tableau, Oracle, Informatica Workflow Manager, BTEQ, Fast Export, Fast Load, Multi Load.
Confidential, OH
ETL Developer
Responsibilities:
- Extensively used Informatica client tools like Source Analyzer, Mapplet Designer, Informatica Repository Manager and Workflow Manager.
- Involved in analysis and understanding of end user requirements and business rules.
- Involved in calculating project estimates.
- Development of scripts for loading the data into the base tables in EDW using Fast Load, Multiplied and BTEQ utilities of Teradata.
- Identified all potential issues during the requirement understanding phase and to describe actions to address those issues.
- Performed tuning and optimization of complex SQL queries using Teradata Explain.
- Created a BTEQ script for pre-population of the work tables prior to the main load process.
- Creation of HLD and LLD design of the system.
- Created the study and TDD for the new requirements.
- Developed MLOAD scripts to load data from Load Ready Files to Teradata Warehouse.
- Involved heavily in writing complex SQL queries to pull the required information from Database using Teradata SQL Assistance.
- Designing the technical solution of Business requirement.
- Loading data by using the Teradata loader connection, writing Teradata utilities scripts (Fast load, Multiplied) and working with loader logs.
- Created and automate the process of loading using Shell Script, Multi load, Teradata volatile tables and complex SQL statements.
- Performed tuning and optimization of complex SQL queries using Teradata Explain.
- Recommend solutions for data issues.
- Streamlined the Teradata scripts and shell scripts migration process on the UNIX box.
- Involved in analysis of end user requirements and business rules based on given documentation and working closely with tech leads and analysts in understanding the current system.
- Fine-tune the existing process to achieve increased performance and reduced load times for faster user query performance.
- Creating and maintaining source-target mapping documents for ETL development team.
- Developed unit test plans and involved in system testing customer information. The main scope in this project is dealing with Enterprise Data Warehouse (EDW) solution that will support ad-hoc reporting & analysis.
Environment: Teradata v13, ETL tools, Teradata SQL Assistant, BTEQ, Fast Export, Fast Load, Multi Load and Shell Scripting.
Confidential, Bridgewater, NJ
ETL Developer
Responsibilities:
- Prepared technical design/specifications for data Extraction, Transformation and Loading.
- Designed the ETL processes using Informatica to load data from Oracle, SQL Server, Flat Files, (Fixed Width), XML files and Excel files to target Teradata Database.
- Responsible for developing, support and maintenance for the ETL (Extract, Transform and Load) processes using Informatica Power Center 7.x and 8.x.
- Actively involved in Data Gathering, recognizing, and confirming the data sources/elements.
- Used ETL to load data from flat files into staging area and then to Data warehouse.
- Involved heavily in writing complex SQL queries based on the given requirements and used volatile tables, temporary tables, derived tables for breaking up complex queries into simpler queries.
- Implemented various Teradata specific features like selection of PI, USI/NUSI, PPI and Compression based on requirements.
- Implemented access rights mechanism using restricted views, macros and roles.
- Provide ongoing Teradata system performance management using Teradata manager and PMON.
- Reviewed and monitoring priority scheduler and TDQM settings.
- Gather information from different data warehouse systems and loaded into warehouse using FastLoad, FastExport, MultiLoad, BTEQ and UNIX shell scripts.
- Involved in unit testing, systems testing, integrated testing and user acceptance testing.
Environment: Teradata v13, Netezza, ETL tool, Informatica Powercenter 7.x/8.x, SQL Server, Oracle, Teradata Manager, BTEQ, Fast Export, Fast Load, Multi Load, Shell Scripting.
Confidential, Richmond, VA
Informatica Developer
Responsibilities:
- Source system evaluation, standardizing received data format, understanding business/data transformation rules, business structure and hierarchy, relationships, data transformation through mapping development, validation and testing of mappings.
- Developed logical & physical modeling as per business requirements using ERWIN.
- Performed requirement analysis and developed designing technical specifications for the data migration according to the business requirement.
- Developed complex ETL structures to extract, transform and load data from multiple data sources into data warehouse based on business requirements.
- Extensively worked with SCD Type I, Type-II and Type-III dimensions and data warehousing Change Data Capture (CDC).
- Created mapplets in place of mappings which were repeatedly used like formatting date or data type conversion.
- Ensured accurate, appropriate and effective use of data; including data definition, structure, documentation, long-range requirements, and operational guidelines.
- Monitored ETL process activity and utilization, with particular strengths in performance tuning highly transactional data integration package in both the development and production environments.
- Responsible for troubleshooting and resolving issues related to system performance, Informatica applications, and data integrity.
- Worked with SQL queries, created stored procedures, packages, triggers, views using PL/SQL Programming.
- Sourced data from Teradata to Oracle using Fast Export and Oracle SQL Loader.
- Created load scripts using Teradata Fast Load and Mload utilities and procedures in SQL Assistant.
- Worked with UNIX commands and used Unix shell scripting to automate jobs.
- Wrote Unix (korn shell scripts) to backup the log files in QA and production.
- Performed Unit and Integration testing and wrote test cases.
- Involved in taking repository backup and restoring it, starting and stopping Informatica services and worked with pmcmd commands.
- Extensively used prompts, filters, cascading prompts, calculations, conditional variables, multiple queries for data extraction in reports.
Environment: Informatica Power center 8.1, Informatica Power Exchange, Teradata, PL/SQL, SQL*Plus, SQL*Loader, Toad, UNIX, Windows XP, Erwin 4.0, Cognos 8.3.
Confidential
Informatica/ Teradata developer
Responsibilities:
- Involved in the Data warehouse data modeling based on the client requirements.
- Developed Logical and physical database designs for the transaction system.
- Responsible for configuring the Workflow manager, Repository Server Administration Console, Power Center Server, Database Connection.
- Performance tuning on sources, targets, mappings and SQL queries in the transformations.
- Created reusable transformations and Mapplets based on the business rules to ease the development.
- Used various Informatica Error handling technique to debug failed session.
- Development of scripts for loading the data into the base tables in using Fast Load, Multiplied and BTEQ utilities of Teradata.
- Involved heavily in writing complex SQL queries to pull the required information from Database using Teradata SQL Assistance.
- Done various optimization techniques in Aggregator, Lookup, and Joiner transformation.
- Developed mapping to implement type 2 slowly changing dimensions.
- Developed workflow tasks like reusable Email, Event wait, Timer, Command, Decision.
- Used various debugging techniques to debug the mappings.
- Created Materialized view for summary data to improve the query performance.
- Responsible for scheduling the workflow based on the nightly load.
- Supported Oracle 8i databases running mission critical 24*7 systems.
Environment: Teradata SQL Assistant, Oracle 8i, Informatica Power center 7.x/8.x, Workflow Manager, BTEQ, Fast Export, Fast Load, Multi Load, Shell Scripting.