We provide IT Staff Augmentation Services!

Senior Datastage(etl) And Teradata Developer Resume

2.00/5 (Submit Your Rating)

San Antonio, TexaS

SUMMARY

  • Over 11 Plus years of Software Development experience in IT industry with strong knowledge in Application support, Design, Development and Testing of ETL methodologies in all phases of teh Data Warehousing Applications.
  • Extensive Experience on Teradata database, analyzing business needs of clients, developing effective and efficient solutions, and ensuring client deliverables with in committed timelines.
  • Strong hands - on experience using Teradata utilities (SQL, B-TEQ, Visual Explain), Teradata parallel support and Unix Shell scripting.
  • Proficient in coding of optimized Teradata batch processing scripts for data transformation, aggregation and load using BTEQ
  • Worked on Data stage Development for almost 6 plus years and involved in Designing Data stage Sequencer jobs, Parallel Jobs, Unix Scripts, Scheduling teh Jobs through teh schedulers and written SQL Procedures for source to target Data validations.
  • Worked on IBM Infosphere Information Server (IIS) 8.x/9.1,11.5,11.7
  • Worked on Onsite/Offshore Model and Handled a Team in Offshore and provided day to day Updates.
  • Worked on Data stage Development projects which included Migration of DataStage 9.1 to Data stage 11.5, Conversion of Legacy system to a new system and Compensation related projects.
  • Worked on HADOOP Hive
  • Worked on Data stage upgrades which includes DataStage 9.1 to DataStage 11.5
  • Writing Teradata SQL queries to join or any modifications in teh table.
  • Integration of Teradata using Teradata connectors.
  • Integration of HDFS, Hive using DataStage 11.5,11.7
  • Integration of Teradata using Teradata connectors.
  • Excellent experience in Data Stage (server and parallel Extender), Quality Stage, SQL, Oracle.
  • Implemented complex ETL requirement using IIS DataStage Designer
  • Implemented QualityStage for Data Cleansing & Data Standardization process.
  • Extensively used Information Analyzer to perform column analysis, primary key, foreign key analysis, writing data definition and data rules.
  • Worked on Information governance catalog to generate business lineage and data lineage.
  • Working experience in all phases of ETL Development Life cycle, ETL design methodology for Data warehousing and Business Intelligence reporting system.
  • Strong Knowledge of Data warehousing concepts, Relational Database Management Systems and Dimensional modeling (Star schema and Snowflake schema).
  • Incorporated various data sources like Oracle, Teradata, DB2, XML, Sequential files, Flat files into staging area.
  • Developed efficient mappings for data extraction/transformation/loading (ETL) from different sources to a target data warehouse.
  • Deep understanding of OLTP and data warehousing environments and tuning both kinds of systems for peak performance.
  • Experienced in new enhancements in teh IBM Infosphere DataStage - Surrogate key generator Stage.
  • Solid experience in writing complex SQL scripts for applying few transformations and cleansing data. Written stored procedure to clean and insert teh data into teh data warehouse tables, fired triggers upon completion of load to obtain teh log of all teh tables loaded with job name and load date. .
  • Pervasive knowledge of IT industry awareness with Insurance.
  • Ability to solve complex technical problems and assimilate information rapidly.
  • Ability to work under time constraints and strong problem solving skills.
  • Experience using automation tools such as Control M for scheduling Jobs.
  • Skilled in unit testing, system integration testing and user acceptance testing.
  • Excellent exposure on Software Development Life Cycle (SDLC) and Onshore/Offshore model.
  • Extensive use of Varicent Tool for teh Compensation Calculations.
  • Experience in building a very large data warehouse with many complex transformations, with many sources and targets.
  • Extracted data from various sources like Oracle, DB2, flat files, SQL Server, Mainframes, UDB (EEE), and loaded into DB2 databases.
  • Experienced in UNIX shell scripting.
  • Worked in Mainframe applications
  • Provided support for Data stage and informatica Applications.
  • Developed E3 Extensive Reusable Framework which supports Datastage and informatica applications.

TECHNICAL SKILLS

ETL Tools: IBM Infosphere Information Server 8.x/9.x,11x, Quality Stage, Information Analyzer, IBM Governance catalog

OLAP Tools: Varicent 7.0, IBM ICM Cognos 8.0

RDBMS: Oracle 10g/9i/8i, MS SQL Server 2008 MS Access, DB2, MySQL, Hadoop (Hive), Teradata

Programming Languages: SQL, PL/SQL, UNIX Shell Scripting, Cobol, JCL, CICS, PL1

Other Tools: Control-M, RTC, RDZ, Endeavor, Change-man, File Aid, File Master, BMC

Operating Systems: Windows 95/98/2000/XP/Vista/7, AIX/ Linux 7.x/6.x, ZOS

PROFESSIONAL EXPERIENCE

Confidential

Senior DataStage(ETL) and Teradata Developer

Responsibilities:

  • Use IBM infosphere Data stage to design Extraction, Transformation, Load (ETL) Jobs to outline teh proposed solution.
  • Designing teh ETL jobs using various stages such as Sequential file, Merge, Funnel, Filter, Copy, Peek, Modify, Compare, Teradata, Aggregator and Transformer Stages
  • Identify Methods for improving performance in ETL Design and Development
  • Analyze identify and recommend ways to improve quality of data from sources using IBM Infosphere Data stage and Quality Stage.
  • Automation Scheduling and performance tuning of existing Mappings/jobs
  • Analysis and implementation of enhancements to data in data warehouse.
  • Determine Feasibility of a requested program change/Functionality and determine impact of Modification.
  • Monitor Database performance, Support Application users
  • Analyze source systems to determine required transformations.
  • Perform address profiling using QualityStage and obtain address coordinates using Geolocator.

Environment: DataStage11.5, Teradata, Windows Batch Scripts, Quality Stage.

Confidential

Senior DataStage (ETL) and Database Developer

Responsibilities:

  • Participated in project planning sessions with project managers, business analysts and team members to analyze business requirements and outline teh proposed solution.
  • Designing teh ETL jobs using IBM Infosphere DataStage 11.5 to Extract high volume data from legacy systems, Transform and load teh data into Staging and tan into Database after conversion.
  • Involved in control-m jobs scheduling, flow analysis, task creation, monitoring, troubleshooting and agent installation.
  • Extensively used teh Designer, Director, Administrator and Manager to develop various parallel jobs/sequences to extract, transform, integrate, and load teh data into Data warehouse.
  • Extracted teh data from teh mainframe applications, which is teh hierarchy file system by using teh DB2 stage, designed parallel jobs using stages such as Join, Merge, Lookup, Remove Duplicates, Copy, Filter, Funnel, Dataset, Lookup, Pivot, and Sort, Surrogate key Generator, Change Data Capture (CDC), Modify, Row Generator and Aggregator.
  • Handled Performance Tuning of Jobs to ensure faster Data Loads, extensively worked with Shared Containers for Re-using teh Business functionality and write complex transformation algorithms.
  • Created Job Parameters and Environment variables to run teh same job for different schemas.
  • Used to do code reviews for all teh jobs before moving to production.
  • Assisted operation support team for transactional data loads in developing SQL & UNIX scripts, participated in Unit testing and Integration testing of DataStage jobs.
  • Involved in writing PL SQL complex queries, validation scripts, stored procedure, cursor, and trigger for ETL requirements.
  • Preparing unit test scripts, technical Design document, STM (Source to Target Mapping) for DataStage development.
  • Involved in all DataStage admin tasks, patch installation and configuring IBM Infosphere enterprise edition software in workstation.

Environment: - ToolsDataStage11.5, DB2, PL SQL, Control- M, UNIX, SeniorDataStage(ETL) and Database Developer

Confidential, San Antonio, Texas

Developer/Team Lead

Responsibilities:

  • Worked with Confidential Business teams to understand requirements of legacy system of HR - PeopleSoft.
  • Handled an offshore team and provided updates on Daily Basis.
  • Designed DataStage jobs and created teh dependencies based on teh functionality and scheduled teh jobs from control M
  • Writing Teradata SQL queries to join or any modifications in teh table.
  • Designing teh ETL jobs using IBM Infosphere DataStage 11.5 to Extract high volume data from legacy systems, Transform and load teh data into Staging and tan into Database after conversion.
  • Involved in control-m jobs scheduling, flow analysis, task creation, monitoring, troubleshooting and agent installation.
  • Extensively used teh Designer, Director, Administrator and Manager to develop various parallel jobs/sequences to extract, transform, integrate, and load teh data into Data warehouse.
  • Integration of HDFS, Hive using DataStage 11.5
  • Worked as one of teh developers in onsite for teh migration effort of existing People soft system to teh Prosed Workday.
  • Validated teh current production data, Current source systems, existing data and teh programming logic involved.
  • Proficiency in working with different data bases - Oracle, Teradata, My Sql, DB2 and Sql Server.
  • Design and build QualityStage jobs to standardize and cleanse data.
  • Analyzing teh Scope of teh effort and documenting teh Technical Requirements.
  • Preparing Low Level Design of teh Components as per teh requirement.
  • Preparation of Analysis and Design Documents.
  • Identified all data sources and size of teh data load, analysed data and responsible in identifying data mapping rules.
  • Imported metadata using IMAM.
  • Performed data profiling and write data definition and data rule based on profiling results.
  • Design and build QualityStage jobs to standardize and cleanse data.
  • Worked with business to tie data rule to corresponding IBM IGC business rule and generate data lineage report.
  • Experience in implementing Slowly Changing Dimensions SCD Type 1 & SCD Type 2

Environment: IIS DataStage 11.5, Netezza, HDFS, Hive, XML, Information Governance Catalogue (IGC), Information Analyzer (IA), Quality Stage, Teradata

Confidential, San Antonio, Texas

Developer

Responsibilities:

  • Worked with Confidential Business teams to understand teh current process of compensation calculations for Wealth Management.
  • Used teh Data Stage Designer to debug processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse database and teh process of loading data into Data-mart.
  • Provide support to perform user acceptance testing and functional validation of variable pay compensation engine.
  • Handled errors using Exception Handling extensively for teh ease of debugging and displaying teh error messages in teh application.
  • Provided application support on weekly basis on shifts.
  • Validated teh current production data, existing data and teh programming logic involved.
  • Analyzing teh Scope of teh effort and documenting teh Business Requirements.
  • Experience in debugging ETL jobs to check in for teh errors and warnings associated with each Job run.
  • Preparing High Level Design and Low-Level Design of teh Components as per teh requirement.
  • Preparation of Analysis and Design Documents.
  • Identified all data sources and size of teh data load, analysed data and Responsible in identifying data mapping rules.
  • Responsible in debugging Ticketing issues in teh production phase.
  • Provided production support and performed enhancement on existing multiple projects.
  • Worked as an onsite lead handling offshore team and provided application support on 24*7 Basis.

Confidential, San Antonio, Texas

Developer

Responsibilities:

  • Coding of new programs as per client’s specifications & creating test data for unit testing.
  • Modifying existing programs to new standards & unit testing of developed programs.
  • Review of teh coded programs to ensure that they meet teh requirements and standards.
  • Studying teh data dependencies using Metadata and preparing teh test cases.
  • Defining data types, Constraints, Indexes, generated Schema in teh Database, created automated scripts, defined storage parameters for teh objects in teh Database.
  • Creating teh implementation plan for teh production.
  • Developed several jobs to improve performance by reducing runtime using different partitioning techniques.
  • Used Information Analyzer to gather and analyze teh technical metadata characteristics of teh data.
  • Used Data Stage Director for validating, execution, monitoring jobs and check teh log files for errors.
  • Used stage variables for source validations, to capture rejects and used Job Parameters for Automation of jobs.
  • Preparation of Technical specification, Low Level Design Document (LLD) for teh development of DataStage Extraction, Transformation and Loading (ETL) mappings to load data into various tables and defining ETL standards.
  • Creating Project Level Parameter Sets.
  • Used Data Stage Designer for importing metadata into repository, for importing and exporting jobs into different projects.
  • Used UNIX shell script to kick off teh Data stage jobs.
  • Performed unit testing of all monitoring jobs manually and monitored teh data to see whether teh data is matched.
  • Creating teh saved imports, calculations, and reports at various level of data aggregations.
  • Scheduled teh jobs through scheduler in Varicent.
  • Worked extensively with Varicent manage User/ manage roles options.
  • Used teh audit logs extensively for auditing purpose.
  • Used teh DataStage Director and teh runtime engine to schedule running teh solution, testing, and debugging its components and monitoring teh resulting executable versions.
  • Use ODBC stage to do Extraction/loading/Lookup/manipulating of data.
  • Used several stages in Sequencer like Abort Job, Wait for Job and Mail Notification stages to build an overall main Sequencer and to accomplish Re-start ability.

Confidential, San Antonio, Texas

Developer

Responsibilities:

  • Analyzing teh Business Requirements and documenting teh System Requirements.
  • Preparing High Level Design and Low-Level Design of teh Components as per teh requirement.
  • Coordination with offshore team to understand teh requirements.
  • Preparation of Minutes of Meeting documents and list teh action items.
  • Preparation of Analysis and Design Documents.
  • Reviewing teh Components which were developed by offshore team.
  • Code Review with teh Data Infrastructure Team and M&P Team.
  • Ensuring that user requirements are effectively and accurately communicated to teh other members of teh development team and facilitate communication between business users, developers, and testing teams.
  • Release process for teh Code check in and Code Migration in different environments.
  • Scheduling teh Jobs in teh Control-M.
  • Supporting teh Quality Assurance Team.
  • Supporting teh M&P Team during teh Project Warranty/Implementation periods.
  • Supporting teh Business Team during teh Production Validation.
  • Fixing teh code right away if there are any production defects.
  • Provided Application support (Level 2).
  • Developing ETL jobs as per teh design.
  • Working on teh value additions for teh project.
  • Developing teh Control M flow for teh ETL jobs developed.

We'd love your feedback!