We provide IT Staff Augmentation Services!

Senior Datastage Engineer Resume

4.00/5 (Submit Your Rating)

Englewood, CO

SUMMARY

  • Highly motivated software professional with 8+ years of experience in analysis, design and development of applications using IBM Info Sphere DataStage and Java/J2EE Technologies and involved in all the phases of SDLC.
  • Over 6 years of experience in Data modeling, Datawarehouse Design, Development and Testing using ETL and Data Migration life cycle using IBM InfoSphere DataStage 11.x/9.x/8.x/7.x and around 6 years of experience in Java/J2EE applications.
  • Expertise in building Operational Data Store (ODS), Data Marts, and Decision Support Systems (DSS), Star and Snowflake schema design.
  • Experience in analyzing the data generated by the business process, defining the granularity, source to target mapping of the data elements, creating Indexes and Aggregate tables for the data warehouse design and development.
  • Data Processing experience in designing and implementing Data Mart applications, mainly transformation processes using ETL tool DataStage (Ver 11.3/9.1/8.0/7 ), designing and developing jobs using DataStage Designer, Data Stage Manager, DataStage Director and DataStage Debugger.
  • Efficient in all phases of the development lifecycle, coherent with Data Cleansing, Data Conversion, Performance Tuning and System Testing.
  • Excellent in using highly scalable parallel processing Infrastructure using DataStage Parallel Extender.
  • Extensive experience in developing Parallel/Server Jobs in DataStage to populate tables in Data warehouse and Data marts.
  • Proven track record in addressing production issues like performance tuning and enhancement.
  • Excellent knowledge in creating and managing Conceptual, Logical and Physical Data Models.
  • Experience in dimensional and relational database design.
  • Strong in Data warehousing concepts, dimensional Star Schema and Snowflakes Schema methodologies.
  • Expert in unit testing, system integration testing, implementation, maintenance and performance tuning.
  • Experience in different Scheduling tools like Control - M, IBM Tivoli Workload Scheduler for automating and scheduling jobs run.
  • Excellent with PL/SQL, T-SQL, Stored Procedures, Database Triggers and SQL * Loader.
  • Experience in UNIX Shell Scripting.
  • Excellent knowledge of operating systems Windows, UNIX, Linux and databases including Oracle, SQL Server, Teradata and DB2.
  • Extensive experience in Agile Methodologies.
  • Detail oriented with good problem solving, organizational, analysis, highly motivated and adaptive with the ability to grasp things quickly.
  • Ability to work effectively and efficiently in a team and individually with excellent interpersonal, technical and communication skills.
  • Extensive Domain Knowledge on Retail, Banking, Insurance and Healthcare.

TECHNICAL SKILLS

ETL Tools: IBM Infosphere Datastage 9.1/8.5/ 8.1/ 8.0.1/ 7.1 (Designer, Director, Manager, Administrator), Talend Open Studio for DI 5.6

BI Tools: Cognos 7.0/6.0, Business Objects XI/6.5/6.1/5.1

Databases: SQL Server, Oracle9i, IBM DB2 9.1, Teradata and Netezza

Languages: SQL, PL/SQL, Java, VB Script, JavaScript, UNIX Shell Script and Perl Script

Dimensional Data Modelling: Dimensional Data Modeling, Data Modeling, Star Schema, Snow-Flake Schema, FACT and Dimensions Tables, Physical and Logical Data Modeling, Erwin 4.0/3.x

Version Controller: CVS (Concurrent Versions System), IBM Rational Clear Case, RTC Client 4.0.5, TortoiseSVN

Job Scheduling Tools: Control-M, IBM Tivoli Workload Scheduler

Java/J2EE Technologies: Java 2, JSP, Servlets, EJB, JDBC, Tomcat 4.1, IBM WebSphere 6.0/7.0/8.0, IBM RSA 8.0

Operating Systems: Windows, MS DOS, IBM AIX and UNIX

PROFESSIONAL EXPERIENCE

Confidential, Englewood, CO

Senior DataStage Engineer

Responsibilities:

  • Extensively used Data Stage for extracting, transforming and loading databases from sources including Oracle, DB2 and Flat files.
  • Collaborated with EDW team in, High Level design documents for extract, transform, validate and load ETL process data dictionaries, Metadata descriptions, file layouts and flow diagrams.
  • Collaborated with EDW team in, Low Level design document for mapping the files from source to target and implementing business logic.
  • Generation of Surrogate Keys for the dimensions and fact tables for indexing and faster access of data in Data Warehouse.
  • Tuned transformations and jobs for Performance Enhancement.
  • Extracted data from flat files and then transformed according to the requirement and Loaded into target tables using various stages like sequential file, look up, Aggregator, Transformer, Join, Remove Duplicates, Change capture data, Sort, Column generators, Funnel and Oracle Enterprise.
  • Created Batches DS job controls and Sequences to control set of jobs.
  • Extensively used DataStage Change Data Capture for DB2 and Oracle files and employed change capture stage in parallel jobs.
  • Executed Pre and Post session commands on Source and Target database using Shell scripting.
  • Collaborated in design testing using HP Quality Center.
  • Utilized Parallelism through different partition methods to optimize performance in a large database environment.
  • Executed jobs through sequencer for better performance and easy maintenance.
  • Developed DS jobs to populate the data into staging and Data Mart.
  • Performed the Unit testing for jobs developed to ensure that it meets the requirements.
  • Developed UNIX shell scripts to automate file manipulation and data loading procedures.
  • Scheduled the jobs using Control M.
  • Responsible for daily verification that all scripts, downloads, and file copies were executed as planned, troubleshooting any steps that failed, and providing both immediate and long-term problem resolution.
  • Provided technical assistance and support to IT analysts and business community.
  • Involved in code migration and packaging using MKS tool.

Environment: IBM WebSphere DataStage 9.X and Qulality Stage 8.0.1a Administrator, Designer, Director, IBM Information Analyzer8.0.1a, Oracle 11g, Toad 9.5, Java, MS Access, SAP BW, DB2, SAP MDM, AS/400, shell scripts, PUTTY, WinSCP, ERWIN 4.0, HP Quality Center, control M, IBM MKS.

Confidential, Houston, TX

DataStage Consultant/ETL Consultant

Responsibilities:

  • Prepared Tech specs to design the Jobs according to the requirement Specification.
  • Extracting the Source Files, Oracle tables to Data Stage Environment.
  • Design of the Data Stage Jobs according to the User requirement.
  • Building, Testing the Data Stage Jobs.
  • Tuned transformations and jobs for Performance Enhancement.
  • Extracted data from flat files and then transformed according to the requirement and Loaded into target tables using various stages like sequential file, look up, Aggregator, Transformer, Join, Remove Duplicates, Change capture data, Sort, Column generators, Funnel and Oracle Enterprise.
  • Created Batches DS job controls and Sequences to control set of jobs.
  • Executed Pre and Post session commands on Source and Target database using Shell scripting.
  • Extensively used DataStage Change Data Capture for DB2 and Oracle files and employed change capture stage in parallel jobs.
  • Collaborated in design testing using HP Quality Center.
  • Utilized Parallelism through different partition methods to optimize performance in a large database environment.
  • Developed DS jobs to populate the data into staging and Data Mart.
  • Executed jobs through sequencer for better performance and easy maintenance.
  • Performed the Unit testing for jobs developed to ensure that it meets the requirements.
  • Scheduled the jobs using Control M.
  • Responsible for daily verification that all scripts, downloads, and file copies were executed as planned, troubleshooting any steps that failed, and providing both immediate and technical long-term problem resolution.
  • Involved in Unit Testing, System Integration Testing.
  • Uploaded Test Cases in QC

Environment: IBM WebSphere DataStage Enterprise Edition 7.5.2, DataStage Server Edition 7.5, ProfileStage 7.5, IBM DB2, Teradata, Toad 8.0, Microsoft SQL 2005, IBM 2094 - System z9, AIX,WinSCP FTP, Putty, Windows 2003, Mercury Center.

Confidential

DataStage Developer/ETL Developer

Responsibilities:

  • Participated in gathering the user requirements and involved in writing technical design documents.
  • Involved in the analysis, data modeling, detailed system design, development and technical documentation.
  • Developed ETL procedures to ensure conformity, compliance with standards and lack of redundancy, translated business rules and functionality requirements into ETL procedures using Data Stage.
  • Extensively used DataStage Designer to develop various jobs to extract, cleanse, transform, integrate and load data into data warehouse database.
  • Designed DataStage Parallel jobs involving complex business logic, update strategies, transformations, filters, lookups and necessary source-to-target data mappings to load the target.
  • Extensively worked on Job Sequences to Control the Execution of the job flow using various Activities & Triggers (Conditional and Unconditional) like Job Activity, wait for file, Email Notification, Sequencer, Exception handler activity and Execute Command.
  • Extensively used the Sequential File stage, Hashed File Stage, Modify, DataSet, Filter, Funnel, JOIN, Lookup, Copy, Aggregator, and Change Capture during ETL development.
  • Extensively used Built-in, Plug-in and Custom Stages for Extraction, transformation and loading of the data.
  • Used DataStage Director to Run and Monitor the Jobs for Performance Statistics.
  • Implemented logic for Slowly Changing Dimensions Type II by using Date methodology.
  • Involved in Performance Tuning of Parallel Jobs using Performance Statistics.
  • Extensively worked with database objects including tables, views, indexes, schemas, PL/SQL packages, stored procedures, functions, and triggers.
  • Working with the Tableau desktop, and tableau Server site for tableau BI reporting.
  • Responsible for the end-to-end implementation of tableau BI Phases.
  • Interacting with Product manager and Data quality analyst for gathering the business report requirements and various cross departmental users for the report requirements, clarifications and tableau end user report trainings
  • Developed UNIX Shell scripts to automate repetitive database processes and maintained shell scripts.
  • Involved in solving Production support issues.
  • Used Control M to schedule jobs.

Environment: IBM Information Server 8.0.1, IBM Information Analyzer 8.0, DataStage (Designer, Director and Administrator), Oracle 10g, DB2, SQL, PL/SQL, SQL* Loader, UNIX Shell Script, ERWIN 4.2, Win XP and AIX UNIX 4.2, Control M.

Confidential

PL/SQL & ETL Developer

Responsibilities:

  • Analyzed and Designed ETL processes for loading the data in to DW.
  • Identified / documented data sources and transformation rules required to populate and maintain data warehouse content.
  • Mapped the ETL process.
  • Created Data Stage Server jobs to load data from sequential files, Flat Files and MS Access.
  • Used Data Stage Manager for importing metadata from repository, new job categories and creating new data elements.
  • Used the Data Stage Designer to design and develop jobs for extracting, cleansing, transforming, integrating, and loading data into different Data Marts.
  • Prepared Data Volume estimates.
  • Defined the data definitions, and created the target tables in the database.
  • Wrote routines to schedule batch jobs to obtain data overnight from various locations.
  • Mapped the source and target databases by studying the specifications and analyzing the required transforms.
  • Troubleshoot jobs using the debugging tool.
  • Analyzed the performance of the jobs and project and enhance the performance using the standard techniques.
  • Standardized the Nomenclature used to define the same data by users from different business units.
  • Created job sequences and schedules for automation.
  • Used the Data Stage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions (on an ad hoc or scheduled basis).
  • Used Data Stage to transform the data to multiple stages, and prepared documentation.
  • Analyzed business functionalities and building the fundamental blocks.
  • Created ETL execution scripts for automating jobs.
  • Worked on writing routines to read parameters from hash file at runtime.
  • Unit tested the mappings to check for the expected results.
  • Documented the purpose of mapping so as to facilitate the personnel to understand the process and in corporate the changes as and when necessary.

Environment: Ascential Data Stage 7.5 (Designer, Director, Manager), Windows 2005/XP, UNIX, Oracle 10g, PL/SQL, and UNIX Flat Files.

We'd love your feedback!