We provide IT Staff Augmentation Services!

Sr. Datastage Developer Resume

5.00/5 (Submit Your Rating)

Dallas, TX

SUMMARY:

  • Sr. IBM InfoSphere Datastage developer with over 7 years of experience in Information technology in Design, Development, Administrator and
  • Implementation of various database and data warehouse technologies (IBM Datastage 9.x/8.x/7.x). Over 6 years of experience in writing complex SQL queries, PL/SQL and Unix.
  • Involved in complete SDLC (Software Development Life - Cycle) of various projects including requirement gathering, data modeling, development, production support, maintenance and performance tuning.
  • I have Knowledge and working experience in MTM
  • Worked extensively using Datastage Client components like Datastage Designer Director, Administrator and Manager in Data Warehouse ETL development.
  • Strong understanding in the principles of Data warehousing concepts and profound knowledge in using Fact Tables, Dimension Tables, Data Marts, star and snowflake schema modeling.
  • Strong knowledge of UNIX shell scripting (C, Bourne, Korn and Bash shell), on AIX, HP and C, C++, Pearl, Ruby and Python Programming.
  • Experienced in scheduling sequence, parallel and server jobs using DataStage Director, UNIX scripts and scheduling tools like Control M, Auto Sys, Tivoli and Corntab.
  • RDBMS experience with Oracle 11g/10g/9i/SQL Server, DB2 including database development, PL/SQL programming.
  • Developed parallel jobs using different processing stages like Transformer, Aggregator, Lookup, Join, Sort, Copy, Pivot, Merge, Funnel, CDC and Filter.
  • Experience in integration of various data sources like Oracle, DB2, SQL Server, MS Access, Sybase, Teradata, Informix, MS Excel and Flat files into the Staging Area.
  • Expert in Data Warehousing techniques for Data Cleansing, Slowly Changing Dimension phenomenon (SCD), surrogate key assignment.
  • Worked with UNIX shell scripting, FTP scripts and enhancing the job performance.
  • Created local and shared containers to facilitate ease and reuse of jobs.
  • Helped functional team in writing up of source to target mapping documents.
  • Good knowledge on reporting tools like, Business Objects, Cognos 7 and microstrategy.
  • Quick learner and adaptive to new and challenging technological environments.
  • Ability to work effectively and efficiently in a team and individually with professional conduct and excellent interpersonal and technical communication skillset.

TECHNICAL SKILLS:

ETL Tools: IBM InfoSphere / WebSphere Datastage 9.1/8.5/8.1/ 7.5 (Designer, Director, Administrator, Manager, and Quality Stage)

Operating Systems: Windows 7, Windows XP, UNIX, LINUX IBM AIX, HP-UX

Languages: C, UNIX Shell scripting, Java, SQL and PL/SQL

Reporting Tools: Crystal Reports 14.0, Cognos 8.x/7.x, Microstrategy and MS Access Reports.

Database: Oracle 11g/10g/9i/8i/, SQL Server 2000/2005/2008, Teradata R12, UDB/DB2.

Other: MQ, Message Broker, SQL Plus, SQL*Loader, SQL Developer, MS Word, MS Excel, MS PowerPoint, MS Project, Minitab, HTML, Putty, Win SCP.

PROFESSIONAL EXPERIENCE:

Confidential, Dallas, TX

Sr. Datastage Developer

Responsibilities:

  • Designed the ETL jobs using IBM Infosphere DataStage 8.5 to Extract, Transform and load the data into staging, ODS and EDW.
  • Designed and developed the ETL jobs using Parallel Edition, which distributed the incoming data concurrently across all the processors, to achieve the best performance.
  • Designed parallel jobs using stages such as Join, Merge, Lookup, Remove Duplicates, Copy, Filter, Funnel, Dataset, Lookup, Pivot, and Sort, Surrogate key Generator, Change Data Capture (CDC), Modify, Row Generator and Aggregator.
  • Responsible for preparing Physical/logical data models.
  • Responsible for data analysis, requirements gathering, report analysis, source-to-target mapping, frequency analysis, process flow diagrams, and documentation.
  • Handled Performance Tuning of Jobs to ensure faster Data Loads.
  • Designed sequence jobs using the activities such as Job Activity, Nested Condition, Notification Activity, Sequencer Activity, Terminator Activity and Execute Command.
  • Performed the Integration and System testing on the ETL jobs.
  • Responsible for preparing ad hoc jobs.
  • Translated business rules and functionality requirements into ETL derivations.
  • Scheduled jobs using Autosys scheduler utility based on the requirements and monitored the production processes closely for any possible errors.
  • Migrated projects from development to QA to Production environments.
  • Assisted operation support team for transactional data loads in developing SQL & UNIX scripts.
  • Scheduled the jobs using AutoSys.
  • Imported the required Metadata from heterogeneous sources at the process level.
  • Created Job Parameters and Environment variables to run the same job for different sources and targets.
  • Used Multi-job-compiler during deployment of projects.
  • Created Batches (DS job controls) and Sequences to control set of jobs.
  • Used the Director to schedule running the job, testing and debugging its components, and monitoring.
  • Created Shared Containers for Re-using the Business functionality.
  • Collaborated with BO team to design Crystal reporting and reports for enterprise reporting applications.
  • Worked with Developers to troubleshoot and resolve issues in job logic as well as performance.

Environment: IBM InfoSphere DataStage 9.1 (Administrator, Designer, Director), IBM Information Analyzer 8.1.1a, Microsoft SQL 2005/2008, IBM DB2 9.1, AIX6.0, Oracle 11g, Toad 9.5, Java, MS-Access, shell scripts, PUTTY, WinSCP, ERwin R8.1, HP Quality Center, AutoSys

Confidential, Cleveland, OH

Sr. Datastage Developer

Responsibilities:

  • Working with both onsite and offshore team of ETL Developers and ETL Analyst.
  • Involving with business users for identifying, prioritizing & resolving numerous data issues, create ETL Project Plans, design and development
  • Handling both development and support teams.
  • Creating new batches that utilized parallelism better (Multi Instance).
  • Simplifying the environment by removing redundant objects.
  • Automated the processes to reduce the manual efforts.
  • Involved in data profiling and data model.
  • Developed a complex SQL code to use in the common code approach to avoid writing several SQL scripts for different source table/file formats.
  • Preparation of technical specification for the development of Extraction, Transformation and Loading (ETL) jobs to load data into various tables in Data marts.
  • Worked with DataStage server stages like OCI, ODBC, Transformer, Hash file, Sequential file, Aggregator, Sort, Merge, Link Partitioner, Link collector, IPC and other stages.
  • Implemented and hardcoded high performance DataStage routines.
  • Imported the required Metadata from heterogeneous sources at the project level.
  • Used Parallel stages like Lookup, Join and Merge stages for joining various information and also used Parallel Transformer, Column Generator, Funnel, Filter, Switch, Modify, Pivot, Row Generator.
  • Used Parallel Extender Development/Debugging stages like Row generator, Column Generator, Head, Tail and Peek for debugging of the jobs.
  • Performed debugging on these jobs using Peek stage by outputting the data to Job Log or a stage.
  • Developed Job Sequencer to execute jobs in proper sequence. Also automated email messaging was implemented using Sequencer to notify the operations team of any data load issues such as job failure, dropped rows, rejected rows etc.

Environment: Windows 2008, IBM Data stage 8.5 Server/parallel/ 8.1/8.0/7.5/7.0 (Administrator Client, Manager, Designer Client, Director Client), Parallel Extender, Information Analyzer (IA), Oracle 11g, SQL Server 2008R2, SQL, and AIX/UNIX.

Confidential, Newark, NJ

Datastage Developer

Responsibilities:

  • Actively involved in Design and development of Extraction, Transformation and Loading Process.
  • Extensively used Information Analyzer Client to perform Database comparisons and OLTP analysis
  • Involved in dimensional modeling of the data mart to design the business process.
  • Worked with various Partitioning (Round-Robin, Hash fields, Entire, Same, modulus etc.) and Collection (Round-Robin, Ordered and Sorted Merge) techniques.
  • Symmetric Multi-Processing processors were used to accommodate partition parallelism.
  • Imported and Exported Jobs, table definitions, created custom transforms and routines.
  • Worked with IBM WebSphere Web Console client to configure WebSphere to the Console connection.
  • Worked with DataStage Director to run, schedule, monitor and view logs for jobs.
  • Developed various DataStage server and parallel jobs and Transformations to load data from relational and flat file sources into the data mart.
  • Created shared and local containers to simplify and modularize server job designs by replacing complex areas of the diagram with a single container stage.
  • Used various stages like lookup, aggregator, merge on the extracted source data according to the business rules and technical specifications.
  • Optimized the jobs and routines using various optimization techniques.
  • Involved in creating Technical Specification Document (TSD) for the project.
  • Performed debugging of some existing jobs using the Director to test and fix the errors.

Environment: IBM InfoSphere DataStage 8.5 (Administrator, Director, Designer), PL/SQL, Oracle 10g/9i, UNIX Shell scripts, Teradata, Flat files, SQL Developer

Confidential

Datastage Developer

Responsibilities:

  • Involved in understanding the scope of application, present schema, data model and defining relationship within and between the groups of data.
  • Interaction with the business users to better understand the requirements and document their expectations, handling the current process, modifying and created the jobs to the updated requirements, handle the load process to data mart and eventually data warehouse.
  • Used the Ascetical Data Stage 7.5 extensively to transfer and load data into the staging area and eventually into Warehouse.
  • Involved in Information Analysis.
  • Created Jobs to load the data into EDW from various subject areas as Target jobs.
  • Defined Stage variables for data validations and data filtering process.
  • Used Parallel Extender for Parallel Processing for improving performance when extracting the data from the sources.
  • Assisted with the design, implementation and support a multi-terabyte point-of-sale data warehouse, performing database design, implementation, and the creation and tuning of data aggregation mechanisms.
  • Used various Parallel Extender partitioning and collecting methods.
  • Extensively used the Sequential File Stage, Dataset Stage, File set Stage, Modify Stage, CDC, Look-up, transformation and other Database plug-ins and the stage provided by the Data Stage to perform transformation and load the data.
  • Performed Unit testing and System Integration testing by developing and documenting test cases in Quality Center.
  • Used Quality Stage stages such as Investigate, Standardize, Match and Survive for data quality and data profiling.
  • Created data quality standardization jobs using WebSphere Quality Stage.
  • Created DataStage jobs to meet business requirements.
  • Active involvement in Interfacing with the legacy teams as well as SAP business process teams for gathering the requirements for the work assign to me.
  • Designed Mappings between sources to operational staging targets, using Star Schema, Implemented logic to Slowly Changing Dimensions.
  • Designed a job template that provides the Environmental parameters for the subsequent use in the projects.
  • Extensively used Microsoft Visio for documentation and control m to schedule the jobs.
  • Implemented Debugging Methodologies with Break Point Options.

Environment: IBM Web Sphere Data Stage 7.5.2 EE (Parallel Extender, Designer, Manager, Administrator, Director), SAP, IBM UDB, Oracle 10g, SQl, PL/SQL, Control M

Confidential

 ETL Developer

Responsibilities:

  • Analyzed, conceptualized/designed the database that serves the purpose of proving critical business metrics.
  • Developed ETL procedures to ensure conformity, compliance with standards and lack of redundancy, translates business rules and functionality requirements into ETL procedures using Informatica - PowerMart.
  • Worked with ERwin tool in Data Modeling (both Physical and Logical Design).
  • Developed and documented data Mappings/Transformations, Audit procedures and Informatica sessions.
  • Assisted in the design and Maintenance of the Metadata environment.
  • Developed and tested all the backend programs, Informatica mappings and update processes.
  • Effectively managed the migration of the transformations/mappings from development to Production.
  • Developed various bulkload and update procedures and processes using SQL * Loader and PL/SQL.
  • Involved in the error checking and testing of the ETL procedures and programs of Informatica session log.

Environment: Informatica, Oracle 9i/10g, DB2, flat files, PL/ SQL, Windows 2003 Server, UNIX (Korn Scripts), and SQL* Loader, ERwin.


 

We'd love your feedback!