Sr. Datastage Developer Resume
Dallas, TX
SUMMARY
- Over Seven (7+) years of experience in Information technology in Design, Development, Administrator and Implementation of various database and data warehouse technologies (IBM DataStage 9.x/8.x/7.x). Over 6 years of experience in writing complex SQL queries, PL/SQL and UNIX.
- Involved in complete SDLC (Software Development Life - Cycle) of various projects including requirement gathering, data modeling, development, production support, maintenance and performance tuning.
- Worked extensively using DataStage Client components like DataStage Designer Director, Administrator and Manager in Data Warehouse ETL development.
- Strong understanding in teh principals of Data warehousing concepts and profound noledge in using Fact Tables, Dimension Tables, Data Marts, star and snowflake schema modeling.
- Strong noledge of UNIX shell scripting (C, Bourne, Korn and Bash shell), on AIX, HP and C, C++, Pearl, Ruby and Python Programming.
- Experienced in scheduling sequence, parallel and server jobs using DataStage Director, UNIX scripts and scheduling tools like Control M, Auto Sys, Tivoli and Crontab.
- RDBMS experience wif Oracle 11g/10g/9i/SQL Server, DB2 including database development, PL/SQL programming.
- Developed parallel jobs using different processing stages like Transformer, Aggregator, Lookup, Join, Sort, Copy, Pivot, Merge, Funnel, CDC and Filter.
- Experience in integration of various data sources like Oracle, DB2, SQL Server, MS Access, Sybase, Teradata, Informix, MS Excel and Flat files into teh Staging Area.
- Expert in Data Warehousing techniques for Data Cleansing, Slowly Changing Dimension phenomenon (SCD), surrogate key assignment.
- Worked wif UNIX shell scripting, FTP scripts and enhancing teh job performance.
- Created local and shared containers to facilitate ease and reuse of jobs.
- Helped functional team in writing up of source to target mapping documents.
- Good noledge on reporting tools like, Business Objects, Cognos 7 and MicroStrategy.
- Quick learner and adaptive to new and challenging technological environments.
- Ability to work effectively and efficiently in a team and individually wif professional conduct and excellent interpersonal and technical communication skillset.
TECHNICAL COMPETENCIES:
ETL Tools: IBM InfoSphere / WebSphere DataStage 9.1/8.5/8.1/ 7.5 (Designer, Director, Administrator, Manager, and Quality Stage)
Operating Systems: Windows 7, Windows XP, UNIX, LINUX IBM AIX, HP-UX
Languages: C, UNIX Shell scripting, Java, SQL and PL/SQL
Reporting Tools: Crystal Reports 14.0, Cognos 8.x/7.x, MicroStrategy and MS Access Reports
Database: Oracle 11g/10g/9i/8i/, SQL Server 2000/2005/2008, Teradata R12, UDB/DB2
Other: MQ, Message Broker, SQL Plus, SQL*Loader, SQL Developer, MS Word, MS Excel, MS PowerPoint, MS Project, Minitab, HTML, Putty, Win SCP
PROFESSIONAL EXPERIENCE:
Confidential, Dallas, TX
Sr. DataStage Developer
Roles & Responsibilities:
- Designed teh ETL jobs using IBM InfoSphere DataStage 8.5 to Extract, Transform and load teh data into staging, ODS and EDW.
- Designed and developed teh ETL jobs using Parallel Edition, which distributed teh incoming data concurrently across all teh processors, to achieve teh best performance.
- Designed parallel jobs using stages such as Join, Merge, Lookup, Remove Duplicates, Copy, Filter, Funnel, Dataset, Lookup, Pivot, and Sort, Surrogate key Generator, Change Data Capture (CDC), Modify, Row Generator and Aggregator.
- Responsible for preparing Physical/logical data models.
- Responsible for data analysis, requirements gathering, report analysis, source-to-target mapping, frequency analysis, process flow diagrams, and documentation.
- Handled Performance Tuning of Jobs to ensure faster Data Loads.
- Designed sequence jobs using teh activities such as Job Activity, Nested Condition, Notification Activity, Sequencer Activity, Terminator Activity and Execute Command.
- Performed teh Integration and System testing on teh ETL jobs.
- Responsible for preparing ad hoc jobs.
- Translated business rules and functionality requirements into ETL derivations.
- Scheduled jobs using AutoSys scheduler utility based on teh requirements and monitored teh production processes closely for any possible errors.
- Migrated projects from development to QA to Production environments.
- Assisted operation support team for transactional data loads in developing SQL & UNIX scripts.
- Scheduled teh jobs using AutoSys.
- Imported teh required Metadata from heterogeneous sources at teh process level.
- Created Job Parameters and Environment variables to run teh same job for different sources and targets.
- Used Multi-job-compiler during deployment of projects.
- Created Batches (DS job controls) and Sequences to control set of jobs.
- Used teh Director to schedule running teh job, testing and debugging its components, and monitoring.
- Created Shared Containers for Re-using teh Business functionality.
- Collaborated wif BO team to design Crystal reporting and reports for enterprise reporting applications.
- Worked wif Developers to troubleshoot and resolve issues in job logic as well as performance.
Environment: IBM InfoSphere DataStage 9.1 (Administrator, Designer, Director), IBM Information Analyzer 8.1.1a, Microsoft SQL 2005/2008, IBM DB2 9.1, AIX6.0, Oracle 11g, Toad 9.5, Java, MS-Access, shell scripts, PUTTY, WinSCP, ERwin R8.1, HP Quality Center, AutoSys
Confidential, Cleveland, OH
Sr. DataStage Developer
Roles & Responsibilities:
- Working wif both onsite and offshore team of ETL Developers and ETL Analyst.
- Involving wif business users for identifying, prioritizing & resolving numerous data issues, create ETL Project Plans, design and development
- Handling both development and support teams.
- Creating new batches dat utilized parallelism better (Multi Instance).
- Simplifying teh environment by removing redundant objects.
- Automated teh processes to reduce teh manual efforts.
- Involved in data profiling and data model.
- Developed a complex SQL code to use in teh common code approach to avoid writing several SQL scripts for different source table/file formats.
- Preparation of technical specification for teh development of Extraction, Transformation and Loading (ETL) jobs to load data into various tables in Data marts.
- Worked wif DataStage server stages like OCI, ODBC, Transformer, Hash file, Sequential file, Aggregator, Sort, Merge, Link Partitioner, Link collector, IPC and other stages.
- Implemented and hardcoded high performance DataStage routines.
- Imported teh required Metadata from heterogeneous sources at teh project level.
- Used Parallel stages like Lookup, Join and Merge stages for joining various information and also used Parallel Transformer, Column Generator, Funnel, Filter, Switch, Modify, Pivot, Row Generator.
- Used Parallel Extender Development/Debugging stages like Row generator, Column Generator, Head, Tail and Peek for debugging of teh jobs.
- Performed debugging on these jobs using Peek stage by outputting teh data to Job Log or a stage.
- Developed Job Sequencer to execute jobs in proper sequence. Also automated email messaging was implemented using Sequencer to notify teh operations team of any data load issues such as job failure, dropped rows, rejected rows etc.
Environment: Windows 2008, IBM Data stage 8.5 Server/parallel/8.1/8.0/7.5/7.0 (Administrator Client, Manager, Designer Client, Director Client), Parallel Extender, Information Analyzer (IA), Oracle 11g, SQL Server 2008R2, SQL, and AIX/UNIX
Confidential, Newark, NJ
DataStage Developer
Responsibilities:
- Actively involved in Design and development of Extraction, Transformation and Loading Process.
- Extensively used Information Analyzer Client to perform Database comparisons and OLTP analysis
- Involved in dimensional modeling of teh data mart to design teh business process.
- Worked wif various Partitioning (Round-Robin, Hash fields, Entire, Same, modulus etc.) and Collection (Round-Robin, Ordered and Sorted Merge) techniques.
- Symmetric Multi-Processing processors were used to accommodate partition parallelism.
- Imported and Exported Jobs, table definitions, created custom transforms and routines.
- Worked wif IBM WebSphere Web Console client to configure WebSphere to teh Console connection.
- Worked wif DataStage Director to run, schedule, monitor and view logs for jobs.
- Developed various DataStage server and parallel jobs and Transformations to load data from relational and flat file sources into teh data mart.
- Created shared and local containers to simplify and modularize server job designs by replacing complex areas of teh diagram wif a single container stage.
- Used various stages like lookup, aggregator, and merge on teh extracted source data according to teh business rules and technical specifications.
- Optimized teh jobs and routines using various optimization techniques.
- Involved in creating Technical Specification Document (TSD) for teh project.
- Performed debugging of some existing jobs using teh Director to test and fix teh errors.
Environment: IBM InfoSphere DataStage 8.5 (Administrator, Director, Designer), PL/SQL, Oracle 10g/9i, UNIX Shell scripts, Teradata, Flat files, SQL Developer
Confidential, New Britain, CT
DataStage Developer
Responsibilities:
- Involved in understanding teh scope of application, present schema, data model and defining relationship wifin and between teh groups of data.
- Interaction wif teh business users to better understand teh requirements and document their expectations, handling teh current process, modifying and created teh jobs to teh updated requirements, handle teh load process to data mart and eventually data warehouse.
- Used teh Ascetical Data Stage 7.5 extensively to transfer and load data into teh staging area and eventually into Warehouse.
- Involved in Information Analysis.
- Created Jobs to load teh data into EDW from various subject areas as Target jobs.
- Defined Stage variables for data validations and data filtering process.
- Used Parallel Extender for Parallel Processing for improving performance when extracting teh data from teh sources.
- Assisted wif teh design, implementation and support a multi-terabyte point-of-sale data warehouse, performing database design, implementation, and teh creation and tuning of data aggregation mechanisms.
- Used various Parallel Extender partitioning and collecting methods.
- Extensively used teh Sequential File Stage, Dataset Stage, File set Stage, Modify Stage, CDC, Look-up, transformation and other Database plug-ins and teh stage provided by teh Data Stage to perform transformation and load teh data.
- Performed Unit testing and System Integration testing by developing and documenting test cases in Quality Center.
- Used Quality Stage stages such as Investigate, Standardize, Match and Survive for data quality and data profiling.
- Created data quality standardization jobs using WebSphere Quality Stage.
- Created DataStage jobs to meet business requirements.
- Active involvement in Interfacing wif teh legacy teams as well as SAP business process teams for gathering teh requirements for teh work assign to me.
- Designed Mappings between sources to operational staging targets, using Star Schema, Implemented logic to Slowly Changing Dimensions.
- Designed a job template dat provides teh Environmental parameters for teh subsequent use in teh projects.
- Extensively used Microsoft Visio for documentation and control m to schedule teh jobs.
- Implemented Debugging Methodologies wif Break Point Options.
Environment: IBM Web Sphere Data Stage 7.5.2 EE (Parallel Extender, Designer, Manager, Administrator, Director), SAP, IBM UDB, Oracle 10g, SQL, PL/SQL, Control M
Confidential
ETL Developer
Roles & Responsibilities:
- Analyzed, conceptualized/designed teh database dat serves teh purpose of proving critical business metrics.
- Developed ETL procedures to ensure conformity, compliance wif standards and lack of redundancy, translates business rules and functionality requirements into ETL procedures using Informatica - PowerMart.
- Worked wif ERwin tool in Data Modeling (both Physical and Logical Design).
- Developed and documented data Mappings/Transformations, Audit procedures and Informatica sessions.
- Assisted in teh design and Maintenance of teh Metadata environment.
- Developed and tested all teh backend programs, Informatica mappings and update processes.
- Effectively managed teh migration of teh transformations/mappings from development to Production.
- Developed various bulk load and update procedures and processes using SQL * Loader and PL/SQL.
- Involved in teh error checking and testing of teh ETL procedures and programs of Informatica session log.
Environment: Informatica, Oracle 9i/10g, DB2, flat files, PL/ SQL, Windows 2003 Server, UNIX (Korn Scripts), and SQL* Loader, ERwin
