Sr. Datastage Developer Resume
4.00/5 (Submit Your Rating)
SUMMARY
- Seven + Years of IT experience with special emphasis on Development, Analysis and Design of ETL methodologies in all the phases of the Data warehousing life cycle with knowledge in ETL, Data warehousing & LDAP Technology.
- Designed and Prepared Mapping Documents for Source to Target mapping with ETL transformation rules.
- Installation, configuration, setup and Administration of DataStage Server.
- Experience in DataStage Administrator to create/modify/delete projects and cleanup projects and Implemented security among DataStage users and projects.
- Worked on parallel and server jobs using various stages like Join, Lookup, Change Capture, Filter, Funnel, Copy, Column generator, Peek, Dataset, Sequential file, Oracle Enterprise, DB2/UDB, Merge, Transformer, Aggregator, Remove duplicates stages
- Designed and developed jobs using DataStage Parallel Extender (also known as IBM Enterprise Edition) for splitting bulk data into subsets and to dynamically distribute data to all available nodes to achieve best job performance
- Excellent knowledge in extraction, cleansing and modification of data from/to various data sources, flat files and comma delimited files (.csv)
- Expert in requirement gathering, analysis and Data cleansing using Quality Stage (Investigate, Standardize, Cross Column Analysis).
- Strong knowledge in OLTP/OLAP systems, Normalized (OLTP), De - normalized models, dimensional strategies, surrogate key, star schema, snowflake schema.
- Good knowledge of dimensional modeling (star and snowflake schema) for data warehouses and data marts
- Experience in integration of various data sources like DB2, Oracle into staging area
- Used stage variables, constraints in DataStage jobs
- Strong experience on UNIX Shell Scripting to run DataStage jobs, to validate the audit log, to consolidate different source, to extract and load from multi system and to enhance the performance
- HTML, XML, JavaScript, Photoshop, Visual Basic 6, SQL/ PL SQL, ORACLE 9i, 10g, SQL Server 2005, C++, C, C#, LINUX, UNIX, and Microsoft Office Suite
TECHNICAL SKILLS
ETL Tools: IBM Info Sphere DataStage 8.x, (Designer, Director, Administrator), Ascential DataStage 7.5.2 Enterprise Edition (Designer, Director, Administrator, Manager)
Databases: Oracle 11g/10g/9i, DB2, SQL Server 2003/2005/2008 and Data Modelling OLTP, OLAP, Star & Snow-Flake schema Modeling, Fact and Dimensions, Physical and Logical Data Modeling
Languages: C, SQL, UNIX Shell scripting
Operating Systems: IBM AIX 5.3, Red Hat Linux, Windows 95/98/2000/XP /7/8 & Windows Server 2000/2003/2008/2012
PROFESSIONAL EXPERIENCE
Confidential
Sr. DataStage DeveloperResponsibilities:
- Loading Members related data for various applications into the DB2 Enterprise Data Warehouse. This involved, pulling in data from various source systems like Flat Files, Oracle, DB2 and loading the target to EDW data warehouse.
- Involved in design and development of parallel jobs using Datastage designer.
- Designed, developed and deployed DataStage jobs using various DataStage stages like Join, Transformer, Lookup, Aggregator, Funnel, Complex Flat File, Modify stage, Peek stage, Remove Duplicate Stage, Sort Stage.
- Involved in designing the simple to complex DataStage jobs.
- Involved in building the base fact tables, aggregate fact tables, dimension tables, Data mart tables, change requests and defect issues related to the Data Warehouse project.
- Involved in the technical development delivery strategy packages that include technical design, development and testing phase.
- Effectively used DataStage Manager to Import/Export projects from development server to production server and implemented Slowly Changing Dimension techniques.
- Created and executed SQL queries for validating transformation rules used in source to target mappings.
- Used the DataStage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions on a scheduled basis.
- Developed Job Sequences, job activities, execute commands, user variable activity and implemented logics for job sequence loops, recovery and restart.
- Identified performance bottlenecks and suggested improvements.
- Used Quality Stage to ensure consistency, removing data anomalies and spelling errors of the source
- Responsible for daily verification that all scripts, downloads, and file copies were executed as planned, troubleshooting any steps that failed, and providing both immediate and long-term problem resolution.
Confidential
Sr. DataStage Developer
Responsibilities:
- Developed DataStage jobs to extract, transform and load the data from source to target.
- Created Datastage environmental parameters for moving DataStage jobs from Development server to Test server and to Production server.
- Involved in Requirement gathering and preparation of Design Document.
- Collaborated with EDW (Enterprise Data Warehousing) team in High and Low Level design documentation to Extract, Transform, validate and Load ETL process data dictionaries, Metadata descriptions, file layouts and flow diagrams
- Loaded formatted, cleansed, summarized, aggregated and transformed data into Data Warehouse.
- Extracted data from MS SQL Server using Data Stage Standard ODBC stage.
- Designed and developed parallel jobs, server and sequence jobs using DataStage Designer. Developed DS jobs to populate the data into staging area and Data Mart.
- Extensively worked on Extraction of data from flat files, Transforming them according to the requirements and Loading them into target tables using various parallel stages like Join, Merge, Look up, Aggregator, Filter Dataset, Remove Duplicates, Change Data capture, Switch and Modify.
- Studied about the current system and Data Warehouse present.
- Generating Surrogate Keys for the dimensions and fact tables for indexing and faster access of data in Data Warehouse
- Unit testing and System Testing.
- Tuned Data Stage jobs for better performance.
Confidential
DataStage Developer
Responsibilities:
- Creating jobs for cleansing, transforming and loading data into warehouse.
- Understanding the Source System.
- Analyzed the business requirements and functional specifications
- Extracted data from oracle database and spreadsheets and staged into a single place and applied business logic to load them in the central oracle database
- Processing files coming from multiple source system
- Designed ETL jobs to identify and remove duplicate rows using remove duplicate stage.
- Extensively worked with surrogate key generator to generate warehouse keys before loading data into warehouse
- Involved in design and development of parallel jobs using DataStage designer
- Design and Development of DataStage ETL jobs using various stages like Aggregator, Join, Transformer, Sort, Merge, Filter and Lookup, Sequence, Modify, Peek etc.
- Used UNIX Shell Scripts for scheduling the jobs
- Frequent communication with the Team members and the business users
- Doing the Analysis & Bug fixing during the development