Datastage Lead Resume
SUMMARY:
- Over 12 years of experience in Software Design, Development, Architecture, Enhancement Maintenance, Testing and troubleshooting with emphasis on Data Warehousing.
- Have an extensive experience in Datastage as a developer, designer, Project Lead and Solution Consultant in designing and developing, performance tuning of Extracting, Transferring and Loading (ETL) process.
- Worked as a consultant in providing Business Intelligence solutions in Data Warehousing for OLAP application, decision support systems, building Data Marts.
- Capable of Full life cycle initiative including doing analysis, design, cleanse, transform and Development of high performance ETL for very large - scale data sets.
- Implemented tuning the Ab Initio graphs and Database queries for Oracle and Teradata.
- Experience in Designing and populating Dimensional model (Star & Snowflake Schema) for Data warehouse and data marts and Reporting Data Sources.
- Experience with Mainframe COBOL files processing with CFF Stage.
- Experience in designing, developing, performance tuning, debugging, troubleshooting, and Monitoring ETL jobs using DataStage Designer, Director, Manager and Administrator.
- Strong knowledge of Extraction Transformation and Loading (ETL) processes using UNIX Shell scripting, PL/SQL and SQL Loader.
- Expertise in design and development of Database applications in Client/Server applications. Extensive experience in using RUP (Rational Unified Process) and Waterfall Models in
- Software Development Life Cycle (SDLC).
- Extensive experience in database programming using SQL and PL/SQL that includes stored Procedures, functions and Packages.
- Actively involved in data collection, group discussions and analysis, analyzed the functional flow of the projects and lead the team in database designing and maintenance
- Excellent interpersonal and communication skills.
TECHNICAL SKILLS:
Data Warehousing: Ascential DataStage 11.3/8.5/8.1/8.0 (IBM Web Sphere Data Stage/Info sphere DataStage) / 7.5/7.1/6.1/6.0/5.2 (Designer, Director, Manager, Administrator), Parallel Extender, Quality Stage, Audit Stage, Profile Stage & Meta Stage.
BI Tools: Business Objects XI (BOXI).
StarSchema Modeling, Snowflake: Schema Modeling, FACT and dimension tables, Pivot Tables, Erwin 3.x/4.x, Designer2000
RDBMS: Oracle 11i,10g,9i/8i/7.x, MS SQL Server 6.5/7.0, 2000, UDB DB2, Sybase, SQL Server 12.0/11.x, MS Access 7.0
Systems/Platforms: UNIX (IBM-AIX, Sun Solaris, HP-UX), Windows 98/NT/2000, and MS-DOS, Mainframe Cobol.
Programming: SQL, PL/SQL, Unix Shell Scripting (Korn shell, c shell, bash shell, bourne shell), C, C++.
Other Tools: SQL * Loader, BTEQ, FastLoad, TPump, TOAD, SQL Developer, SQL *Plus, PVCS, Harvest, Merant Dimensions, Test Director, AutoSys.
PROFESSIONAL EXPERIENCE:
Confidential
DataStage Lead
Responsibilities:
- Involved with different stake holders like Analysts, Testers and Business Users.
- Responsible to take the production operations calls on 24X7 on a rotation basis and resolving the issues.
- Based on the requirements from the users, developing the new jobs or enhancing the existed ones.
- Worked with the Unix scripting, which is an intermediate between Autosys and DataStage.
- Worked with Autosys/Operations for scheduling the jobs, Monitoring, putting the jobs ON ICE, ON HOLD, OFF ICE, OFF HOLD as needed.
- Taking the responsibility of bug fixings of the production failures.
- Worked with the Oracle SQL scripts, Analyzing the Oracle Tables.
- Worked with DataStage parameter sets.
- Worked with the DataStage Server edition and DataStage routines.
- Worked with DataStage Environmental variables.
- Used third party tool STAR for code migration from Dev to Test to Prod, which migrates to all 12 sites.
- Used IBM Clear-Quest for defect tracking.
- Worked with the Audit process for the enhancements or development.
Environment: Accentual DataStage 8.5/11.5 Designer, Director, Information Server Manager, UNIX, Shell Scripting, TOAD SQL Developer, SQL, PL/SQL, Windows XP, Autosys.
Confidential
Sr. DataStage Developer
Responsibilities:
- Involved in different phases of the project in different sub modules and worked with Business Analysts, Developers, Testers and Business Users.
- Created the Technical Specifications Documents for the requirements.
- Been responsible for Integration testing of the project modules.
- Co-ordinate the team members and update the project status in daily scrum meetings.
- Worked with the DataStage Parallel stages like Transformer, Join, Aggregator and Pivot.
- Created sequences to prioritize the jobs using Autosys JILs.
- Used the Rational Unified Process (RUP) and Safe Agile Methodologies
- Guided and helped other Team Members whenever needed technical help.
- Used Pivot Stage to do Horizontal Pivoting and Vertical Pivoting.
- Worked closely with the Business Analysts, Testers and End Users.
- Wrote Unix Shell Scripts to check for files and run the jobs and then archiving and deleting old files.
- Worked with Audit Process Automation.
- Used stage variables extensively in Transformer and Worked with Start and End loop stages in the Sequencer.
- Worked with the SQL scripts as part of the extraction, Truncating and Loading process.
- Created DataStage Parameter Sets.
Environment: Accentual DataStage 8.5/11.3 Designer, Director, Information Server Manager, UNIX, Shell Scripting, SQL Developer, SQL, PL/SQL, Windows XP, Autosys.
Confidential
DataStage Lead
Responsibilities:
- Involved in the requirements gathering from the End Users and Understand the business requirements.
- Distributed and assigned the requirements to developers based on the modules.
- Created the High-level design documentation and Technical Specifications Document as per the requirements.
- Been responsible for testing of the project modules.
- Co-ordinate the team members and update the project status in team meetings.
- Worked with the DataStage Parallel and Server Stages.
- Created sequences to prioritize the jobs using UNIX Scripts.
- Used the Rational Unified Process (RUP) methodology for developing this project.
- Guided and helped other Team Members in the Development Process.
- Used Aggregator Stage to do the summations of the amount fields.
- Worked closely with the Business Analysts, Testers and End Users.
- Developed a Master controlling sequencer using the UNIX Scripting which runs all other processes in that. And these processes will run the DataStage Jobs.
- Involved in Defining and designing the process for Extraction, Transformation and Reporting (ETL) Data from various source systems to Excel Sheets.
- Created the Best Practices document.
- Worked with the SQL scripts as part of the extraction process.
- Worked with Unix and Unix Scripting as part of the development.
- Worked with Information Server manager for creating Packages and migrating the Jobs.
Environment: Accentual DataStage 8.1/8.5 Designer, Director, Information Server Manager, UNIX, TOAD Oracle SQL, PL/SQL, Windows XP.
Confidential
DataStage Solution Consultant
Responsibilities:
- Involved in the requirements gathering and creation of the Technical Design Document.
- Managed a team of four developers.
- Divide the whole project into sub modules and assign each module to one developer.
- Created High level design documentation for the Project and each module.
- Co-ordinate between the Development, Testing and BA teams.
- Created the jobs as per the requirements using Transformer, Join, LookUp and Merge Stages.
- Used the Complex Flat File (CFF) stage to extract the Data from the Mainframe Cobol files.
- Worked with other Parallel Stages like Row Generator, Column Generator, Modify, Funnel, Filter, Switch and Remove Duplicates Stages extensively
- Created sequences to prioritize the jobs using Sequencer Stages.
- Used the Rational Unified Process(RUP) based on Unified Modeling Language(UML).
- Guided and helped the team members when and as required.
- Used Aggregator Stage to do the summations of the amount fields.
- Worked closely with the Business Analysts, Testers and End Users.
- Developed a Master controlling sequencer jobs using the DataStage Job Sequencer.
- Been a part of the performance team to improve the performance of the jobs across theProjects, and decrease the overall processing time to 60%.
- Involved in Defining and designing the process for Extraction, Transformation and Loading (ETL) Data from various source systems to Data warehouse.
- Created the Best Practices document.
- Worked with the SQL scripts as part of the extraction process.
- Worked with Unix and Unix Scripting as part of the development.
- Worked with the orchadmin command to view the data.
Environment: Ascential DataStage 8.1, Designer, Director, Unix, Quality Center(QC), Oracle SQL, PL/SQL, Vancouver Utilities, Windows XP.
Confidential
DataStage Lead
Responsibilities:
- Involved in design and development of server jobs, sequences using the Designer
- Involved in Defining and designing the process for Extraction, Transformation and Loading (ETL) Data from various source systems to Data warehouse.
- Interacted with architects and subject-matter experts to design comprehensive solutions.
- Coordinating an onsite and offshore team and leading an offshore team of five developers.
- Responsible for status updates in the client meetings.
- Worked with the data and the requirements to find out whether there are any gaps.
- Developed Mappings for ETL processes & Jobs.
- Designing and developing ETL - Jobs for Various Loads using DataStage tool.
- Designing and developing Master controlling sequencer jobs using the DataStage Job Sequencer.
- Used the DataStage Manager for importing, exporting and packaging DataStage jobs.
- Based on the volumes of the data used Join/Merge/Lookup Stages to replicate integration logic.
- Used Most of the Other Parallel Stages like Row Generator, Column Generator, Modify, Funnel, Filter, Switch, Complex Flat Files, Aggregator, Remove Duplicates and Transformer Stages etc extensively.
- Worked with the data to find out the integrity of the ETL process, like whether all the data that’s been extracted is being inserted or not.
Environment: Ascential Datastage 7.5, 8.0, SQL Server 2005, SQL Server Studio, IBM DB2, DB2 Control Center, Cognos, Windows NT.
Confidential, Warren, NJ
DataStage Developer
Responsibilities:
- Designed the mappings between sources (external files and databases) to Operational staging targets
- Involved in developing data marts for specific Business aspects like finance
- Used DataStage Manager for importing metadata from repository and new job categories
- Used the DataStage Designer to develop processes using various stages like Hash file (lookup), aggregate, transformer, sequential stages for extracting, clean, transforming, integrating, and loading data into data warehouse database.
- Developed parallel processing jobs on Orchestrate environment while using DataStage tool
- Distributed the data load to different available processors to speed up the job on Orchestrate environment.
- Have worked with Teradata utilities TPUMP, Fastload, BTeq, FastExport.
- Used CFF Stage to process Mainframe COBOL files.
- Used Sequential debugging in parallel programs on Orchestrate environment.
- Programming in PL/SQL on Oracle for proper analysis of the source and target data.
- Developed user defined Routines and Transformations by using Universe Basic.
- Used the DataStage Director and its run-time engine to schedule running the solution and monitoring the resulting executable versions (on an ad hoc or scheduled basis)
- Developing shell scripts to automate file manipulation and data loading procedures
Environment: Ascential DataStage 7.1, Orchestrate, Oracle 9i, Teradata, SQL, PL/SQL, SQL* Loader, Korn Shell Scripts, UNIX AIX and Windows NT 4.0
