Sr. Datastage Developer Resume
Chattanooga, TN
SUMMARY
- 8+ Years of IT experience with special emphasis on System Analysis, Design, Development, Testing and implementation of Data Warehousing, Data Integration and Data Migration using IBM Info sphere DataStage (IIS) v11.3 or 9.1 or 8.5.3 (Parallel), and its foundation tools such as Oracle 11g, PL/SQL, DB2, and Sequential Files and UNIX Shell Scripting.
- Extensive experience in developing strategies for Extraction, Transformation, loading (ETL) data from various sources into Data Warehouse and Data Marts using Accentual Data Stage client tools like DataStage Designer, DataStage Director and DataStage Administrator, Quality Stage, Information server and Parallel Extender.
- Experience with different flavors of RDBMS (DB2, Oracle, etc.).
- Good knowledge of Maintenance, enhance, and optimizing DataStage jobs.
- Strong knowledge of relational and dimensional database concepts.
- Expert in Data Warehousing techniques for Data Cleansing, Slowly Changing Dimension phenomenon (SCD), Surrogate key assignment and CDC (Change Data Capture).
- Strong understanding of the principles of DW using Fact Tables, Dimension Tables, Star and Snowflake schema modeling.
- Experience in using various stages like ODBC, Transformer, Sequential file, Hashed file, Join, Aggregator, Merge, Join, Lookup, sort, Copy, remove duplicate, Funnel, Filter, Pivot, Switch, Modify, Dataset, Oracle, DB2 Stage, shared containers, Teradata Stage (Multiload, Fast Load, Tpump) for developing jobs.
- Involved in complete Software Development life - cycle (SDLC) of various projects, including requirements gathering, system designing, data modeling, ETL.
- Worked and extracted data from various data sources such as Oracle, MS-SQL Server, MS- Access, Teradata, DB2, XML and Flat files.
- Experience in using Quality stage with investigate, standardize, match frequency and survive.
- Experienced in Extraction, Cleansing, Integration, and Loading of data from/to various data sources.
- Experience in Designing, Compiling, Testing, and Scheduling and Running Data Stage jobs.
- Knowledge in using PL/SQL to write stored procedures, functions, and triggers.
- Experience with developing both server and parallel jobs running on a UNIX platform against relational databases such as Oracle, SQL Server systems as source and target data environments.
- Designed Mapping documents ETL architecture documents and specifications.
- Excellent communication skills, Good organizational skills, Self-starter and motivated, hardworking, ability to work independently or cooperatively in a fast paced and challenging business environment, ability to learn new development environments quickly.
TECHNICAL SKILLS
ETL Tools: IBM Info Sphere / Web Sphere DataStage 8.5/8.1/ 7.5.2/7.1 (Administrator, Manager, Designer, Director, Orchestrate, Information Analyzer, Quality Stage)
Operating Systems: IBM AIX 4.3 and Windows NT 4.0/2000/2003/ XP, Windows 7.
Languages: PL/SQL, C/C++, UNIX (AIX, HP-UX) Shell scripting, Java.
Database: Oracle 11g/10g/9i/8i/, SQL Server 2000/2005/2008 , Teradata, UDB/DB2 on AIX.
Other: Cyber fusion, SQL Assistant, Pattern Action Language (PAL), Perl scripting, Control-M, AutoSys, SAP MDM 5.5/7.1, Management console, DataStageTrouble shooting, Data Issue resolution, batch monitoring, skill set
PROFESSIONAL EXPERIENCE
Confidential, Chattanooga, TN
Sr. DataStage Developer
Responsibilities:
- Worked with Business Analyst for requirements gathering, Logical Design, Physical Design model meetings to understand the data flow, frequency of data loads.
- Involved in Defined Best practice doc, Development standards doc forDataStageJobs.
- Extensive experience in handling and creating In-bound and Out-bound files from legacy systems.
- Designed IBM info sphere parallel jobs using stages such as Join, Merge, Lookup, Remove Duplicates, Copy, Filter, Funnel, Dataset, Lookup, Pivot, and Sort, Surrogate key Generator, Change Data Capture (CDC), Modify, Row Generator and Aggregator.
- Created complex sequencer to handle ABC (Audit Balancing Check) for 550 Database objects.
- Worked with Functional team and Data Modelers/Architects to identify and understand the data from different source systems.
- We using Quality stage with investigate, standardize, match frequency and survive.
- Handling of productionDataStagejobs using ESP Scheduler.
- Imported assets into the Information Server Repository usingMetadataasset manager.
- Extensively used Connector Migration Tool for conversion project.
- Involved inDataStage9.1 Prototype project.
- Used configuration management tools like ClearCase and Clear Quest for Version Control System.
Environment: IBM InfosphereDataStage 7.2/7.5/8.0/8.5/9.1/11.1 (Parallel Extender), Teradata 12.0/13.11, DB2 UDB/ZOS 8.x/7.x, BTEQ, TPT, SQL, Shell Scripts, Mainframe, ESP CA Work Station 11.3, IBM Rational (ClearQuest & ClearCase) 7.0, AIX 5.2/6.0, Windows XP
Confidential, San Francisco, CA
Sr. DataStage Developer
Responsibilities:
- Involved with Technical Business Analysts to understand the Business Requirement Specifications and implemented the ETL jobs using DataStage.
- Extensively used Datastage Designer to Develop the Parallel Jobs.
- Developed various Jobs using Designer stages like Join, Lookup, Transformer, Copy, Sort Remove duplicate, Sort, Filter, Aggregator, Funnel stages.
- Developed parameter driven ETL process to map source systems to Target data systems with DataStage complete source system profiling.
- Developed sequencers to control the job execution of the Datastage Jobs.
- Implemented various partition methods like Hash, Entire, Auto, db2.
- Dealt with various Database stages like DB2/UDB, ODBC.
- Extensively used SQL to Extract the Data from the History tables to improve the performance.
- Involved in developing the shell scripts to create indexes, Drop the indexes on the Tables, FTP Processes and enhanced the master script to run the master sequencer.
- Performed the Unit Testing for Jobs Developed to ensure that it meets the Requirements.
- Involved in migration of Datastage code to the Integration and Production, participated in Integration testing.
- Moved the ETL Jobs from Integration to Production.
Environment: IBM Data stage v 8.0.1, DB2/AIX64 9.5.4, Microsoft xp2002, IBM AIX 5.3, Db2 command editor.
Confidential, Oakland, CA
DataStage Developer
Responsibilities:
- Working with both onsite and offshore team of ETL Developers and ETL Analyst.
- Involving with business users for identifying, prioritizing & resolving numerous data issues, create ETL Project Plans, design and development
- Handling both development and support teams.
- Simplifying the environment by removing redundant objects.
- Automated the processes to reduce the manual efforts.
- Involved in data profiling and data model.
- Developed a complex SQL code to use in the common code approach to avoid writing several SQL scripts for different source table/file formats.
- Preparation of technical specification for the development of Extraction, Transformation and Loading (ETL) jobs to load data into various tables in Data marts.
- Worked with DataStage server stages like OCI, ODBC, Transformer, Hash file, Sequential file, Aggregator, Sort, Merge, Link Partitioner, Link collector, IPC and other stages.
- Implemented and hardcoded high performance DataStage routines.
- Imported the required Metadata from heterogeneous sources at the project level.
- Used Parallel stages like Lookup, Join and Merge stages for joining various information and also used Parallel Transformer, Column Generator, Funnel, Filter, Switch, Modify, Pivot, Row Generator.
- Used Parallel Extender Development/Debugging stages like Row generator, Column Generator, Head, Tail and Peek for debugging of the jobs.
- Performed debugging on these jobs using Peek stage by outputting the data to Job Log or a stage.
- Developed Job Sequencer to execute jobs in proper sequence. Also automated email messaging was implemented using Sequencer to notify the operations team of any data load issues such as job failure, dropped rows, rejected rows etc.
Environment: Windows 2008, IBM Data stage 8.5 Server/parallel/ 8.1/8.0/7.5/7.0 (Administrator Client, Manager, Designer Client, Director Client), Parallel Extender, Information Analyzer (IA), Oracle 11g, SQL Server 2008R2, SQL, and AIX/UNIX.
Confidential, San Antonio, TX
ETL DataStage Developer
Responsibilities:
- Expertise in designing and implementing DataStage Architecture in data warehousing and Business Intelligence projects.
- Worked with Functional team and Data Modelers/Architects to identify and understand the data from different source systems.
- Involved in the Analysis of the functional side of the project by interacting with functional experts to design and write technical specifications.
- Worked on the Architecture of ETL process.
- Created DataStage jobs (ETL Process) for populating the data into the Data warehouse constantly from different source systems like ODS, flat files, scheduled the same using DataStage Sequencer for SI testing.
- Extracted data from sources like Oracle and Flat Files.
- Preparing development timing plans & reporting to senior management about the supplier progress system & ensuring their engineering support for onsite integration & production launch.
- Working in a team with other associate product & component developers.
- Analyzing & Designing.
- Involved in Quality Assurance, Unit Testing and Integration Testing to test jobs and also the system process flow.
- Worked on changed requests as per clients and projects technical specification needs.
- Awareness about the functional/business aspects for the components.
- Automated process of job monitoring which helped in minimizing the manual intervention & documenting them perfectly.
- Provide support for monthly/weekly batches in production run.
- Involved in the Documentation of the ETL phase of the project.
- Developed the reusable components, best practices that were later on used in other Data warehouse.
Environment: Data Stage 9.X, DB2, Oracle 11g, UNIX, MICROSOFT VISIO, Control-M, SQL plus, Win CVS.
Confidential, Charlotte,NC
Datastage/ETL Analyst
Responsibilities:
- Part of design team and production Support team for the migration project.
- Part of a design team for design of STAR schema for data warehouse project.
- Interacted with the End users / Customers for Creating Mapping documents.
- Created Mapping documents for Migration project.
- Done extensive business analysis to analyze the source system and talking to the business groups to understand the reporting requirements.
- Designed the mapping documents between source databases and target databases.
- Designed and developed Customer mart and Sales mart using the data from the centralized data warehouse using top-down approach.
- Worked on critical Occurs and Redefines in the complex flat file structures.
- Done data analysis, quality analysis, and data loading.
- Developing processes for extracting, cleansing, transforming, integrating and loading data into databases.
- Created extract processes, analyzing the data, DB2 code to pull the required data.
- Developed many DataStage server jobs for data processing and loading of data.
- Developed Load jobs Oracle and DB2databases.
- Used TOAD tool for the analysis part.
- Used AutoSys for Scheduling of the Jobs.
Environment: IBM Info Sphere DataStage 8.5 (Manager, Designer, Director, Administrator), Oracle 10g, DB2 UDB, SQL, PL/SQL, Lotus Notes, Toad, SQL * Loader, UNIX, AutoSys, Windows XP/NT, Erwin 3.5
Confidential
SQL BI Consultant
Responsibilities:
- Created Queries in T-SQL, Stored Procedures, and Views to store the data of clients, advisors.
- Created User Defined Functions, Triggers to store data into appropriate tables as and when data arrives and created indexes to the tables that have least updates to improve the query performance.
- Used SSIS to migrate databases such as Excel files, flat files, Oracle Database and SQL Server database to centralized IT destination.
- Involved in requirement gathering and performed ETL Process.
- Implemented Triggers, Views, Clustered and Non-clustered indexing. Extensive work on the performance tuning of Oracle ETL process.
- Created tables needed for ETL processing and develop ETL framework.
- Implemented SSIS packages to Migrate data to staging server and then to production server
- Developed, Monitored and Deployed SSIS packages and successfully created dynamic configuration packages in SSIS.
- Following Data Warehousing methodologies and concepts, including Star schemas, snowflakes, dimensional modeling.
- Data migration from old databases and different databases to main database
- Based on the required reports, identified various data sources and established the connections using SSIS and constructed data source view during extraction of data.
- Developed Report Models using report builder and distributed reports in multiple formats using SQL Server Reporting Services (SSRS) in Business intelligence development studio (BIDS).
- Created many complex database code objects such as Stored Procedures/ views/ Functions and used them in Reports directly to generate reports on the fly.
- Report Design and Coding for Standard Tabular type reports, including Drill down and Drill through functionality, Charts and Dashboard type metrics.
- Worked as onsite coordinator, assign work and manage offshore team.
Environment: MS SQL Server 2008/2005, Microsoft TFS, SQL Server Integration Services (SSIS), SQL server Reporting Services (SSRS), Microsoft Visual Studio, Share Point, SQL Server Management Studio, MS Excel