Datastage Developer Resume
Peoria, IL
SUMMARY
- Around 7 years of experience in IT industry especially in client/server architecture and Business Intelligence (BI) /Enterprise Data warehouse (EDW) analysis, design, development, Testing and implementation.
- Over 5 years of Strong design/development/Testing experience with DataStage, OLAP tools and Data Warehousing (DW).
- Worked with Data Stage Server and Parallel Jobs of DataStage 8.5/8.1/7.5/7.1.
- Involved in all the phases of the SDLC - requirement gathering, design, and development.
- Expertise in Relational Database Modeling and Dimensional Modeling-Star schema, Snow-Flake schema, and hands on experience in data modeling tools Erwin / ER Studio.
- Very good understanding of Kimball and Inmon Methodologies.
- Experienced in troubleshooting DataStage jobs, enhancement of jobs and addressing production issues like performance tuning and enhancement.
- Optimized DataStage jobs utilizing partitioning and pipelining parallelism features of Parallel Extender jobs.
- Experience in designing Batch Jobs and Job Sequences for scheduling server and parallel jobs using DataStage Director, UNIX scripts, Autosys, UC4.
- Experience in programming using SQL, PL/SQL, and UNIX Shell Scripting.
- Extensive experience in Microsoft SQL Server 2005/2000, IBM DB2 UDB 8.0/7.0, Informix,TeraData, Oracle 10g/9i/8i., XML files and Message Queues.
- Worked with Teradata Loadutilitieslike MultiLoad, FastLoad,BTEQ, And Fast Export.
- Knowledge on designing and developing reports using BI/OLAP tools like Business Objects and OBIEE.
- Involved in Documentation of ETL processes following the best practices and standard naming conventions used in DataStage.
- Extensively used parallel extender Joins, Merges, lookups and sorts, Modify, switch, row generator, column generator, funnel, pivot, copy stages etc. for the development of DataStage Jobs.
- Performed Debugging, Troubleshooting, Monitoring and Performance Tuning for DataStage Jobs (server and parallel).
- Excellent communication and interpersonal skills, teamwork, problem solving skills, flexible, self-direct and energetic person.
- Experience in DataStage Administrator to create/modify/delete projects, add DSN entries and cleanup projects and implemented security among DataStage users and projects.
TECHNICAL SKILLS
ETL Tools: IBM Information Server 8.7/8.5/8.1/8.0.1 , Ascential DataStage 7.5.x/7.x, Informatica Power Center 8.6.1, Information Analyzer.
Data Modeling Tools: ER Studio, Microsoft Visio Professional.
BI/ OLAP Tools: Business Objects XI, OBIEE.
Databases and Tools: Oracle11g,10g/9i/8.x/7.x, SQL Server 2005/2000, DB2, MDM, Informix, Teradata, DB Visualizer,TOAD.
Operating Systems: Microsoft Windows 2003 Server XP/2000/98/95, UNIX(AIX/HP/Solaris).
Languages: SQL, PL/SQL, Unix Shell scripting/C++, Java.
Networking: FTP, SFTP, Telnet.
PROFESSIONAL EXPERIENCE
Confidential, Peoria, IL
DataStage Developer
Responsibilities:
- Designed and developed ETL jobs using IBM Infosphere Datastage 8.7 to extract, transform and load the data into SAP.
- Extensively used ABAP Extract and IDOC load stages for extracting and loading data from/to SAP R/3 repository.
- Used the Datastage Administrator for SAP to define the connection between datastage and SAP also to initialize and set up IDOC types for a new SAP Client
- Worked with the existing jobs to convert them into the GRID environment where they can be run in parallel.
- Achieved the performance tuning of datastage jobs by utilizing the grid implementation.
- (by creating a dynamic config file at run-time)
- Developed Job Sequencers with restart capability for the designed jobs using Job
- Activity, Exec Command, E-Mail Notification Activities and Triggers.
- Used import and export inbuilt designer functionalities to migrate the datastage jobs.
- Performed unit testing of Datastage jobs.
- Loaded the Data into SAP R/3 using various programs like LSMW, Z-tran and Datastage.
- Reviewed the functional specifications (CDD) and created the High-level design documents and technical design documents as per the specifications provided.
- Worked closely with various teams in various geographical locations.
- Worked on Information Analyzer to generate the Business Rule Reports and built Business logics.
Environment: IBM Information Server 8.7/8.5 (DataStage and QualityStageand Information Analyzer), IBM DB2 v9.x, IBM Information Server PACK for SAP, Information Analyzer, AIX, HP Quality centre,PL/SQL Developer, Windows XP.
Confidential, Lansing, MI
DataStage Developer
Responsibilities:
- Involved in understanding the scope of application, present schema, data model and defining relationship within and between groups of data.
- Extensively used Lookup, Join, Merge stages for joining various information and also used Parallel Transformer, Column Generator, Funnel, Filter, Switch, Modify, Pivot, Row Generator from various database DB2 Enterprise, Oracle Enterprise.
- Written SQL and PLSQL procedures to facilitate coding.
- Worked extensively on UNIX shell scripting.
- Worked extensively on DataStage Enterprise Edition 8.0.1
- Involved in loading Deal decision and Deal Processing data in Data warehouse. This required various complex data transformations, with the involvement of number of tables.
- Participated in source to target mapping design document, prepared system requirement documents based on data model and source target mapping documents.
- Optimized Query Performance, Session Performance and Reliability.
- Experience working with Connect Direct processes, FTP, SCP scripts for Transferring files between Servers and Legacy systems.
- Created interfaces for SQL data access to corporate level operations codes used as dimensions in the Data Warehouse
- Scheduled ETL processes to avoid Conflicts both at Resource utilization level, Database lock issues and to avoid Datastage contention issues
- Performed the Unit testing for jobs developed to ensure that it meets the requirements
- Responsible for Planning UAT Testing.
Environment: IBM Information Server WebSphere Information Server 8.5/8.0.1 (DataStage and QualityStage Designer, Director, Administrator), Oracle 10g,Crystal Reports, Java J2EE, Teradata V2R4, IBM AIX4.3, Erwin 4.1, IBM AIX4.3, AUTOSYS, Clear Case, Toad, PL/SQL Developer, Windows XP.
Confidential, Roanoke, VA
DataStage Developer
Responsibilities:
- Extensively worked on designing the ETL process and creating source to target mapping.
- Extensively worked on applying server and client patches for Salesforce.com PACK.
- Worked with DB2 DBA team building replicated dimensions.
- Extensively used DataStage Director to run, schedule, monitor and reset DataStage and QualityStage jobs.
- Extensively used parallel extender Joins, Merges, lookups and sorts, Modify, switch, row generator, column generator, funnel, pivot, copy stages etc. for the development of DataStage Jobs.
- Performed Debugging, Troubleshooting, Monitoring and Performance Tuning for DataStage Jobs (server and parallel).
- Worked on Change capture stage and Slowly Changing Dimension (SCD) stage.
- Extensively worked on customizing Salesforce Object Query Language (SOQL) to extract data from SFDC.
- Extensively worked on customizing SQL and created truncate and run stats scripts and used in before and after job routines.
- Processed Sales and transaction counts to identify a primary store for commercial customers.
- Extensively used MQConnectorStage, XML Stage,CFF Stages
- Used XML Input stage to parse the XML messages and transform the business rules. Designed various jobs to meet the audit requirements.
- Worked on Autosys to schedule DataStage jobs, UNIX scripts.
Environment: IBM Information Server WebSphere Information Server 8.5/8.0.1 (DataStage and QualityStage Designer, Director, Administrator), IBM DB2 v9.x, Oracle 10g,IBM Information Server PACK for Salesforce.com (SFDC), Salesforce Object Query Language (SOQL), AIX 5.3,Toad, PLSQL Developer, Windows XP.
Confidential, NJ
ETL Developer
Responsibilities:
- As a Data Warehousing team member, Involved in designing, developing and testing of the ETL (Extract, Transformation and Load) strategy to populate the Insurance Data from various source systems feeds into Client Hub Database using Datastage Transformers, Routines and Unix Shell scripts.
- Involved in CDI/MDM Data Profiling, Data Extraction, Staging, Transformation, Pre-Landing, and Landing into Client Hub Database and worked with DB2 Application Integration.
- Developed various DataStage jobs using Teradata Enterprise Stage, TDMLoad, Oracle Enterprise Stage, Sequential file, RTI stage, XML Input and XML Transformer stages
- Imported metadata from Teradata schemas using DataStage Manager.
- Extensively used Data stage Director for Job Scheduling, emailing production support for troubleshooting from LOG files.
- Involved in performance tuning of the ETL process and performed the data warehouse testing.
- Designed server jobs for migrating data from staging area to warehouse to data marts.
- Extensively worked in writing SQL Queries (Sub queries and Join conditions, correlated sub queries).
- Used the Data stage Designer to develop various jobs processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse database. Used Version Control for DataStage to track the changes made to the DataStage project components and for protecting jobs by making read only.
- Performing Unit Testing and integration testing.
- Extensively used SQL Loader to load Oracle database.
- Defined test scripts, test specs & testing methodologies.
- Modified existing Autosys jobs for scheduling the DataStage jobs with new parameters.
Environment: DataStage (Designer, Manger, Directory and Administrator) 7.5.2 Enterprise Edition, ProfileStage (Later known as Information Analyzer), QualityStage, Mainframe DB2, Teradata V2R6, Cognos Reportnet, Cognos 8 BI, XML plug-in, Version Control, Autosys, Oracle 8i, PL/SQL, SQL Server, DB2, JAVA, HP-UNIX and Windows NT.
Confidential, Foothill Ranch, CA
DataStage Developer
Responsibilities:
- Designed and customized data models for Data warehouse supporting data from multiple sources on real time.
- Developed and designed Data marts extensively using Star Schema.
- Project Life Cycle - from analysis to production implementation, with emphasis on identifying the source and source data validation, developing particular logic and transformation as per the requirement and creating jobs and loading the data into different targets.
- Designed, developed Data Stage jobs, enabling the extract, transport and loading of the data into target tables.
- Wrote the Design documents and specifications in accordance with Confidential ’s design frameworks and best practices.
- Defined the Mapping and Test Case documents.
- Extensively analyzed the Data Sources in identifying data anomalies, patterns, value ranges.
- Used Data Stage Enterprise Edition/Parallel Extender stages namely Datasets, Sort, Lookup, Peek, Standardization, Row Generator stages, Remove Duplicates, Filter, External Filter, Aggregator, Funnel, Modify, and Column Export in accomplishing the ETL Coding.
- Developed Data Stage job sequences used the User Activity Variables, Job Activity; Wait for File stages, Execute Command, Loop Activity, and Terminate.
- Wrote Extensive Unix scripts for running the Data Stage jobs, validating data.
- Tuned Data Stage jobs to enhance their performance.
- Involved in writing, testing and implementation of the triggers at Database level using PL/SQL.
- Wrote Release notes, Deployment documents and scheduled the jobs.
- Wrote DDL scripts for creating, altering tables.
Environment: Data Stage 7.5.1 Enterprise Edition/Parallel Extender, Flat files, Oracle10g/9i, Erwin 4.0, PL/SQL, UNIX Shell Programming, and Windows NT.
Confidential
ETL/Database Developer
Responsibilities:
- To study the business functions and flow control with various levels of users.
- Responsible for designing the database based on the entities, attributes and the relationship between them and for creating database tables, views, and indexes.
- Involved in Coding and Testing the Software. Was also involved in Creating Database and Users.
- Completed performance tuning of database and application, optimization of queries and wrote database triggers, package procedures and functions.
- Creating the table and writing the Database Triggers and stored procedures in Oracle and design the module using power Builder.
- Developed complex reports using Reports 3.0 and PL/SQL.
- Prepared Data Volume estimates.
- Defined the data definitions, and created the target tables in the database.
- Mapped the source and target databases by studying the specifications and analyzing the required transforms.
- The mappings were Unit tested to check for the expected results.
Environment: Oracle 7.1, Developer/2000 (Forms 4.5, Reports 2.5),ETL Informatica Concepts, PL/SQL, and SQL*plus, Windows NT, UNIX.