Datastage Developer Resume
Southfield, MI
PROFESSIONAL SUMMARY:
- Around 8 years of experience with ETL Tool like IBM Infosphere Information Server .
- Good Knowledge on Datastage client components - Datastage Director, Datastage Manager, Datastage Designer and Datastage Administrator.
- Developed efficient jobs for data extraction/transformation/loading (ETL) from different sources to a target data warehouse.
- Strong Knowledge on Data warehousing Basics and relational database management Systems and Dimensional modeling (Star schema and Snowflake schema).
- Implemented Slowly Changing Dimension phenomenon while building Data Warehouses.
- Deep understanding of OLTP, OLAP and data warehousing environment and tuning both kind of systems for peak performance.
- Worked with DB2 Enterprise, Oracle Enterprise, Teradata, Mainframe sources, Flat files, and datasets operational sources.
- Experience in all stages of WebSphere Administration like installation, Configuration, Deployment, dScripting, Migration, and Trouble shooting on AIX 6.0/5.3/5.2, Red Hat Linux, SUSE Linux, Solaris 10/9/8, Windows 2003 Server Environments.
- Executing JCL program to extract files from mainframes.
- Strong knowledge of database querying using SQL and PL/SQL programming in Oracle and QMF in DB2 environments and use of Stored Procedures in Oracle PL/SQL.
- Experience in setting up WebSphere clusters, distributed sessions using session replication, HA Managers, WLM (Work Load Management), Core and Node groups.
- Exposure in designing and developing the Logical and physical model using Data modeling tool (ERWIN)
- Experience in using scheduling tools like Autosys,Control M.
- Experience in Integration of various data sources like DB2, Oracle, SQL Server, SAP BW, XML Files IIW Data model and EBCDIC files into a staging area. Very strong experience in writing Perl and shell scripts to automate and maintain the WebSphere and WebSphere Portal Server environments.
- Experience in working with parallel extender for splitting bulk data into subsets to distribute the data to all available processors to achieve best job performance.
- Experienced in Performance Tuning, Bug Fixing and Trouble Shooting of Data Stage Jobs.
- Experience in coordinating with offshore and offsite teams to resolve design, development and testing
- Issues.
- Worked on SQL scripts for applying few transformations and cleansing data.
- Responsible for creating all necessary documentation to build, administer, and support all DEV, TEST, QA and production WebSphere Environments.
- Work expertise in working with software vendors like IBM to troubleshoot any WebSphere
- Worked with stored procedures to insert and clean data into the data warehouse tables, fired triggers upon completion of load to obtain the log of all the tables loaded with job name and load date.
- Worked on UNIX shell scripts using Kshell for the Scheduling sessions, automation of processes, pre and post session scripts.
- Experience in web technologies like HTML and JavaScript.
- Ability to solve complex technical problems and have unique ability to understand long-term project development issues at all levels and interpersonal skills with strong desire to achieve specified goals within the given time frame.
TECHNICAL SKILLS:
Languages: C, C++, Unix Shell Programming/ PERL,, SQL, PL/SQL
Operating Systems: Unix, Windows, Aix (IBM)
Enterprise Servers & Middleware: IBMWebSphere Application Server
Databases and Database utilities: Oracle 11i,10g/9i/8i, SQL Server, DB2 UDB 9.5/9.1/8.1,Teradata,Toad,Sql Developer
Data Modeling Tools & Scheduling Tools: Erwin,Autosys,Control-M,Tivoli,Open Processor
PROFESSIONAL EXPERIENCE:
Confidential, Southfield, MI
Datastage Developer
Responsibilities:
- Developed ETL jobs to load data from Oracle, DB2, flat files to Target warehouse.
- Datastage was used to transform a variety of claims from different product platforms into standardized data mart.
- Implemented ICD-10 codes in the Datastage jobs.
- Optimized SQL Queries for better performance.
- Worked on Datastage 8.5 to develop the jobs and upgrading it to 11.3.
- Designed jobs using different parallel job stages such as Join, Merge, Lookup, Filter, Dataset, Lookup file Set, Remove Duplicates, Change Data Capture, Switch, Modify, and AggregatorUsed Datastage Director to execute the jobs.
- Modified existing codes and developed PL/SQL packages to perform Certain Specialized functions / enhancement on oracle application.
- Customer data load from flat files into Oracle tables using TOAD and PL/SQL procedures.
- Developed batch programs using UNIX shell scripts to generate reports daily, weekly & monthly for Customers.
- Coordinate the monthly implementation process. Maintain a consolidated implementation plan. Move source code to production servers. For WebSphere applications, review & edit deployment documents, create appropriate zip files packages and stage for production implementation.
- Invovlved in unit testing and SIT.
- Created ACES entries to deploy in production.
- Worked with Datastage Manager to export/import Datastage components.
- Experienced in developing test plans for data warehouse solutions.
Environment: Datstage 8.5(Director, Designer, Manager), Oracle, PL/SQL, IBM DB2, Open processor, TOAD, AIX, LINUX.
Confidential, Eden Prairie, MN
Datastage Developer
Responsibilities:
- Developed ETL jobs to load data from SQL Server, Oracle databases, flat files to Target warehouse.
- Datastage was used to transform a variety of Claim files from different product platforms into standardized data mart.
- Experience in generating and interpreting mapping documentation, and translating into detailed design specifications using ETL code.
- Optimized SQL Queries for maximum performance.
- Used Datastage Designer to develop the jobs.
- Developed processes to extract the source data from different sources, integrated and populated the extracts after cleansing, transforms and integrating.
- Worked with stages like Sequential file, hash file, Transformer, Aggregator, Sort,Lookup,Join and others.
- Used Datastage Director to execute the jobs.
- Modified existing codes and developed PL/SQL packages to perform Certain Specialized functions / enhancement on oracle application.
- Coded PL/SQL sub-programs and modified the existing PL/SQL program units for customer Contact Employees (CCE’s) relationships.
- Claims data load from flat files into Oracle tables using SQL*Loader and PL/SQL procedures.
- Involved in developing Datastage Designer Server and Parallel jobs for Extracting, Cleansing, Transforming, and Integrating/Loading Data into Corporate Data Warehouse (CDW).
- Implemented various strategies for Slowly Changing Dimensions using Datastage Server/Parallel jobs using the Frame Work approach
- Involved in Unit Testing and Integration Testing.
Environment: Datastage(8.7),Oracle,SQL Server,DB2,UNIX Shell Scripting,PL/SQL/,Windows NT/2000, PERL,IBM AIX 5.2, LINUX, Tivoli
Confidential, San Antonio, TX
Datastage Developer
Responsibilities:
- Developed ETL jobs to load data fromSql server, Oracle database and flat files to Target warehouse.
- Datastage8.5 was used to transform a variety of financial transaction files from different product platforms into standardized data mart.
- Created various PL/SQL Scripts involving Insert, Sequences, Constraint and Index scripts.
- Developed ETL jobs to load data from DB2 databases, Flat files and XML files to Target warehouse, and experience with high volume databases.
- Optimized SQL Queries for maximum performance.
- Proficient in writing Packages, Stored Procedures, Functions, Views and Database Triggers using SQL and PL/SQL in Oracle.
- Used Datastage Designer 8.5 to develop the jobs. Recently we are migrating the jobs from 7.5 to 8.5.
- Used Parallel Extender for parallel processing for improving performance when extracting the data from the sources.
- Provided infrastructure solutions for J2EE applications around IBM WebSphere Application Server, IBM HTTP Server, WebSphere ESB, WebSphere Process Server, IBM BPM and ODM and IBM MQSeries on Solaris and Linux platforms.
- Used Datastage Designer 8.5 to develop the jobs. Recently we migrated the jobs from 8.5 to 9.1.
- Involved in development of DataStage Jobs with required Transformations like Aggregator, Filter, Funnel Join, Lookup, Merge, Remove Duplicates, Surrogate Key Generator, Sort and Transformer.
- Designed and developed jobs using Datastage/Qualitystage for loading the data into Dimension and Fact Tables.
- Developed Job Sequences for automating and scheduling the Datastage Jobs in the Control - m.
- Experience in generating and interpreting mapping documentation, and translating into detailed design specifications using ETL code.
- Installed and configured DB2 on AIX.
- Extensively designed, developed and implemented Parallel Extender jobs using Parallel Processing (Pipeline and partition) techniques to improve job performance while working with bulk data sources.
- Used Datastage Director to execute the jobs.
- Experience transferring WebSphere Portal Server configuration data from CloudscapetoDB2andOracle databases using command line interface and configuration wizard.
- We used varicent tool to do the calculations.
- Involved in Unit Testing and Integration Testing.
- Worked with Datastage to migrate jobs from 7.5 to 8.5 and Datastage components.
- Involved in documenting the Frame Work Templates and the process of developing jobs using Templates.
- I was involved in the production support.
Environment: IBM Datastage 9.1/8.5 (Director, Designer),7.5, PL/SQL, IBM DB2, WebSphere ESB, IBM BPM 7.5/8.x, SQL Server, PERL, Varicent,Oracle, AIX 6.0, UNIX,BO, LINUX, Control - M.
Confidential, Addison, TX
Datastage Developer
Responsibilities:
- Involved with Business users and ETL Leads from different teams to implement ETL Frame Work using Datastage Server/Parallel combination of jobs.
- Extracted data from various sources like Oracle Database,XML, Flat Files, .CSV files and loaded to target warehouse.
- Used Column Analysis results to understand the hidden business rules, data types, data anomalies, cardinality and nullability.
- Responsible for Designing, development, testing and deployment of Oracle Alerts, Triggers. And Used Cron Jobs to schedule the jobs and Developed PL/SQL packages and database triggers.
- Coordinate with the front end design team to provide them with the necessary stored procedures and packages and the necessary insight into the data.
- Generated server side PL/SQL scripts for data manipulation and validation and materialized views for remote instances.
- Implemented various strategies for Slowly Changing Dimensions using Datastage Server/Parallel jobs using the Frame Work approach.
- Designed jobs using different parallel job stages such as Join, Merge, Lookup, Filter, Dataset, Lookup file Set, Remove Duplicates, Change Data Capture, Switch, Modify, and Aggregator.
- Involved in developing Datastage Designer Server and Parallel jobs for Extracting, Cleansing, Transforming, and Integrating/Loading Data into Corporate Data Warehouse (CDW).
- Extensively used Data Stage to load data from DB2 and Flat Files.
- Developed Job Sequences for automating and scheduling the Datastage Jobs.
- Extensively designed, developed and implemented Parallel Extender jobs using Parallel Processing (Pipeline and partition) techniques to improve job performance while working with bulk data sources.
- Developed processes on both Teradata and Oracle using shell scripting and RDBMS utilities such as Multi Load, Fast Load, Fast Export, BTEQ (Teradata ) and SQL * Plus, SQL * Loader (Oracle).
- Used Teradata Parallel Transporter to load data from various sources.
- Extensively used Datastage Director to Monitor and check the run statistics of the Jobs and to clear the job logs, job resources.
- Used DB2 EE stage for doing loads into DB2 UDB Database and to load large volumes of data into Teradata V2R4 using Teradata Fast Export, Multi Load.
- Configured Global Security for WebSphere console and assigned different roles to Developers and Admins.
- Extensively used Datastage Manager to Export/import Datastage components.
- Involved in Unit Testing for the jobs.
- Created Shell scripts for scheduling the Datastage jobs using wrappers.
- Used configuration management tools like Rational Clear Case/Clear Quest for version control and migration.
- Involved in documenting the Frame Work Templates and the process of developing jobs using Templates.
Environment: 8.1,Oracle 10g, WebSphere Process Server, Teradata, DB2, UNIX Shell Scripting, PL/SQL/,Windows NT/2000, PERL,Clear Case/Clear Quest, IBM AIX 5.2, LINUX, Autosys
Confidential
ETL Developer
Responsibilities:
- Involved in creating entity relational and dimensional relational data models using Data modeling tool Erwin.
- Designing the Target Schema definition and Extraction, Transformation and Loading (ETL) using Data stage.
- Mapping Data Items from Source Systems to the Target System.
- Used the Data stage Designer to develop processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse database.
- Worked on programs for scheduling Data loading and transformations using Data Stage from legacy system to Oracle 9i using SQL* Loader and PL/SQL.
- Designing and Developing PL/SQL Procedures, functions, and packages to create Summary tables.
- Used the Data Stage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions (on an ad hoc or scheduled basis).
- Worked with Datastage Manager for importing metadata from jobs, new job Categories and creating new data elements.
- Developing Shell Scripts to automate file manipulation and data loading procedures.
Environment: Datastage 7.5 (Manager, Designer, Director), ERWIN, Oracle 9i, PL/SQL, SQL* Loader, SQL Server 2000, Windows NT 4.0, UNIX.
