Senior Datastage Developer Resume
Newport News, VA
SUMMARY
- Around 8 years of experience with ETL Tool like IBM Infosphere Information Server .
- Good Knowledge on Datastage client components - Datastage Director, Datastage Manager, Datastage Designer and Datastage Administrator.
- Developed efficient jobs for data extraction/transformation/loading (ETL) from different sources to a target data warehouse.
- Strong Knowledge on Data warehousing Basics and relational database management Systems and Dimensional modeling (Star schema and Snowflake schema).
- Implemented Slowly Changing Dimension phenomenon while building Data Warehouses.
- Deep understanding of OLTP, OLAP and data warehousing environment and tuning both kind of systems for peak performance.
- Worked with DB2 Enterprise, Oracle Enterprise, Teradata, Mainframe sources, Flat files, and datasets operational sources.
- Executing JCL program to extract files from mainframes.
- Strong knowledge of database querying using SQL and PL/SQL programming in Oracle and QMF in DB2 environments and use of Stored Procedures in Oracle PL/SQL.
- Experience in setting up WebSphere clusters, distributed sessions using session replication, HA Managers, WLM (Work Load Management), Core and Node groups.
- Exposure in designing and developing teh Logical and physical model using Data modeling tool (ERWIN)
- Experience in using scheduling tools like Autosys,Control M.
- Experience in Integration of various data sources like DB2, Oracle, SQL Server, SAP BW, XML Files IIW Data model and EBCDIC files into a staging area. Very strong experience in writing Perl and shell scripts to automate and maintain teh WebSphere and WebSphere Portal Server environments.
- Experience in working withparallel extenderforsplitting bulkdata into subsets to distribute teh data to all available processors to achievebest job performance.
- Experienced in Performance Tuning, Bug Fixing and Trouble Shooting of Data Stage Jobs.
- Experience in coordinating with offshore and offsite teams to resolve design, development and testing
- Issues.
- Worked on SQL scripts for applying few transformations and cleansing data.
- Responsible for creating all necessary documentation to build, administer, and support all DEV, TEST, QA and production WebSphere Environments.
- Work expertise in working with software vendors like IBM to troubleshoot any WebSphere
- Worked with stored procedures to insert and clean data into teh data warehouse tables, fired triggers upon completion of load to obtain teh log of all teh tables loaded with job name and load date.
- Worked on UNIX shell scripts using Kshell for teh Scheduling sessions, automation of processes, pre and post session scripts.
- Experience in web technologies like HTML and JavaScript.
- Ability to solve complex technical problems and has unique ability to understand long-term project development issues at all levels and interpersonal skills with strong desire to achieve specified goals within teh given time frame.
TECHNICAL SKILLS
Languages: C, C++, Unix Shell Programming/ PERL,, SQL, PL/SQL
Operating Systems: Unix, Windows, Aix (IBM)
Enterprise Servers & Middleware: IBMWebSphere Application Server
Databases and Database utilities: Oracle 11i,10g/9i/8i, SQL Server, DB2 UDB 9.5/9.1/8.1,Teradata,Toad,Sql Developer
Data Modeling Tools & Scheduling Tools: Erwin,Autosys,Control-M,Tivoli,Open Processor
PROFESSIONAL EXPERIENCE
Confidential, Newport News,VA
Senior Datastage Developer
Responsibilities:
- Involved in teh analysis, implementation, support of software dat meet business requirements analyze user requirements, procedures and prepare technical design documents
- Developed ETL jobs to load data from Oracle to Target warehouse(NETEZZA)
- Used 9.1 to develop teh jobs.
- Develop ETL jobs to load data from Enterprise data warehouse to Data mart, Used DS parallel extender’s ability to design teh DS objects to run efficiently using optimal resources.
- Used Environment Variables, Project parameters, job parameters, apt config file, Stage Variables and Routines for developing Parameter Driven Jobs.
- Understanding teh existing rules of analyzing risk and develop a strategy (ETL) to reduce false positives
- Designed jobs using different parallel job stages such as Join, Merge, Lookup, Filter, Dataset, Lookup file Set, Remove Duplicates, Change Data Capture,Switch,Modify, and Aggregator.
- Optimized SQL Queries for better performance
- Invovlved in unit testing and SIT.
- Worked on Code Promotions and support teh deployment activities.
- Used Autosys to create teh batch jobs.
Environment: IBM Infosphere Datastage 9.1,UNIX,Shell Scripting,Oracle,Netezza,Aginity,Toad,Autosys,Cognos.
Confidential, Southfield, MI
Datastage Developer
Responsibilities:
- Developed ETL jobs to load data from Oracle, DB2, flat files to Target warehouse.
- Datastage was used to transform a variety of claims from different product platforms into standardized data mart.
- Implemented ICD-10 codes in teh Datastage jobs.
- Optimized SQL Queries for better performance.
- Worked on Datastage 8.5 to develop teh jobs and upgrading it to 11.3.
- Designed jobs using different parallel job stages such as Join, Merge, Lookup, Filter, Dataset, Lookup file Set, Remove Duplicates, Change Data Capture,Switch,Modify, and AggregatorUsed Datastage Director to execute teh jobs.
- Modified existing codes and developed PL/SQL packages to perform Certain Specialized functions / enhancement on oracle application.
- Customer data load from flat files into Oracle tables using TOAD and PL/SQL procedures.
- Developed batch programs using UNIX shell scripts to generate reports daily, weekly & monthly for Customers.
- Coordinate teh monthly implementation process. Maintain a consolidated implementation plan. Move source code to production servers. For WebSphere applications, review & edit deployment documents, create appropriate zip files packages and stage for production implementation.
- Invovlved in unit testing and SIT.
- Created ACES entries to deploy in production.
- Worked with Datastage Manager to export/import Datastage components.
- Experienced in developing test plans for data warehouse solutions.
Environment: Datastage 8.5(Director, Designer, Manager), Oracle, PL/SQL, IBM DB2, Open processor, TOAD, AIX, LINUX
Confidential, Eden Prairie,MN
Datastage Developer
Responsibilities:
- Developed ETL jobs to load data from SQL Server, Oracle databases, flat files to Target warehouse.
- Datastage was used to transform a variety of Claim files from different product platforms into standardized data mart.
- Experience in generating and interpreting mapping documentation, and translating into detailed design specifications using ETL code.
- Optimized SQL Queries for maximum performance.
- Used Datastage Designer to develop teh jobs.
- Developed processes to extract teh source data from different sources, integrated and populated teh extracts after cleansing, transforms and integrating.
- Worked with stages like Sequential file, hash file, Transformer, Aggregator, Sort,Lookup,Join and others.
- Used Datastage Director to execute teh jobs.
- Modified existing codes and developed PL/SQL packages to perform Certain Specialized functions / enhancement on oracle application.
- Coded PL/SQL sub-programs and modified teh existing PL/SQL program units for customer Contact Employees (CCE’s) relationships.
- Claims data load from flat files into Oracle tables using SQL*Loader and PL/SQL procedures.
- Involved in developingDatastage Designer Server and Parallel jobs for Extracting, Cleansing, Transforming, and Integrating/Loading Data into Corporate Data Warehouse (CDW).
- Implemented various strategies forSlowly Changing Dimensionsusing Datastage Server/Parallel jobs using teh Frame Work approach
- Involved in Unit Testing and Integration Testing.
Environment: Datastage(8.7),Oracle, SQL Server,DB2,UNIX Shell Scripting, PL/SQL/,Windows NT/2000, PERL,IBM AIX 5.2, LINUX, Tivoli
Confidential, San Antonio, TX
Datastage Developer
Responsibilities:
- Developed ETL jobs to load data fromSql server, Oracle database and flat files to Target warehouse.
- Datastage8.5 was used to transform a variety of financial transaction files from different product platforms into standardized data mart.
- Created various PL/SQL Scripts involving Insert, Sequences, Constraint and Index scripts.
- Developed ETL jobs to load data from DB2 databases, Flat files and XML files to Target warehouse, and experience with high volume databases.
- Optimized SQL Queries for maximum performance.
- Proficient in writing Packages, Stored Procedures, Functions, Views and Database Triggers using SQL and PL/SQL in Oracle.
- Used Datastage Designer 8.5 to develop teh jobs. Recently we are migrating teh jobs from 7.5 to 8.5.
- Used Parallel Extender for parallel processing for improving performance when extracting teh data from teh sources.
- Provided infrastructure solutions for J2EE applications around IBM WebSphere Application Server, IBM HTTP Server, WebSphere ESB, WebSphere Process Server, IBM BPM and ODM and IBM MQSeries on Solaris and Linux platforms.
- Used Datastage Designer 8.5 to develop teh jobs. Recently we migrated teh jobs from 8.5 to 9.1.
- Involved in development of DataStage Jobs with required Transformations like Aggregator, Filter, Funnel Join, Lookup, Merge, Remove Duplicates, Surrogate Key Generator, Sort and Transformer.
- Designed and developed jobs using Datastage/Qualitystage for loading teh data into Dimension and Fact Tables.
- Developed Job Sequences for automating and scheduling teh Datastage Jobs in teh Control - m.
- Experience in generating and interpreting mapping documentation, and translating into detailed design specifications using ETL code.
- Installed and configured DB2 on AIX.
- Extensively designed, developed and implementedParallel Extenderjobs usingParallel Processing (Pipeline and partition)techniques to improve job performance while working with bulk data sources.
- Used Datastage Director to execute teh jobs.
- Experience transferring WebSphere Portal Server configuration data from CloudscapetoDB2andOracle databases using command line interface and configuration wizard.
- We used varicent tool to do teh calculations.
- Involved in Unit Testing and Integration Testing.
- Worked with Datastage to migrate jobs from 7.5 to 8.5 and Datastage components.
- Involved in documenting teh Frame Work Templates and teh process of developing jobs using Templates.
- I was involved in teh production support.
Environment: IBM Datastage 9.1/8.5 (Director, Designer),7.5, PL/SQL, IBM DB2, SQL Server, PERL, Varicent, Oracle, AIX 6.0, UNIX,BO, LINUX, Control - M.
Confidential, Addison, TX
Datastage Developer
Responsibilities:
- Involved with Business users and ETL Leads from different teams to implementETL Frame WorkusingDatastage Server/Parallel combination of jobs.
- Extracted data from various sources likeOracle Database,XML, Flat Files, .CSV filesand loaded to target warehouse.
- Used Column Analysis results to understand teh hidden business rules, data types, data anomalies, cardinality and nullability.
- Responsible for Designing, development, testing and deployment of Oracle Alerts, Triggers. And Used Cron Jobs to schedule teh jobs and Developed PL/SQL packages and database triggers.
- Coordinate with teh front end design team to provide them with teh necessary stored procedures and packages and teh necessary insight into teh data.
- Generated server side PL/SQL scripts for data manipulation and validation and materialized views for remote instances.
- Implemented various strategies forSlowly Changing Dimensionsusing Datastage Server/Parallel jobs using teh Frame Work approach.
- Designed jobs using different parallel job stages such as Join, Merge, Lookup, Filter, Dataset, Lookup file Set, Remove Duplicates, Change Data Capture,Switch,Modify, and Aggregator.
- Involved in developingDatastage Designer Server and Parallel jobs for Extracting, Cleansing, Transforming, and Integrating/Loading Data into Corporate Data Warehouse (CDW).
- Extensively used Data Stage to load data from DB2 and Flat Files.
- Developed Job Sequences for automating and scheduling teh Datastage Jobs.
- Extensively designed, developed and implementedParallel Extenderjobs usingParallel Processing (Pipeline and partition)techniques to improve job performance while working with bulk data sources.
- Developed processes on both Teradata and Oracle using shell scripting and RDBMS utilities such as Multi Load, Fast Load, Fast Export, BTEQ (Teradata ) and SQL * Plus, SQL * Loader (Oracle).
- Used Teradata Parallel Transporter to load data from various sources.
- Extensively usedDatastage Directorto Monitor and check teh run statistics of teh Jobs and to clear teh job logs, job resources.
- Used DB2 EE stage for doing loads into DB2 UDB Database and to load large volumes of data into Teradata V2R4 using Teradata Fast Export, Multi Load.
- Configured Global Security for WebSphere console and assigned different roles to Developers and Admins.
- Extensively usedDatastage Managerto Export/import Datastage components.
- Involved in Unit Testing for teh jobs.
- Created Shell scriptsfor scheduling teh Datastage jobs using wrappers.
- Used configuration management tools likeRational Clear Case/Clear Questfor version control andmigration.
- Involved in documenting teh Frame Work Templates and teh process of developing jobs using Templates.
Environment: 8.1,Oracle 10g, WebSphere Process Server, Teradata, DB2, UNIX Shell Scripting, PL/SQL/,Windows NT/2000, PERL, Clear Case/Clear Quest, IBM AIX 5.2, LINUX, Autosys
Confidential
ETL Developer
Responsibilities:
- Involved in creating entity relational and dimensional relational data models using Data modeling tool Erwin.
- Designing teh Target Schema definition and Extraction, Transformation and Loading (ETL) using Data stage.
- Mapping Data Items from Source Systems to teh Target System.
- Used teh Data stage Designer to develop processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse database.
- Worked on programs for scheduling Data loading and transformations using Data Stage from legacy system to Oracle 9i using SQL* Loader and PL/SQL.
- Designing and Developing PL/SQL Procedures, functions, and packages to create Summary tables.
- Used teh Data Stage Director and its run-time engine to schedule running teh solution, testing and debugging its components, and monitoring teh resulting executable versions (on an ad hoc or scheduled basis).
- Worked with Datastage Manager for importing metadata from jobs, new job Categories and creating new data elements.
- Developing Shell Scripts to automate file manipulation and data loading procedures.
Environment: Datastage 7.5 (Manager, Designer, Director), ERWIN, Oracle 9i, PL/SQL, SQL* Loader, SQL Server 2000, Windows NT 4.0, UNIX.