Datastage Developer Resume
ChicagO
SUMMARY
- 8+ years of experience in IT as an application developer with experience in the total life cycle of Software Development Applications involving Requirements, Design, Analysis, Development and Testing.
- 6 years of in - depth experience in Extraction Transformation and Loading (ETL) processes). Using IBM Web sphere Data stage 8.5/8.1/8.0/7.5/7.1/7.0/6.0 and mapping Server and Parallel jobs.
- Worked on Datastage client tools Datastage Designer, Datastage Director, Datastage Manager and Datastage Administrator.
- Experience in Designing, Compiling, Testing, and Scheduling and Running Data stage jobs.
- Developed Server jobs for extracting, transforming, integrating and loading data to targets.
- Excellent experience in using Stages like Complex Flat File, Dataset, Copy, File set, Oracle Enterprise, Join, Sequencer, Aggregator, Merge, Filter, Transformer, Lookup, Funnel, Compress etc.,
- Good Understanding in design and implementation of Star schema, Snowflake schema and multi dimensional model.
- Worked with various databases Oracle 10g/9i/8i/8.0/7.x, DB2, MS Access, Teradata, SQL Server and Sybase.
- Extensive Experience working with Database tool Toad, SQL Loader, Teradata components such as BTEQ(Basic Teradata Query), Fast Load, Multi Load, Teradata Manager, CLI, ODBC etc.,
- Expertise in data warehousing techniques like Data cleansing, Slowly Changing Dimension phenomenon and Change Data Capture.
- Used Datastage Version Control to migrate the project from one environment to the other.
- Experience working with Parallel Extender for Parallel Processing to improve job performance while working with bulk data sources.
- Worked with most of the parallel stages applying different partitioning techniques.
- Experience in Debugging, Troubleshooting and Performance tuning.
- Experience with the Production support.
- Excellent analytical, problem solving, communication and interpersonal skills, with ability to interact with individuals at all levels.
- Efficient in all phases of the development life cycle, coherent with Data Cleansing, Data Integration, Data Conversion, Performance Tuning.
TECHNICAL SKILLS
ETL Tools: Ascential Data stage 8.5/8.1/8.0/7.5/7.1/6.0 (Manager, Designer, Director, Administrator), Data Stage PX (Parallel Extender), Quality Stage, Meta Stage, Profile Stag. Informatica Power Center 8.6.
Databases: Oracle10g/9i/8i/8.x/7.x,DB 2 9.0/8.0/7.0 , Teradata V2R5/V2R4/V2R3, MS SQL Server 2005/7.0/6.5 , Ms Access 2000, SQL*Plus, SQL*Loader, TOAD 7.0 and Developer 2000
Environment: Sun Solaris 2.7/2.6, HP-UX 10.2/9.0, IBM AIX 4.3/4.2, Linux, MS DOS 6.22, Win 3.x/95/98/XP, Win NT 4.0, Sun Ultra, HP9000, IBM RS6000, AS400
Programming Skills: UNIX Shell Scripting, SQL, PL/SQL, SQL*Plus 3.3/8.0, C, C++, Java, JavaScript, SQL*Loader, VB, ASP, COBOL, HTML, XML.
Data modeling Tools: Dimensional Data Modeling, Star Join Schema Modeling, Snow-Flake, Modeling, Fact and Dimensions Tables, Physical and Logical Data, Modeling and ERwin 4.5/4.0/3.5/3.0 , Enterprise Database, Integration and Management.
PROFESSIONAL EXPERIENCE
Confidential, Chicago
Datastage Developer
Responsibilities:
- Designed and tested the DataStage jobs for extract, transform and load.
- Involved in performance tuning of the Data Stage jobs and queries.
- Involved in Extracting, transforming, loading and testing data from XML files, Flat files, Oracle and DB2 using Data stage jobs.
- Used Data Stage Manager for importing metadata from repository, new job categories and creating new data elements.
- Involved writing shell scripts for running Data stage jobs, Using CSV, Excel, text (Hierarchy file for Data stage jobs).
- Implemented ETL Processes and developed complex SQL queries involving extremely large tables using Data stage.
- Using Data Stage Designer designed and created jobs for Target Warehouse Entity for Oracle.
- Developed Quality stage jobs to Standardize Addresses and Names.
- Used Director to validate, schedule and run data stage jobs
- Involved in creating WINSCP server, for scheduling and running Datastage jobs.
- Extensively involved ETL code using Data stage in order to meet requirements
- For extract, cleansing, transformation and loading of data from source to target data Structures.
Environment: Ascential data Stage 8.5/8.1 - Data Stage Designer, DataStage Director, DataStage Manager, Data Stage Administrator, Quality Stage, Oracle, UNIX Shell Programming.
Confidential, Bentonville, AR
Datastage Developer
Responsibilities:
- Designed and tested the DataStage jobs for extract, transform and load.
- Developed various jobs using stages DB2 enterprise, lookup, Dataset, Join, Sort, Aggregator, Filter, Modify, Funnel etc.
- Involved in performance tuning of the Data Stage jobs and queries.
- Involved in the Production support.
- Worked with Parallel Extender for parallel processing to improve job performance while working with bulk data sources.
- Written SQL in DB2 for using in DataStage and testing the data.
- Worked exclusively with the Teradata SQL Assistant to interface with the Teradata.
- Involved in Extracting, transforming, loading and testing data from XML files, Flat files, Oracle and DB2 using Data stage jobs.
- Used Governance Catalog to provide information integration capabilities to help you understand and govern information.
- Used the data stage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions on an ad hoc or scheduled basis.
- Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements.
- Involved writing shell scripts for running Datastage jobs, Using CSV (Hierarchy file for Datastage jobs).
- Implemented ETL Processes and developed complex SQL queries involving extremely large tables using DataStage.
- Using DataStage Designer designed and created jobs for Target Warehouse Entity for Oracle.
- Involved in creating CA7, for scheduling and running Datastage jobs.
- Performed the Unit testing for jobs developed to ensure that it meets the requirements. experience on data governancewithin group & developed structure.
Environment: Ascential DataStage 8.5/8.1 - DataStage Designer, DataStage Director, DataStage Manager, Data Stage Administrator, Oracle, UNIX Shell Programming, DB2, Teradata.
Confidential, Nashville, TN
Datastage Developer
Responsibilities:
- Designed and tested the DataStage jobs for extract, transform and load.
- Developed various jobs using stages DB2 enterprise, lookup, Dataset, Join, Sort, Aggregator, Filter, Modify, Funnel etc.
- Involved in performance tuning of the Data Stage jobs and queries.
- Extensively worked with Parallel Extender for parallel processing to improve job performance while working with bulk data sources.
- Extensively worked with quality stage for data cleansing, data standardization and matching process and implemented stages like Investigate, Match and Survive.
- Extensively worked with Quality stage to standardize data by trimming the spaces, removing nonprinting characters, incorrect spellings using transfer, parse, collapse, select, unijoin and build stages.
- Worked exclusively with the Teradata SQL Assistant to interface with the Teradata.
- Involved in Extracting, transforming, loading and testing data from XML files, Flat files, Oracle and DB2 using Datastage jobs.
- Used Dashboard for many common governance reporting tasks.
- Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements.
- Involved writing shell scripts for running Datastage jobs, Using CSV (Hierarchy file for Datastage jobs).
- Implemented ETL Processes and developed complex SQL queries involving extremely large tables using DataStage.
- Using DataStage Designer designed and created jobs for Target Warehouse Entity for Oracle.
- Involved in creating Autosys Jils, for scheduling and running Datastage jobs.
- Performed the Unit testing for jobs developed to ensure that it meets the requirements.
Environment: Ascential DataStage 8.5/8.1 - DataStage Designer, DataStage Director, DataStage Manager, Data Stage Administrator, Quality Stage, Oracle, PL/SQL, UNIX Shell Programming, Erwin, DB2, JD EDWARDS.
Confidential, Tallahassee, FL
Data stage Developer
Responsibilities:
- Worked with the Business analysts and the DBA for requirements gathering, business analysis, testing, and project coordination.
- Involved System analysis and design of Enterprise Datawarehouse.
- Defined best practices for source system analysis and source data profiling.
- Involved in creating Functional and scope documents for ETL process.
- Involved in developing Data mart for Reporting applications using Data Stage.
- Developed Datamarts for different customers with their requirements and developed a process to capture the statistics of all the tables to check the integrity like Min, Max, Mean, Sum and Median from Source to Target (i.e. SOR (System of record to Datamart tables).
- Designed, developed and tested the DataStage jobs for extract, transform and load.
- Extensively worked on writing Datastage Build-Ops for various jobs based on the requirements and transformation rules.
- Wrote stored procedures and triggers in Oracle 8i for managing consistency and referential integrity across data mart.
- Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements.
- Tuned the Parallel jobs for better performance.
- Extensively worked with Parallel Extender for parallel processing to improve job performance while working with bulk data sources.
- Written SQL in DB2 for using in DataStage and testing the data.
- I extensively worked on Oracle PL/SQL programming. As part of this, I developed packages, procedures, and functions.
- Developed Parameterized reusable Datastage jobs where you can use these jobs in multiple instances.
- Developed Datastage Jobs to load the data into Teradata tables using Fast load utility.
- Involved in Extracting, transforming, loading and testing data from XML files, Flat files, Oracle and DB2 using Datastage jobs.
- Developed Qualitystage jobs to Standardize Addresses and Names.
- Extensively involved in ETL code using Datastage tool in order to meet requirements
- For extract, cleansing, transformation and loading of data from source to target data Structures.
- Performed Unit testing for jobs developed to ensure that it meets the requirements.
- Created MS Visio Process flows to understand the processes and for maintenance purpose
- Supported Production On call for a week in every two months for newly installing code and for all Production issues.
- Performed User Acceptance Testing and end user training.
Environment: Ascential DataStage 7.5/7.1(Designer, Director, Manager), Oracle, SQL, PL/SQL, Shell Script, TOAD, ERWIN 4.2, DB2, UNIX, Server 2005, Business Objects 5.1, Win 2000/NT and AIX UNIX.
Confidential, NY
ETL Developer
Responsibilities:
- Extensively used DataStage Designer to develop various Parallel jobs to extract, cleanse, transform, integrate and load data into Enterprise Data Warehouse tables.
- Worked with Data Stage Manager to import/export metadata, DataStage Components between the projects.
- Involved in Design, Source to Target Mappings between sources to operational staging targets, using Star Schema, Implemented logic for Slowly Changing Dimensions.
- Loaded integrated data into the Teradata database using Load utilities like (Fast Load, MultiLoad, & TPump).
- Involved in Performance Tuning of Parallel Jobs using Performance Statistics
- Used Various Standard and Custom Routines in DataStage jobs.
- Schedule jobs through UNIX shell scripts.
- Extensively worked with DataStage Shared Containers for Re-using the Business functionality.
- Actively participated in the Team meetings to gather the business requirements and developing the Specifications.
- Responsible for adopting the standards for Stage and Link naming conventions.
- Extensively wrote user-defined SQL coding for overriding for Auto generated SQL query in DataStage.
- Involved in unit testing, system testing and integration testing.
- Created and edited the design specification documents for the jobs
- Participated in the review of Technical, Business Transformation Requirements Document.
- Participated in discussions with Team leader, Group Members and Technical Manager regarding any technical and Business Requirement issues.
- Coordinated with team members at times of change in Business requirements and change in Data Mart Schema.
Environment: Ascential DataStage 4.0/5.1 (Data Stage Designer, DataStage Director, DataStage Manager, DataStage Administrator), Informatica Power Center 8.6, Oracle 8i, PL/SQL, UNIX Shell Programming, WinNT 4.0 Server, Windows NT.
Confidential, San Francisco, CA
Data stage developer
Responsibilities:
- Interacted with Business personnel to analyze the business requirements and transform the business requirements into technical requirements.
- Developed and supported the extraction, transformation and load process (ETL) for Data Warehouse from the source systems using Data stage.
- Extensively involved in ETL code using Datastage tool in order to meet requirements
- For extract, cleansing, transformation and loading of data from source to target data Structures.
- Wrote SQL overrides in source qualifiers for extracting only the required rows for optimal performance.
- Created complex transformations using Source Qualifier, Joiner, Aggregator, Lookup, Router, Expression, Update Strategy, Sequence Generator etc.
- Debugging code, testing and validated data after processes are run in development/testing according to business rules
- Involved in developing Data mart for Reporting applications using Data Stage.
- Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements.
- Using DataStage Designer designed and created jobs for Target Warehouse Entity for Oracle.
- Wrote DataStage Basic routines to perform common functions such as file backup, surrogate key generation, file clearing.
Environment: Ascential DataStage 7.5/7.1(Designer, Director, Manager), Oracle, SQL, PL/SQL, Shell Script, TOAD, ERWIN 4.2, DB2, UNIX, Server 2005, Business Objects 5.1, Win 2000/NT
Confidential
DW Developer
Responsibilities:
- Database servers and backup server’s installation.
- Support of Production, Development and Test Environments of Oracle and Sybase Databases for multiple applications.
- Troubleshooting and Performance tuning of SQL Servers and applications.
- Backup and Recovery procedures for Production and Development servers.
- Running DBCC and fixing database consistency and allocation errors.
- Creating databases, tables, indexes, new logins, users etc.
- Monitoring performance of Oracle database.
- I extensively worked on Oracle PL/SQL programming. As part of this, I developed packages, procedures, and functions.
- Statistics maintenance.
- Converted Dozens of SQR Reports to Teradata SQL reports.
- Writing shell scripts to schedule tasks.
- Creating stored procedures and triggers.
Environment: Oracle 8.0, Teradata-V2R4 PL/SQL, SQL, Windows NT