We provide IT Staff Augmentation Services!

Etl Datastage Developer Resume

0/5 (Submit Your Rating)

San Francisco, CA

SUMMARY

  • 5+ years of IT industry experience in Analysis, Design, Development, Testing, Implementation and Support of Data Warehouses, Database Technologies using Extraction Transformation and Load (ETL) tools Ascential DataStage Server 8.x/7.x/6.x/5.x - Server & PX, Quality Stage, Informatica Power Center
  • Extensive experience on designing and developing jobs by using IBM InfoSphere Data Stage (11.5, 9.1, 8.x)
  • Extensive domain knowledge of Healthcare, Insurance, Retail and Financial Industry.
  • Developed industry standard solutions with Datastage ETL jobs based on business requirements using various Datastage stages like Sort, Column Import, Modify, Aggregator, Filter, Funnel, Join, Lookup, Merge, Change Capture, Datasets, MQ Stage, Sequential Stage and Transformer etc.
  • Experience in design and implementation of Star Schema, Snowflake Schema and Multi Dimensional Modeling.
  • Worked with and extracted data from various database sources Oracle 12c/11g/10g/9i/8i, DB2UDB, DB2, SQL Server, Teradata, Sequential files.
  • Experience in troubleshooting of DataStage jobs and addressing production issues like performance tuning and enhancement.
  • ConvertedComplexjob designs to different job segments and executed through job sequencer for better performance and easy maintenance.
  • Experience in working with Sprint/Agileimplementation models.
  • Worked in designing and developing the Logical and Physical model using Erwin, MS Visio.
  • Excellent working knowledge on multiple platforms like DB2 z/OS, UNIX, IBM-AIX.
  • Worked extensively on Teradata Query Submitting and processing tools like BTEQ and Teradata SQL Assistant.
  • Experience in writing, testing and implementation of procedures, functions, triggers at Database level using PL/SQL.
  • Proficiency in data warehousing techniques for Slowly Changing Dimensions, Surrogate key assignment and Change Data Capture.
  • Experience in Performance tuning of ETL processes and datastage jobs in SMP and MPP environments from both system as well as job design perspective.
  • Experience with Onsite Offshore Working Model.
  • Gained a good experience in UNIX Shell Scripting and XML Scripting.
  • Knowledgeable in administering Job Schedules using DataStage internal scheduler as well as third party schedulers like Control-M, Autosys and AT utilities on UNIX machines.
  • Strong knowledge of UNIX shell scripting (Korn, and Bash shell), on AIX, HP, Sun OS and Perl Programming.
  • Good experience in Data modeling using Erwin tool, IBM rational Rose.
  • Solid understanding of OLTP and OLAP concepts. Extensively worked on implementation of physical and logical Data Warehouses and DataMarts and built multidimensional cubes for strategic decision making, data modeling in star schema and snow flake schemas.
  • Strong Skills in Reporting Tool such as Business Objects, Micro strategy, Cognos and Microsoft SSAS/SSRS.
  • Exposure to diversified business environments- Finance, Insurance, Retail, Automobile & Pharmaceuticals.
  • Excellent communication, interpersonal, analytical skills and strong ability to lead, manage and motivate the team.
  • Strong problem solving capabilities with Good communication skills with a proven track record of success.
  • Ability to work autonomously and also as part of a team under tight deadlines so as to meet any project expectations.

TECHNICAL SKILLS

ETL/Data Integration/Data Management Tools: IBM InfoSphere Datastage 11.5, 9.1, 8.x, Ascential DataStage 7.5/6.x, Server and Enterprise Parallel Edition, Quality stage, Metadata Data Management MDM, Information Analyzer, Informatica v7.0 Power Center, Oracle Data Integrator 10.x, Microsoft SSIS.

OLAP Tools: Microstrategy9.5/8.x, Business Objects 6.x, Cognos, Microsoft SSAS/SSRS.

Databases: Oracle 12.c/11g/10g/9i/8i, DB2 UDB V 7.x/8.x, Teradata 13.0/12.0/V2R5, SQL Server 2008/2005, Sybase IQ, MS-Access.

Modeling: Erwin 4.2/3.5, Microsoft Visio, Oracle Designer.

Languages: SQL, PL/SQL, COBOL, Perl, C, C++, HTML, XML, UML.

Operating Systems: MS-DOS, UNIX, SUN SOLARIS, AIX, DB2 z/OS, LINUX

Scripting: UNIX Shell/Kron scripting, DOS Scripting, XML, HTML, Java Scripting.

Scheduling Tools: AutoSys 9.0/4.x, Control-M, UC4, IBM Datastage Director, Maestro Scheduling Tool, MS Windows Scheduler.

Others: FTP Pro, Quest Central for DB2, TOAD, SQL Navigator, SQL*Loader.

PROFESSIONAL EXPERIENCE

Confidential - San Francisco, CA

ETL Datastage Developer

Responsibilities:

  • Involved in the development phase for business analysis and requirements gathering.
  • Worked on upgradation of Datastage from 7.5 to 8.1
  • Verified Environment Variables, Stage Variables and Routines for developing Parameter Driven Jobs and debugging them.
  • Involved in design and development of parallel jobs, sequences using the Designer.
  • Designed several parallel jobs using Sequential File, Dataset, Join, Merge, Lookup, Change Apply, Change Capture, MQ Stage, Remove duplicates, Funnel, Filter, Copy, Column Generator, Peek, Modify, Compare, Oracle Enterprise, Surrogate Key, Aggregator, Transformer stages.
  • Develop, Testing and Maintenance ofETLdesign and data warehouse development applications using SQL, PL/SQL programming and data stage.
  • Developed SQL Queries for implementingComplexbusiness rules and transformations.
  • Extensively involved inAgiledelivery environment.
  • Created a technical document forETLdesign for efficient stage use.
  • Used both Pipeline and Partition Parallelism for improving performance.
  • Involved in Jobs and analyzing scope of application, defining relationship within & between groups of data, Star Schema etc.
  • Developed user defined Routines and Transformations for implementingComplexbusiness logic.
  • Participating in anAgile/ Scrum methodology to deliver high - quality software releases on a periodic basis through Sprints
  • Used Column Import Stage, Shared Containers, for DS jobs
  • Created the ETL routines for enterprise Operational Data Source.
  • Performed the unit testing, integration testing and resolved the functional and technical issues.
  • Developing Shell Scripts to automate file manipulation and data loading procedures.
  • Assist the development team to address the issues raised by testing team
  • Worked with AutoSys 9.0 to schedule DataStage Jobs
  • Along with designing mappings from scratch, re-wrote existing code to enhance performance and trouble-shoot errors in both Oracle9i and DataStage.

Environment: IBM InfoSphere Datastage 11.1, Oracle12c, MicroStrategy9.5, XML Scripting, AutoSys 9.0, Agile, Erwin4, DB2 UDB, DB2 z/OS, AIX, Windows XP, PL/SQL.

Confidential -Des Moines, IA

ETL Datastage Developer

Responsibilities:

  • Responsible for assisting in architectural design and development related to data warehouse and IBM InfoSphere Information Server platforms in understanding the scope of application, present schema, data model and defining relationship within and between groups of data.
  • Used Datastage Parallel Extender to load data, utilizing the available processors to achieve job performance, configuration management of system resources in Orchestrate environment.
  • Developed necessary metadata repositories for all initiatives and ensure these meet current needs and provide flexibility for future growth.
  • Wrotecomplexqueries to compare the counts and data from source to target.
  • Developed theETLDevelopment Standards and best practices to design the Data Stage Parallel jobs consistently across the project.
  • Parallel Extender was used to run the jobs efficiently.
  • Managed migration of all job batches and related designs from Version 7.5 to 8.1, incorporating new functionality and notification capabilities. Incorporated functionality of pipeline and partitioning parallel processing using multiple processors to gain performance boost.
  • Developed acomplexSQL code and parameterized it to use in the common code approach to avoid writing several SQL scripts for different source table/file formats.
  • Used DB2 EE stage for doing loads into DB2 UDB Database and to load large volumes of data into Teradata.
  • Extensively used Lookup, Join, Merge stages for joining various information and also used Parallel Transformer, Column Generator, Funnel, Filter, Switch, Modify, Pivot, Row Generator from various database DB2 Enterprise, Oracle Enterprise.
  • Usingagilescrum method, partitioned deliverables in to sprints and delivering the sprints on timely manner.
  • Developed parameter-driven ETL processes to map source systems to target data systems with DataStage complete source system profiling.
  • Used Metadata Repository for storing datastage log messages.
  • Used Distributed Transaction Stage for treating the read, deleting messages and delivery of rows to a database.
  • Used ProfileStage to reduce the overall time. Automation was done using profile stage.
  • Written SQL and PL/SQL procedures to facilitate coding.
  • Used PL/SQL for writing procedures and triggers.
  • Writing the UNIX scripts to ExecuteETLJobs, Sequences, FTP files, Archiving and purging the files on regular intervals.
  • Designed Conceptual, Logical and Physical Data Mart using Star Schema methodology using ERWIN data model.
  • Involved in loading Deal decisioning and Deal Processing data in Data warehouse. This required various complex data transformations, with the involvement of number of tables.
  • Participated in source to target mapping design document, prepared system requirement documents based on data model and source target mapping documents.
  • Optimized Query Performance, Session Performance and Reliability.
  • Scheduled various ETL Batch processes using UC4 scheduling tool.
  • Worked with Connect Direct processes, FTP, SCP scripts for Transferring files between Servers and Legacy systems.
  • Interacted with Report Users and Business Analysts to understand and document the Requirements and translated these to Technical Specifications for Designing Universes and Business Object Reports.

Environment: IBM InfoSphere DataStage 9.1, Teradata 12.0, SQL, PL/SQL, DB2, Metastage, ProfileStage, Agile, Quality Stage, IBM AIX, Erwin 3.5, UC4 and Microsoft SqlServer SSAS/SSRS.

Confidential

ETL Datastage Developer

Responsibilities:

  • Involved in the design and development of Data Warehouse.
  • Worked closely with data modeler and database administrator to understand the business process of the data warehouse model.
  • Upgraded and Installed DataStage Clients from 6.5 to 7.5 on Windows 2000 user machines.
  • Extensively worked with Parallel Extender. Using Parallel Processing (Pipeline and partition parallelism) techniques to improve job performance while working with bulk data sources.
  • Worked closely with data modeler and database architect during the design and development of ETL technical specification document.
  • Used DataStage Designer to develop processes for extracting, cleansing, transforming, integrating and loading data into Data Warehouse database.
  • Performed Import and Export of DataStage components and table definitions using DataStage Manager.
  • Extensively used Flat File Stage, Hashed File Stage, DB2 UDB Stage, FTP Plug-in Stage and Aggregator Stage during ETL development.
  • Converted Oracle, DB2, Mainframes data into SAP datawarehouse by using SAP R/3 Packs like ABAP extract, load, BAPI, IDOC packs.
  • Extracted, cleansed, data from Mainframes legacy systems by using COBOL programming and transformed loaded into oracle datawarehoue.
  • Used DataStage Director to Run and Monitor the Jobs performed, automation of Job Control using Batch logic to execute and schedule various DataStage jobs.
  • Used Metastage for metadata loading and as storage for Repository.
  • Scheduled the job run process by using Unix Shell Scripting to run as per the requirement.
  • Performed the Unit testing for jobs developed to ensure that it meets the requirements.
  • Responsible for Planning UAT Testing.
  • DocumentedETLDatastagetest plans, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.
  • Used ClearCase to store entire-project .dsx backups.
  • Loaded the raw data to Oracle using SQL Loader.
  • Created Shared Container stages to use in other jobs and scheduled to use the containers in Parallel extender.
  • Used Ascential Profile stage for cleansing and mining of the data while loading into datawarhouse.
  • Strong UNIX administration skills for increasing the performance of the multiple nodes.
  • Used WMQ files for message transportation across different application and database servers.
  • Documented the Data Warehouse development process and performed knowledge transfer to Business Intelligence developer.

Environment: IBM WebSphere DataStage 8.1 and Mainframes, MetaStage, ProfileStage, Sybase IQ, SAP R/3 Packs, Business Objects, IBM AIX, DB2 UDB, MS Visio, COBOL/MVS, Weblogic, WMQ files.

Confidential

ETL Datastage Developer

Responsibilities:

  • Involved in the creation of jobs using Data Stage Designer and used Director to Validate, Schedule, Run and Monitor the Data Stage jobs.
  • Involved in designing the procedures for getting the data from all systems to Data Warehousing system.
  • Information is stored in table definitions in the repository and is entered using the Data stage manager.
  • Worked with Orchestrate environment for parallel processing at Job & lookup stage.
  • Assisted development and production teams by determining application design flaws, thereby optimizing SDLC.
  • Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements.
  • Prepared Data Mapping Documents and Design of theETLjobs based on the requirements.
  • Created and modified Oracle control files for data loads.
  • Modified, maintained and developed the SQL codes to develop new enhancements.
  • Created new tables and corrected data in Oracle Database as required.
  • Provided Standard Documentation, Best practices and CommonETLProject Templates.
  • Created new/modified existing Oracle PL/SQL stored Packages and Procedures.
  • Automated manual processes by creating Oracle SQL Scripts, PL/SQL cursors, packages, procedures, functions, triggers, tables, indexes, views and constraints.
  • Created and maintained user account profiles and passwords, ensuring company-wide security.
  • Responsible for maintaining and updating technical documentation for software and systems.
  • Created interfaces for SQL data access to corporate level operations codes used as dimensions in the Data Warehouse.
  • UNIX scripts written to create and migrate files for ad hoc client projects, executing custom programs based on project specifications.
  • Scheduled ETL processes to avoid Conflicts both at Resource utilization level, Database lock issues and to avoid Datastage contention issues.

Environment: IBM WebSphere DataStage 8.1, Ascential Datastage 7.5/Parallel ExtenderOracle10g, Toad, Windows, MS SQL Server 2000, SQL Plus.

We'd love your feedback!