We provide IT Staff Augmentation Services!

Senior Datastage Developer Resume

4.00/5 (Submit Your Rating)

Dallas, TX

SUMMARY:

  • Around 11 years of experience in the IT Industry with specialization in Data Warehousing & Business Intelligence area as Data Architect, ETL Architect and ETL Developer.
  • Drawing on Experience in all aspects of analytics/data warehousing solutions (Database issues, Data mapping, ETL Development, metadata management, data migration and reporting solutions) I have been key in delivering innovative database /data warehousing solutions to the Retail, Automotive, Media and Finance Industries.
  • Extensive experience in managing support and development teams.
  • Experience in project implementation using Agile, Waterfall methodologies.
  • Experience in all aspects of project development life cycle including Analysis, Design, Development, Implementation, Modeling, Testing, Deployment and supporting for various ETL/DWH projects.
  • Worked on Web services as a part of DataStage and obtained the successful connection of the external Web service call.
  • Expertise in design and implementation of SCD - Slowly changing dimensions types (1, 2 and 3) and CDC - Change data capture.
  • Extensive experience with Data Extraction, Transformation, and Loading (ETL) from multiple data sources Oracle, DB2, SQL Server, Flat files and XML files into Enterprise Data Model.
  • Broad Experience in Database Development including effective use of Database objects, Explain Plan, Hints, Indexes, Table Partitions, Sub Partitions, Materialized Views and Temporary tables
  • Expertise in Architecture, Development of BASIC Routines, SQL, PL/SQL Stored procedures, Packages and Functions, Query and Jobs tuning for better performance.
  • Expertise in creating tables, triggers, views, stored procedures, functions, joins and hash indexes in Teradata database.
  • Extensively worked with Teradata utilities like BTEQ, Fast Export, Fast Load, Multi Load to export and load data to/from different source systems including flat files.
  • Extensive experience in production support in resolving tickets of severity level Critical (sev1) and Urgent (sev2) and troubleshooting issues arising post deployment.
  • Experienced in writing Unix Shell Scripts for the automation of ETL processes and using schedulers like Autosys and Control-M.
  • Experience in migration projects across different tools and versions. Implemented migration project from SAS to Ab Initio and Data Stage upgrades(8.1 to 8.7 and 8.7 to 11.5)
  • Involved in transition of 30 applications from Client and lead BI team across multiple technologies.
  • Superior communication skills, strong decision making and organizational skills along with outstanding analytical and problem solving skills to undertake challenging jobs. Able to work well independently and also lead a team by helping to troubleshoot technology and business related problems.

TECHNICAL SKILLS:

ETL Tools: Ab Initio (GDE 3.1.7.1, Co>Op 3.0.4.0) and IBM InfoSphere DataStage 7.x/8.x/11.x

OLAP: OBIEE 11g

Schedulers: Control-M, Autosys and Maestro

RDBMS: Teradata 12x/14x, Oracle 11g/10g/9i/8i, SQL Server, DB2, Netezza and Informix

DB Tool: SQL*Loader, TOAD, Teradata SQL Assistant, SQL plus and WinSQL

Scripting Languages: SQL, PL/SQL, XML and UNIX Shell Scripting

Operating Systems: UNIX (HP-UX, IBM AIX 4.2/4.3), Windows 2003/2000/XP/98/7

Data Modelling: E/R Modeling, Dimensional Modeling (Star, Snowflakes Schema Modeling)

Professional Experience:

Confidential, Dallas, TX

Senior DataStage Developer

Responsibilities:
  • Involved as primary on-site ETL Developer during the analysis, planning, design, development, and implementation stages of project
  • Prepared Data Mapping Documents and Design the ETL jobs based on the Requirement Document.
  • Documented ETL test plans, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.
  • Reviewed data mapping, design documents, DataStage code and Unit Test Cases.
  • Designed and developed different slowly changing dimension procedures for multiple data extracts based on business requirements
  • Extensively worked with Netezza database to implement data cleanup, performance tuning techniques.
  • Used DataStage to Extract, Transform and Load data into Netezza Data Warehouse from various sources like Oracle and flat files.
  • Performed performance tuning of the jobs by interpreting performance statistics of the jobs developed.
  • Implemented multi-node declaration using configuration files for performance enhancement.
  • Successfully implemented pipeline and partitioning parallelism techniques and ensured load balancing of data.
  • Generation of Surrogate Keys for the dimensions and fact tables for indexing and faster access of data in Data Warehouse.
  • Extensively worked on Job Sequences to Control the Execution of the job flow using various Activities & Triggers (Conditional and Unconditional) like Job Activity, Wait for file, Email Notification, Sequencer, Exception handler activity and Execute Command.

Environment: DataStage 8.7, Oracle12c, SQL Server, Netezza, Shell Scripting, AIX UNIX and Autosys

Confidential, Lisle, IL

BI Support Lead/ Senior DataStage Developer

Responsibilities:
  • Met with business users to understand the business process and gather requirements.
  • Prepared Proof of Concept for DataStage migration from 7.1 to 8.7 environment and replacing existing COBOL and SQL scripts with DataStage.
  • Technical lead responsible to come out with the design patterns to load the data in data warehouse (ETL & ELT).
  • Technical SME, responsible for Enterprise Technical Governance for all the Business intelligence projects across organization
  • Created reusable objects such as containers, routines to handle the reusability of the code.
  • Has provided multiple DataStage trainings to the new joiners in the organization.
  • Created multiple reusable scripts (archiving, Incident Creation and guaranteed FTP) and parallel routines which were used across other modules.
  • Lead the team to develop the DataStage jobs with complex mappings applying various transformations.
  • Extensive use of Parallel Extender, developing Parallel jobs using stages, which includes Aggregator, Join, Transformer, Sort, Merge, Filter, Lookup and profound knowledge of the SCD stages.
  • Used Parameter files and variables in Jobs.
  • Preparing the Visio diagrams for Control M jobs.
  • Has extensive experience in reading the XML sources and sending the XML data to downstream.
  • Prepared High Level Design of Source Data Analysis, ETL Process flow, Error Handling, Re-startability and Auditing.
  • Mentoring the team members on Data warehouse, ETL, Database, UNIX concepts.
  • Established “Best Practices” and created components for Reusability. Very good exposure to the integration components like FTP and SFTP
  • Reviewed data mapping, design documents, DataStage code and Unit Test Cases.
  • Successfully leading the support teams across multiple technologies (DataStage, Informatica and OBIEE) from last 3 years without any SLA slippages and improved the stability of system.
  • Created multiple Dashboards, Reports, Agents and RPD in OBIEE 11g.
  • Created BTEQ scripts to transform data
  • Created Fastexport scripts to export data
  • Created, tested and implemented Teradata Fastload, Multiload and Bteq scripts, DML and DDL.

Environment: DataStage 7.1/11.5, Oracle 10g/11g, Informix, SQL Server, DB2, Teradata 14, OBIEE 11g, XML, Shell Scripting, Teradata SQL Assistant, AIX UNIX and Control-M.

Confidential, Greenville, SC

Senior DataStage Developer

Responsibilities:
  • Lead and co-ordinate ETL efforts of the project.
  • Designed the entire Purge project and automated the process.
  • Analyzed business needs and documented functional and technical specifications based upon user requirements with extensive interactions with business users.
  • Creating effort/duration estimates and deliverable lists for proposed project.
  • Design walk through with the internal and external stake holders of the project.
  • Using both the approaches called ETL and ELT to load the data into target tables.
  • Designed and developed ETL processes using DataStage Designer to load data from Flat Files (Fixed Width/Delimiter) and XML files to landing schema/database.
  • Extensively worked on Data Stage Tool using various stages like aggregate, join, transformer, merge etc.
  • Worked with Datasets, hash files and flat UNIX files processing.
  • Developed dynamic graphs to load data from data sources into tables.
  • Utilized Parallelism through different partition methods to optimize performance in a large database environment.
  • Involved in the development of DataStage jobs and also modified them for better performance.
  • Implemented handling of reject records automatically by sending them to the users for maintaining data integrity and reduce the job failures.
  • Implemented only delta load logic vs the entire refresh of the data mart tables.
  • Created test scripts for system and regression testing.
  • Created ETL best practices and Developers guide.

Environment: DataStage 7.5, Oracle 9g, Shell Scripting, XML, SQL-Loader, Toad, AIX UNIX and Maestro.

Confidential

Senior Ab Initio Developer

Responsibilities:
  • Provided Technical support to the team as Ab Initio developer. Addressed best practices and productivity enhancing issues.
  • Participated in Design walk-throughs, Test case reviews with attention to performance, stability, scalability and testability and provide inputs for Go/No Go decision.
  • Provide clear communication to project team and managers.
  • Worked in the Data Management Team on Data Extraction, Data Cleansing, Data Validation and loading Target tables.
  • Developed number of Ab Initio Graphs based on business requirements using various Ab Initio Components such as Partition by Key, Reformat, Rollup, Join, Scan, Normalize, Read Multiple Files, Update Table etc.
  • Developed Ab Initio graphs to fetch data from Oracle, Teradata, Flat Files and mainframe Files.
  • Developed jobs to load data for Teradata using FAST Load, Multi Load and T-Pump techniques.
  • Involved in Re-designing the load flow by eliminating the intermediate steps and Optimizations in order to get significant ETL conversion performance gains.
  • Wrote BTEQ scripts to transform data from landing to staging.
  • Performance tuned and optimized various complex SQL’s.
  • Implemented SCD type2 for History maintenance.
  • Responsible for code migration, Code review, test plans, test scenarios, test cases as part of Unit and system testing.
  • Automate the Ab Initio jobs using UNIX script in the scheduler.

Environment: Ab Initio 2.14, Oracle 9i, Teradata 12, Netezza, CA-7, Shell Scripting, PL/SQL, Toad, SQL-Plus, Teradata SQL Assistant, HP UX, Data Modelling and Autosys.

Confidential

Ab Initio Developer

Responsibilities:
  • Actively participate in understanding business requirements, analysis and designing Data Migration Process.
  • Understood the existing SAS code and developed Ab Initio graphs to implement the same logic as part of Re-engineering project.
  • Identified the gaps in the existing system and suggested data model changes for the better visibility of the data to the business users.
  • Created AS-IS and TO-BE design documents which served as reference for the developers in the migration project.
  • Created test cases for unit testing and integration testing and also created implementation plan.
  • Created Ab Initio graphs for loading summary tables.
  • Created jobs to load the history data.
  • Implemented auditing and reconciliation procedures to ensure data integrity.
  • Implemented phasing and checkpoint approach in ETL process to prevent data loss and to maintain uninterrupted data flow against process failures.
  • Worked on preparing AUTOSYS scripts for scheduling jobs in Prod environment.
  • Extensive experience on converting copybooks from FDR and reading the EBCIDIC files.
  • Used Ab Initio EME for Check-In/Check-Outs and Version control.

Environment: Ab Initio 2.14, Oracle 8i, SAS, Python 3.3, Shell Scripting, PL/SQL, Toad, AIX UNIX and Autosys.

We'd love your feedback!