We provide IT Staff Augmentation Services!

Datastage Developer Resume

5.00/5 (Submit Your Rating)

San Francisco, CA

SUMMARY:

  • Over 8+ years of experience in developing, testing, supporting and maintaining applications in Data Warehouse using ETL tools IBM INFORMATION SERVER 11.3/9.1/8.5/8.1/8.0 and Ascential datastage 7.5/7.0/6.0.
  • 7+ years of experience in UNIX environment, shell scripts, Teradata V6, R13, R14, ORACLE 11G/10G/9i/8i and PL/SQL.
  • Strong understanding of the principles of DW using Fact Tables, Dimension Tables, star and snowflake schema modeling.
  • Experience on Various data models like BDM, IIS, Data Vault and Siebel CRM warehouse model.
  • Working experience in Banking, Finance, marketing and Insurance verticals.
  • Experience in Data collection, design, analysis and development of systems using ETL.
  • Handled development integration, datastage migration, test environment maintenance and production support projects.
  • Experience converting business requirements into a feasible technical solution.
  • Design to build and maintain batch processes that derive data from data warehouse database and propagate it into all SDLC environments.
  • Experience working with various source types like Flat files, Xml, Complex flat files, MQ, RDBMS - Oracle, DB2, Teradata and SQL Server.
  • Extensive experience in performance tuning and process optimization.
  • Very good understanding and working experience on SDLC processes, ETL methodologies and ITIL standards.
  • Worked on agile projects and waterfall methodologies with cross functional teams, Business analysts and Quality analysts.
  • Experience converting business requirements into a feasible technical solution.
  • Design to build and maintain batch processes that derive data from data warehouse database and propagate it into production environment
  • Strong understanding of the principles of DW using Fact Tables, Dimension Tables, star and snowflake schema modeling.
  • Applying client-server database skills (Oracle, DB2-UDB, TERADATA, SYBASE, Informix) in mixed OS environments (including UNIX).
  • Extensive experience in loading high volume data, and performance tuning.
  • Experienced in designing the database schemas for OLAP (STAR) warehouse databases.
  • Experience in loading the warehouse databases with the Data Vault modelling methods.
  • Experienced in preparation of reports, tables and listings.
  • Proficient in data analysis, and with using Logical and Physical Models.
  • Detailed and problem solving oriented in DataStage jobs and addressing production issues such as performance tuning and enhancement.
  • Effective in cross-functional and global environments to manage multiple tasks & assignments concurrently.
  • Highly organized, detail-oriented professional with strong business and technical skills.

PROFESSIONAL EXPERIENCE:

Confidential,Charlotte, NC

Sr. DataStage Developer

Responsibilities:
  • Worked in Enterprise Data Warehouse (EDW), Enterprise Staging Platform (ESP) & Master Data Management (MDM) for designing the Data Warehousing ETL job procedures for extracting the data from all source systems to the target system.
  • Responsible to analyze architecture and design Dynamic and Parameter driven multi instance ETL solutions across EDW and ESP (Enterprise Staging Platform) projects.
  • Responsible to design ETL framework model for ESP project.
  • Responsible to Lead and Support co development (co-dev) team members.
  • Developed complex Teradata queries which involved many tables and calculated the summary values as necessary.
  • Responsible to provide status in daily scrum meetings, sprint planning and retrospective meetings along with sprint demos.
  • Develop Data Stage jobs extensively using Parallel Extender, Sequencers, Custom Routines, Shared Containers, Generic components and Performance tuning.
  • Migration of ETL projects to IBM information Server 11.3/8.7/8.5/8.0/8.0.1 on different servers.
  • Responsible for converting all the datastage jobs from old server to new server by making sure the ETL code is in synch with the new version features and functionalities.
  • Performed the development where necessary and supported across all the SDLC environments.
  • Migration of around 1000+ jobs from DS 8.0 to IBM information Server 8.0.1
  • Responsible for environment setups by coordinating with multiple teams which include DBA’s, Unix teams and various Admin teams to have the code testing in side by side environments.
  • Performed the development and supporting the Production support team in extensive Unit testing, integration testing, system testing of migrating Data Stage jobs from 8.0 to 8.1 in the Grid Environment and test results were recorded and compared to the system test results of Data stage jobs.
  • Validating data values, column/table definition, source system profiling
  • Identify source systems, their connectivity, related tables and fields and ensure data suitably for mapping.
  • Developed Scripts that can be run from autosys to call the data stage sequence jobs.
  • Developed ETL Mappings using data stage and tuned them for better performance.
  • Worked with flat files, Oracle and Teradata as sources.
  • Extensively worked with Teradata RDBMS and TeraData BTEQ Scripts to store and retrieve data regardless of low-level operating system interface and scheduled jobs in Autosys.
  • Developed UNIX Shell scripts.
  • Instantiate common data routines through the Data Integration (DI) architecture.
  • Put all new DI jobs through data quality measurement.
  • Preparing documents, assisting the production support team in the warranty period of new code and migrate of existing systems as per requirements.
  • Coordinating with client managers, business architects and data architects for various sign offs on data models, ETL design docs, testing docs, migrations and end user review specs.
  • Confidential CREF has 3 different warehouse systems namely EDW, MDM and ESP. EDW is a financial Data warehouse primarily used for generating reports for Employee Retirement Income Security Act (ERISA) where as MDM is a Person Information Holder for the entire warehouse primarily used for holding the participant personal information and act as Sole record keeper which is used by Confidential internal users. ESP is an in-house developed enterprise staging platform which houses the data from all source systems in Confidential CREF. Data will be maintained in Raw format, the ETL process for ESP system is generic from begin cycle, extraction, staging, reconciliation and history loads. Below are the projects details which I worked on.
  • IPPM-Retirement Readiness: This project is about providing the retirement readiness details to the employees of different organizations based on their current savings and liabilities.
  • Project goal is to extract the contributions, loans and savings details for all participants from EDW(Teradata) and XML data (for extraction criteria ) from POA (Oracle) databases and then loading into POA (Plan Outcome Assessment) database (Oracle tables) after applying the business logic.
  • FCG UD: Objective of this project is to provide data for internal Confidential -CREF marketing groups. Plan and participant data will be loaded to a database which will be accessed through unified desktop application by field consulting groups to assess the customer behavior. Data extracts are from marketing warehouse and MDM.
  • EBounceBack Letters: This project is all about replacing the traditional process of sending the mails to the employees whose emails are bounced back. The traditional process involves the people in Operations to contact the employees either by phone or manual mail to get their email address corrected. This project implemented the solution to automate the process of sending out letters to these employees. Lyris database consists of the emails of the employees whose emails are bounced back. MDM data consist of the employees address data. Using these data XML files are generated. These files are transferred via MQ to MOBIUS server where these are converted to PDF’s, printed and mailed to customers
  • Product Control-Work Flow Solution: In brief this process involves reading SQL Server data from File Net server and loading into Teradata tables maintaining slowly changing dimension phenomenon (SCD type 2) and implement CDC.
  • Daily Client Transactions: Project would extract daily client financial transaction data from
  • Omni Plus that was processed in the prior business night’s batch cycle. The EDW (Enterprise Data warehouse) daily Extract File created will be transmitted from Teradata to NetApp Server via wmqfte.
  • Open Enrollment: Open enrollment project is all about the creation of seed file for MVAS with new participants enrolled during the open enrollment period and how many participants successfully entered after the open enrollment period ends. This project involves extracting the newly enrolled participant data from Lax Enrollment database (Oracle) which is present in MDM. Plan Conversion List file provides the list of plans and OMNI extracts provides the required data for the creation of seed file. Newly generated seed file transferred to MVAS using MQFTE.
  • Enterprising Staging Platform (ESP): The Enterprise Staging Platform is envisioned as a central staging platform for Enterprise usage to house all System of Records (SOR’s) data from different Line of Business (LOB’s). ESP platform supports data acquisition in various formats including but not limited to Flat files, XMLs and Relational databases.

Environment: IBM web sphere data stage 11.3/9.1/8.7/8.5/8.1/8.0.1, Teradata V6, R13, R14,R15, Autosys 11, 4.5, Oracle 11G/10G/9i, SQL/PLSQL, UNIX, AIX, Shell Scripts, Erwin, MS Visio, MS-Office, Agile & Water Fall Methodologies Project Management, HP ALM for defect tracking.

Confidential,Charlotte, NC

Datastage Developer

Responsibilities:
  • Solidifying the environment to improve data quality and access controls.
  • Simplification of the environment to reduce complexity.
  • Establish the Time Persistent Repository (TPR) to capture atomic source data.
  • Corresponding cost reduction based on simplification in reducing the number of ETL jobs executed, Reduction in the number of database tables and disk space required.
  • Deploy the Banking Data Warehouse Data Model and significantly reduce the number of data model tables.
  • Deploy the DI architecture and significantly reduce the number of Extract, Transform and Load (ETL) Jobs.
  • Deploy the IBM information server (IIS) Suite of tools to support data mapping, data integration and metadata management.
  • Deploy a consistent set of metadata through the DI and data warehouse layers using the information server platform.
  • Take a floor sweep approach with Teradata platform to refresh older technology.
  • Rationalize a small set of in-scope data marts for use with new environments.
  • Support a “do-no-harm” approach for approximately 225 data marts and 120 applications.
  • Deploy Teradata in database software to drive model execution of the data over the course of the transformation period.
  • Analyze user requirements ETL design documents, Mapping documents, logical and physical data models.
  • Analyze coding and writing specific programs based on requirements.
  • Develop Flowcharts, Teradata tables, Schema and database objects.
  • Create Autosys jobs, Shell scripts on UNIX.
  • Integration of data model update into code database.
  • Installed and Configured HP Quality Center for Defect Managements and Resolution.
  • Installed and Configured Tortoise SVN checkout Version control tool.

Environment: IBM websphere datastage 8.1, Teradata, Netezza, Autosys, Unix, Quality Center, Tortoise SVN, MS- Access.

Confidential,San Francisco,CA

Datastage Developer

Responsibilities:
  • Designed the Data Warehousing ETL procedures for extracting the data from all source systems to the target system.
  • Performed extensive Unit testing, integration testing, system testing of migrated DataStage jobs in Aix environment and test results were recorded and compared to the system test results of Datastage jobs in Windows environment
  • Helped data architect in preparing system requirement document.
  • Developed DataStage jobs extensively using Aggregator, Sort, Merge, and Data Set in Parallel Extender to achieve better job performance.
  • Validating data vales, column/table definition, source system profiling and analysis using profile stage
  • Using IBM quality stage we deliver the high quality data required for success in a range of enterprise initiatives including legacy consolidation and master data management.
  • With the help of quality stage we reduced time and cost to implement CRM, data warehouse, data governance, and other strategic IT initiatives and maximizes their role by ensuring their data quality.
  • Implementation, Capacity Planning & Upgradation from Datastage 7.5 to IBM Websphere 8.0/8.0.1 (Datastage, Quality Stage & information analyzer) on IBM AIX 6.1
  • Migration of 80 ETL projects (around 12000 jobs) DS 7.5 to IBM information Server 8.0/8.0.1
  • Identify source systems, their connectivity, related tables and fields and ensure data suitably for mapping.
  • Scripts that can be run from datastage sequence jobs, which can run and report on the status of datastage jobs from an enterprise-scheduling tool.
  • Generated Surrogate ID’s for the dimensions in the fact table for indexed and faster access of data.
  • Designed datastage jobs to load into the warehouse using the data vault modelling methodologies.
  • Developed datastage mappings and tuned them for better performance.
  • Extensively worked on datastage Transformations and wrote maps for daily data loads.
  • Worked with flat files, Oracle, Teradata and Sybase as sources.
  • Designed and developed Oracle PL/SQL Scripts and scheduled jobs in Autosys.
  • Worked on various operating systems like UNIX AIX 5.2/5.1, Sun Solaris V8.0 and Windows and Developed Strategies for Extraction Transformation Loading (ETL) mechanism.
  • Developed UNIX Shell scripts.
  • Worked on interface for reporting, analysis and continuous monitoring of all business data.
  • Perform source target analysis using Information Analyzer.
  • Designed the Data Model application using Erwin.

Environment: IBM websphere datastage 8.0.1/8.0 & Ascential datastage 7.5.2, SAS, Autosys, Oracle 11G/10G/9i, SQL Server 7.0(2008), Sybase, SQL/PLSQL, DB2, Cobol, SQL Loader, Teradata, Data Vault, Unix, Sun Solaris, AIX and Windows NT 4.0, Data Modeling, Erwin 4.5/3.5.2/3. x, Oracle Designer.

Confidential,San Jose, CA

Datastage Developer

Responsibilities:
  • Collected the information about different Entities and their Attributes.
  • Collected the information about the existing sources by reverse engineering them.
  • Extracted data transformed and loaded into Oracle database according to the required provision using Ascential DataStage 7.5.2.
  • Used the DataStage Designer to develop processes for extracting, cleansing, transforms, integrating and loading data into data warehouse database.
  • Designed the mappings between sources external files and databases like Oracle, Teradata SQL Server, DB2 and XML files to Operational staging targets.
  • Worked on BTEQ to submit data command and sql commands to Teradata RDBMS
  • Used built-in as well as complex custom transformations
  • Involved in creating more than 80 jobs using Datastage Designer.
  • Used Datastage manager to manage the Metadata repository and import/export of jobs.
  • Used PL/SQL processes to upload flat files using SQL*Loader.
  • Optimized job performance by carrying out Performance Tuning.
  • Identify source systems, their connectivity, related tables and fields and ensure data suitably for mapping.
  • Created source table definitions in the Repository by studying the data sources.
  • Created Log Tables containing data with discrepancies to analyze and re-process the data.
  • Trouble-shooted the designed jobs using the Debugger.

Environment: Ascential DataStage 7.5.2/7.0, (Designer, Director, Manager, Parallel Extender), Autosys, Oracle 10G/9i, SQL Server 20005/2003, DB2, Teradata, SQL,SQL Loader, MS-Access, XML files, Erwin 4.1.4,SQL, PL/SQL, UNIX, Windows NT.

We'd love your feedback!