We provide IT Staff Augmentation Services!

Sr Datastage Developer Resume

SUMMARY:

  • Involved in all phases of a Data warehouse project mainly in ETL and having Expertise in Data Analyzing, Data Warehousing Technologies
  • Having strong knowledge in extracting data from legacy systems to stage and then Cleanse, Process and Loading into Data Marts and Data Warehouse.
  • Design and implementation of data warehousing ETL (Extract, Transform and Load) Oracle databases in - house SQL programming.
  • Having experience in both development and operations as well.
  • Strong experience in data analysis and troubleshooting data issues.
  • Hands on experience in Tuning Jobs, bug identifying and resolve performance in Parallel Jobs in Data Stage.
  • Having Strong knowledge in Linux and good knowledge in shell scripting too.
  • Hands on experience in Greenplum.
  • Hands on Experience in installation Greenplum in production server with 8 Cluster
  • Maintaining and running regular database backup’s
  • Troubleshooting Datastage jobs (ETL)
  • Lead data architecture for Enterprise DW implementation-hands on designing and validating data models and ETL architecture
  • Hands on experience in Reporting Tool (LOOKER)
  • Responsible for data migration from Greenplum to Snowflake
  • Responsible for data migration from Greenplum to AMAZON S3 using tools like S3CMD LINE TOOL and AWSCLI
  • Involved in data processing in amazon Redshift
  • Developed the Data Modeling in snowflake
  • Excellent team player with strong written, communication and analytical skills. Capable of working under high stress environment with resource constraints.
  • Working experience in various domains like Retail sales, insurance.

TECHNICAL SKILLS:

ETL Tools: IBM Data stage 11.5, Pentaho

Databases: SQL Server 2008,Oracle 11g/10g/9i,Greenplum

Database Tools: TOAD, SQL Plus, SQL Developer

Languages: SQL, Transact SQL (T-SQL), PL/SQL, UNIX Shell Scripts, C, C++, HTML, XML

Load Utilities: SQL Loader

Scheduling Tools: Control-M, Autosys, Tws

BI Reporting Tools: Tableau

Operating Systems: UNIX, Linux, Windows 9x/2000/NT/XP, 2003/2008 Windows Server

PROFESSIONAL EXPERIENCE:

Confidential

Sr Datastage Developer

Responsibilities:
  • Used various sourced and designed and developed jobs in order to facilitate the integration process of the expenditures.
  • Analyzed reports made by business user to extract data to effectively integrate expenditures from various sources.
  • Evaluated the Data extraction from source to confirm for data irregularities and classify corrupt data to apply suitable transformation in the mappings in the jobs.
  • Understand the business rules completely and implements the data transformation methodology.
  • Involved in the Technical design document and Source-To-Target mappings.
  • Extensively used Data Stage Designer for Developing Parallel jobs and performed complex mappings based on Business specifications.
  • Involved in the design and development of the ETL process for the data warehouse.
  • Implemented SCD 1 and SCD 2 Jobs.
  • Design and implemented XML Jobs.
  • Done performance tuning to long running source SQL queries in the jobs.
  • Checked in the Datastage code in SVN tortoise to maintain different versions in different stages of project life cycle
  • Built the SQL queries to fetch the data from the Database as per the business requirement and used the SQL queries in the Datastage for further processing.
  • Developed few server jobs as part of the project.
  • Developed sequencers to automate the parallel jobs and created looping jobs using sequencers.
  • Responsible for Performance tuning for better performance.
  • Involved in data analysis and support to QA.
  • Created build & Release documents.

Environment: Datastage 11.5, SQL Server, UNIX Shell Scripting, Autosys

Confidential

Sr Datastage Developer

Responsibilities:
  • Migrated jobs from 11.3 to 11.5.
  • Evaluated the Data extraction from source to confirm for data irregularities and classify corrupt data to apply suitable transformation in the mappings in the jobs.
  • Captured results compared result sets of 11.3 and 11.5.
  • Tuned the parallel jobs for higher performance and replaced old stages with new stages in the migrated jobs.
  • Resolved compilation/run time errors in the migrated jobs and End to End tested the output data of the migrated jobs in the new environment.
  • Worked on changes to be made to jobs in 11.5 in case of errors.
  • Worked on data issues in source files.
  • Communicated with client in case of code changes in 11.5.
  • Worked in performance tuning phase.
  • Monitored jobs in 11.3 production and 11.5 production.
  • Prepared track sheets for understanding performance improvement

Environment: Datastage 11.3, SQL Server, UNIX Shell Scripting

Confidential

SR Datastage Developer

Responsibilities:

  • Responsible for complete working of data warehouse
  • Running daily batch jobs from OLTP to OLAP
  • Involved /Responsible for various data integration processes/applications
  • Error handling and debugging on batch jobs
  • Enhancements based on client requirements.
  • Responsible for running data processing smooth
  • Developed and modification on SCD’s through various scripting
  • Collaborate with other function leaders in evaluating a correcting DW strategies and goals and implement changes as needed
  • 24x7x365 operation management of Data Warehousing group that includes business analysis, ETL processing, reports and technical support to the environment.
  • Also, responsible for reporting and Dashboards using LOOKER
  • Migration of data warehouse from Greenplum to Snowflake.

Environment: Datastage 8.5, GreenPlum, UNIX Shell Scripting, Tws

Confidential

SR ETL Developer

Responsibilities:
  • Creating data-model & Data-Ware house for the bank
  • Creating Amazon EC2 instance.
  • Design Pentaho jobs to extract, transforming result set and integrate the data from Salesforce to data-sink.
  • Created shell scripts to fetch data from Oracle source.
  • Created SCD-2 to capture the changes and load it into DWH using SQL scripting
  • Installed and implemented Tableau server.
  • Generate Tableau reports like “tracking pipeline tendencies of the Loan applications”, “customer ownerships “etc.
  • Responsible for migrating Tableau reports from Development to Production systems.

Environment: Pentaho, Oracle 10g, UNIX Shell Scripting, Aws

Confidential

SR ETL Developer

Responsibilities:
  • Gather the Client requirements to develop the jobs
  • Troubleshoot the Pentaho jobs and add error handling
  • Responsible for rectification and modification of the scripts for seamless working of jobs (which were previously developed)
  • Developed & configured new Database for the client.

Environment: Pentaho, Sql Server, UNIX Shell Scripting, Crontab

Confidential

Datastage Developer

Responsibilities:
  • Understand the business rules completely and implements the data transformation methodology.
  • Understanding the Technical design document and Source-To-Target mappings.
  • Designing Datastage jobs for validating and loading data.
  • Used the Datastage Designer to develop processes for extracting, cleansing, transforming, integrating and loading into Data Warehouse.
  • Extracting data from sources such as oracle, Flat files to transform and load into target Databases.
  • Datastage Designer was utilized for developing mappings using stages, which includes Transformer, Join, Lookup, Merge, Funnel, Filter, Oracle Enterprise Stage, Sequential File, Dataset, File Set, Copy, and Modify Stage.
  • Implemented SCD- Type II Techniques.
  • Designed Sequencer to automate the whole process of data loading.
  • Extensively worked with Datastage Shared Containers for Re-using the Business functionality
  • Experience in running jobs using Job Sequencers, Job Batches.
  • Involving in performance tuning jobs process identifying and resolve performance issues.
  • Involved in unit testing of Datastage jobs.

Environment: Datastage 8.5, XP, Oracle 10g, Unix, Teradata

Confidential

Datastage Developer

Responsibilities:
  • Extensively used Data Stage Designer for Developing Parallel jobs and performed complex mappings based on Business specifications.
  • Involved in the design and development of the ETL process for the data warehouse.
  • Worked extensively on different types of stages like Sequential file, Aggregator, Funnel, Change capture, Transformer, Merge, Join, Lookup for developing jobs.
  • Extensively used processing stages like the Lookup stage to perform lookup operations based on the various target tables, Modify stage to alter the record schema of the input data set, Funnel stage to combine various datasets into a single large dataset and Switch stage to trigger the required output based on a Specific condition.
  • Constructed containers for performance analysis.
  • Involved in the unit testing.

Environment: Datastage 8.5, XP, Oracle 10g, Unix

Hire Now