We provide IT Staff Augmentation Services!

Sr. Datastage Developer Resume Profile

4.00/5 (Submit Your Rating)

NJ

Summary

  • Involved in complete Software Development life-cycle SDLC of various projects, including requirements gathering, system designing, data modeling, ETL development, production enhancement, support and maintenance.
  • Extensive experience in analysis and design of database including ER Diagrams and Normalization techniques.
  • Strong knowledge of UNIX shell scripting C, Bourne, Korn and Bash shell , on AIX, HP, Sun OS, RHEL and C, C , Perl and Python Programming.
  • Experience with Star and Snowflake Schema, Data Modeling, Fact and Dimensional Tables and Slowly Changing Dimensions.
  • Experience includes working in various industries like Financial, Supply chain management, Healthcare, Insurance and Retail.
  • Experienced in scheduling sequence, parallel and server jobs using DataStage Director, UNIX scripts and scheduling tools.
  • Extensively worked on performance tuning and backup on databases like Oracle 10g/9i/8i.
  • Developed parallel jobs using different processing stages like Transformer, Aggregator, Lookup, Join, Sort, Copy, Merge, Funnel, CDC, Change Apply and Filter.
  • Experience in integration of various data sources like Teradata, Oracle, DB2, SQL Server, MS Access, Sybase, Informix, MS Excel and Flat files into the Staging Area. Extensively worked with materialized views and TOAD.
  • Imported the required Metadata from heterogeneous sources at the project level.
  • Good experience in scheduling Jobs using AutoSys, Tivoli, Zeke and Corntab.
  • Knowledge in using PL/SQL to write stored procedures, functions, and triggers.
  • Generated Surrogate IDs for the dimensions in the fact table for indexed and faster access of data in server jobs.
  • Created local and shared containers to facilitate ease and reuse of jobs.
  • Experience in resolving Data Transformation, Cleansing and Capturing rejects and Exception and Error reporting.
  • Extensively worked on SAP MDM Pack to deliver data to online analytical processing OLAP .
  • Good knowledge on reporting tools like, Business Objects, Cognos 7 and microstrategy.
  • Good experience in Transforming Business specific rules into functional Specs.
  • Experience in Production Support, extensively worked on production support issues and resolved them using session logs, workflow logs, and used e-mail task for capturing issues via e-mail along with the session logs.
  • Working experience in interacting with business analysts and developers to analyze the user requirements, functional specifications and system specifications.
  • Ability to work autonomously and alsddc 4o as part of a team under tight deadlines so as to meet any project expectations.

Technical Skills:

  • Data Warehouse
  • IBM WebSphere DataStage 8.5/ 8.0.1/7.5/ 7.1 Designer, Director, Manager, and Administrator , MetaStage 6.0/ QualityStage, Parallel Extender 6.0, Orchestrate, Information Analyzer/ProfileStage, and Informatica 7.x/6.x.
  • Dimensional Modeling
  • IBM Rational Rose, ERwin R8.1 and Visio Diagram.
  • Reporting Tools
  • Crystal Reports 6.x/ 5.x, Cognos8.x/7.x, Microstrategy and MS Access Reports.
  • Databases
  • Oracle 11g/10g/ 9i, DB2, Teradata R12, MS SQL 2005/ 2000/ 7.0, Informix, MS Access 97/ 2000/2007.
  • Languages
  • SQL, PL/ SQL, C, C , VC , Perl, Java, .Net, JDBC, VB, and XML.
  • Unix Tools
  • Shell scripts C Shell, K Shell, and Bourne Shell , Perl, Python, AWK, VI, and SED
  • Operating Systems
  • HP-UX, IBM-AIX, Sun Solaris, Red-Hat Linux, Red hat enterprise Linux 4 AS/3, Susie Linux, Windows 2000/XP//2003/Vista
  • Others Tools and Applications
  • SQL Plus, SQL Loader, SQL Developer MS Word, MS Excel, MS PowerPoint, MS Project, Minitab, HTML, Putty, Win SCP.

Professional Experience:

Confidential

Role: Sr. DataStage Developer/ Consultant

Responsibilities:

  • Performed the Integration and System testing on the ETL jobs.
  • Designed sequence jobs using the activities such as Job Activity, Nested Condition, Notification Activity, Sequencer Activity, Terminator Activity and Execute Command.
  • Handled Performance Tuning of Jobs to ensure faster Data Loads.
  • Designed parallel jobs using stages such as Join, Merge, Lookup, Remove Duplicates, Copy, Filter, Funnel, Dataset, Lookup, Pivot, and Sort, Surrogate key Generator, Change Data Capture CDC , Modify, Row Generator and Aggregator.
  • Designed and developed the ETL jobs using Parallel Edition which distributed the incoming data concurrently across all the processors, to achieve the best performance.
  • Designed the ETL jobs using IBM Infosphere DataStage 8.5 to Extract, Transform and load the data into staging, ODS and EDW.
  • Responsible for generation of DDL statements, which are executed, for database creation.
  • Responsible for preparing Physical/logical data models.
  • Responsible for data analysis, requirements gathering, report analysis, source-to-target mapping, frequency analysis, process flow diagrams, and documentation.
  • Responsible for preparing ad hoc jobs.
  • Translated business rules and functionality requirements into ETL derivations.
  • Used Multi-job-compiler during deployment of projects.
  • Created Job Parameters and Environment variables to run the same job for different sources and targets.
  • Imported the required Metadata from heterogeneous sources at the process level.
  • Assisted operation support team for transactional data loads in developing SQL UNIX scripts.
  • Migrated projects from development to QA to Production environments.
  • Scheduled jobs using Autosys scheduler utility based on the requirements and monitored the production processes closely for any possible errors.
  • Created Batches DS job controls and Sequences to control set of jobs.
  • Created Shared Containers for Re-using the Business functionality.
  • Used the Director to schedule running the job, testing and debugging its components, and monitoring.
  • Collaborated with BO team to design Crystal reporting and reports for enterprise reporting applications.
  • Worked with Developers to troubleshoot and resolve issues in job logic as well as performance.

Environment:

IBM WebSphere DataStage 8.5 Administrator, Designer, Director , IBM Information Analyzer 8.1.1a, Microsoft SQL 2005/2008, IBM DB2 9.1, AIX6.0, Oracle 11g, Toad 9.5, Java, MS-Access, shell scripts, PUTTY, WinSCP, ERwin R8.1, Mercury Quality Center, IBM Rational Rose, AutoSys

Confidential

Role: DataStage Developer/ Data Modeler

Responsibilities:

  • Extensively used DataStage for extracting, transforming and loading databases from sources including Oracle, DB2 and Flat files.
  • Collaborated with EDW team in, High Level design documents for extract, transform, validate and load ETL process data dictionaries, Metadata descriptions, file layouts and flow diagrams.
  • Collaborated with EDW team in, Low Level design document for mapping the files from source to target and implementing business logic.
  • Generation of Surrogate Keys for the dimensions and fact tables for indexing and faster access of data in Data Warehouse.
  • Tuned transformations and jobs for Performance Enhancement.
  • Extracted data from flat files and then transformed according to the requirement and Loaded into target tables using various stages like sequential file, Look up, Aggregator, Transformer, Join, Remove Duplicates, Change capture data, Sort, Column generators, Funnel and Oracle Enterprise.
  • Created Batches DS job controls and Sequences to control set of jobs.
  • Extensively used DataStage Change Data Capture for DB2 and Oracle files and employed change capture stage in parallel jobs.
  • Executed Pre and Post session commands on Source and Target database using Shell scripting.
  • Collaborated in design testing using HP Quality Center.
  • Extensively worked on Job Sequences to Control the Execution of the job flow using various Activities Triggers Conditional and Unconditional like Job Activity, Wait for file, Email Notification, Sequencer, Exception handler activity and Execute Command.
  • Collaborated in Extraction of OLAP data from SSAS using SSIS.
  • Collaborated with BO teams in designing dashboards and scorecards for Analysis and Tracking of key business metrics and goals.
  • Collaborated with BI and BO teams to find how reports are affected by a change to the corporate data model.
  • Extensively used SAP R/3 and SAP BW packs
  • Utilized Parallelism through different partition methods to optimize performance in a large database environment.
  • Developed DS jobs to populate the data into staging and Data Mart.
  • Executed jobs through sequencer for better performance and easy maintenance.
  • Performed the Unit testing for jobs developed to ensure that it meets the requirements.
  • Developed UNIX shell scripts to automate file manipulation and data loading procedures.
  • Scheduled the jobs using AutoSys, Tivoli and Corntab.
  • Collaborated in developing Java Custom Objects to derive the data using Java API.
  • Responsible for daily verification that all scripts, downloads, and file copies were executed as planned, troubleshooting any steps that failed, and providing both immediate and long-term problem resolution.
  • Provided technical assistance and support to IT analysts and business community.

Environment:

IBM WebSphere DataStage and QulalityStage 8.0.1a Administrator, Designer, Director , IBM Information Analyzer8.0.1a, Microsoft SQL 2005/2008, IBM DB2 9.1, AIX6.0, Microsoft SQL 2008, Oracle 11g, Toad 9.5, Java, MS Access, SAP BW, SAP MDM, AS/400, shell scripts, PUTTY, WinSCP, ERWIN 4.0, HP Quality Center, Tivoli, IBM Rational Rose, AutoSys.

Confidential

Role: Technical DataStage Developer

Responsibilities:

  • Involved in various roles of Administrator and Developer throughout the project.
  • Conducted the training sessions for other ETL developers on the best practices as well as performance improvement techniques.
  • Managed analysis, design, coding and testing of ETL jobs for 7 Source Systems.
  • Involved in implementing the Best practices and design standards. The Best practices include Restart-ability, Recovery, Parameter standardization and Capacity planning, etc.
  • Participated in the review of Technical, Business Transformation Requirements Document.
  • Prepared documentation to describe process development, logic, coding, testing, changes and corrections.
  • Used Partition methods and collection methods for implementing parallel processing.
  • Developed complex DataStage jobs according to the business requirements / mapping documents.
  • Performed Unit Testing, System Integration Testing and User acceptance testing.
  • Involved in importing and exporting jobs category wise and maintaining the backup regularly.
  • Extensively Designed local containers and shared containers to simplify and modularize job design by replacing complex logics with single container stage and also to promote reusability of job designs.
  • Used designer and director to schedules and monitor jobs and to collect the performance statistics.
  • Worked within a team to populate Type I and Type II slowly changing dimension tables from several operational source files created some routines Before-After, Transform function used across the project.
  • Involved in creating UNIX shell scripts for database connectivity and executing queries in parallel job execution.
  • Responsible to tune ETL processes to optimize load and query performance.
  • Created standards document, best practices guide and performance tuning techniques documents.

Environment:

IBM WebSphere DataStage Enterprise Edition 7.5.2, DataStage Server Edition 7.5, ProfileStage 7.5, Oracle 10g, Teradata, Cognos , Toad 8.0, Microsoft SQL 2005, IBM 2094 - System z9, AIX, Java, Star Team, WinSCP FTP , SSIS 2005, Putty, Windows 2003 , Zeke, MS Visio, SAP MDM, Mercury Center.

Mellon Financial Corporation, Southfield, MI Jan'09 to Nov'10

Role: Developer/Trainer

Responsibilities:

  • Worked on DataStage Designer, Manager, Administrator and Director.
  • Worked with the Business analysts and the DBAs for requirements gathering, analysis, testing, and metrics and project coordination.
  • Involved in extracting the data from different data sources like Oracle and flat files.
  • Involved in creating and maintaining Sequencer and Batch jobs.
  • Creating ETL Job flow design.
  • Used ETL to load data into the Oracle warehouse.
  • Created various standard/reusable jobs in DataStage using various active and passive stages like Sort, Lookup, Filter, Join, Transformer, aggregator, Change Capture Data, Sequential file, DataSets.
  • Involved in development of Job Sequencing using the Sequencer.
  • Performing unit testing and integration.
  • Taking the regular backups of the jobs using Data Stage Export/Import utility.
  • Used Remove Duplicates stage to remove the duplicates in the data.
  • Used designer and director to schedules and monitor jobs and to collect the performance statistics.
  • Extensively worked with database objects including tables, views, indexes, schemas, PL/SQL packages, stored procedures, functions, and triggers.
  • Creating local and shared containers to facilitate ease and reuse of jobs.
  • Implemented the underlying logic for Slowly Changing Dimensions.
  • Executed Pre and Post session commands on Source and Target database using Shell scripting.
  • Worked with Developers to troubleshoot and resolve issues in job logic as well as performance.
  • Documented ETL test plans, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.

Environment:

DataStage Enterprise Edition 7.5.2/7.1 Parallel Extender, ProfileStage, MetaStage, DB2 UDB 8.0, Oracle 10g, Sybase, AIX, PL/SQL, Business Objects 6.5, OLAP, ERwin5.5, SQL plus, SQL Loader, Sun Solaris 8.0.

Confidential

Role: ETL Developer

Responsibilities:

  • Analyzed, conceptualized/designed the database that serves the purpose of proving critical business metrics.
  • Developed ETL procedures to ensure conformity, compliance with standards and lack of redundancy, translates business rules and functionality requirements into ETL procedures using Informatica PowerMart.
  • Worked with ERwin tool in Data Modeling both Physical and Logical Design .
  • Developed and documented data Mappings/Transformations, Audit procedures and Informatica sessions.
  • Assisted in the design and Maintenance of the Metadata environment.
  • Developed and tested all the backend programs, Informatica mappings and update processes.
  • Effectively managed the migration of the transformations/mappings from development to Production.
  • Developed various bulkload and update procedures and processes using SQL Loader and PL/SQL.
  • Involved in the error checking and testing of the ETL procedures and programs of Informatica session log.

Environment:

Informatica 6.1, Oracle 9i/10g, DB2, flat files, PL/ SQL, Windows 2003 Server, UNIX Korn Scripts , and SQL Loader, ERwin.

We'd love your feedback!