We provide IT Staff Augmentation Services!

Sr. Data Stage Developer Resume

5.00/5 (Submit Your Rating)

Dallas, TX

SUMMARY:

  • Over 8+ years of IT experience in Software Development Life Cycle involving Requirements Gathering, Design Analysis, Development, Maintenance, Implementation and Testing.
  • Over 6 years of hands - on experience with ETL Tools Confidential Data Stage 8.x/7.x/9.1 versions.
  • Excellent work experience in AGILE methodology and development.
  • Extensive experience as Production Support Personal in various multiple Data warehouse Projects and extensively worked with offshore team.
  • Experience in Working and Designed and populated dimensional model (star and snowflake schema) for a Data warehouse and data marts and Reporting Data Sources.
  • Extensive Experience with dimensional and relational DB design and development.
  • Diverse knowledge of data dependencies using Metadata of DataStage and preparing job sequences for existing jobs to facilitate scheduling of multiple jobs.
  • Experience in Parallel Extender (DS-PX) developing Parallel jobs using various stages including Transformer, Aggregator, Sort, Join, Merge, Lookup, Filter, Funnel, Modify, Remove Duplicates, Change Data Capture, Peek, Head, Tail, Copy, Sequential files, Datasets and database stages.
  • Developed and debugging of java files is done using Eclipse IDE.
  • Strong knowledge of Extraction Transformation and Loading (ETL) processes using UNIX shell scripting, SQL Loader and handled metadata using metastage for data analysis.
  • Experience in developing custom subroutines/scripts to simplify the determination of data output paths for complex business logic and expertise working with both OLTP and OLAP architectures.
  • Experienced in handling of packed decimal field in Mainframe datasets and tape drives and loaded them into DB2 and Teradata using DataStage.
  • Hands-on experience with several BI tools, Reporting tools and Analytic tools like OBIEE, SSRS, Business Objects, Cognos
  • Extensive experience in handling and creating in-bound and out-bound files from legacy systems.
  • Well versed in installation, configuration, supporting and managing of Big Data and underlying infrastructure of Hadoop Cluster.
  • Good understanding of Integrations including Web Services, SaaS, Workday Architecture, Business Process Framework and iLoads.
  • Created numerous Dashboards and Scorecards for enterprise summary level reporting using difference BI Tools.
  • Expertise in working with various operational sources like DB2, SQL Server, Oracle, Teradata, Flat Files into a staging area.
  • Scripting in multiple languages on UNIX, LINUX and Windows - Perl, Korn, AIX, DOS & VB script etc
  • Experience in working with various data sources like Sequential files, Mainframe files (COBOL copy books), Oracle, DB2, and Teradata in DataStage designer.
  • Having a good knowledge of source to target mapping tool, Fast Track in the Information Server.
  • Perform KYC and AML remediation within commercial banking investor services.
  • Strong analytic, problem solving, collaborative and interpersonal communication skills.

TECHNICAL SKILLS:

Databases/RDBMS: TERADATA 13, Oracle 11g/10/9i, Netezza and DB2

Operating System: UNIX Sun Solaris, AIX, HP and Windows Family

ETL Technologies: Confidential Info Sphere / Web sphere Data Stage 9.1/8.5/8.1/8.0/7. x

Scripting Languages: Shell Scripts,Python,Batch Scripting,AIX, Korn, Languages.

Scheduling Tools: CA7, AUTOSYS & CRON tab

Functional Knowledge: Retail, Banking and Health care.

Other Tools: Teradata SQL Assistant, MS Visio, POWER, AnthillPro, ClearCase, TOAD, BMS ticketing etc…

PROFESSIONAL EXPERIENCE:

Confidential

Sr. Data stage Developer

Responsibilities:

  • Responsible for extracting, transforming and loading the data into Cloud ( DashDB).
  • Responsible for adding logic to the jobs for automating the pull of the data form server and transforming it and loading it into the Cloudant.
  • Developed server and parallel jobs for extracting, cleaning, transforming, integrating and loading data into data warehouse database using DataStage Designer.Created tables in DashDB.
  • Involved in understanding business processes and coordinated with business analysts to get specific user requirements.
  • Involved in understanding logical and physical models for the subject areas.
  • Worked on creating mapping documents from the business requirements and designed the ETL Specification Documents.
  • Implemented J2EE design patterns as a part of application development
  • Identified and documented data sources and transformation rules required to populate and maintain data warehouse.
  • Extensively used DataStage Designer for creating new job categories, metadata definitions and data elements, import/export of projects, jobs and DataStage components, viewing and editing the contents of the repository as well as writing routines and transforms.
  • Used DataStage Designer to design and develop jobs for extracting, cleansing, transforming, integrating, and loading data into different Data Marts.
  • Used several stages like Sequential file, Aggregator, Join, Merge and Lookup during the development process of the DataStage jobs.
  • Proactively involved in ongoing maintenance, support and improvements in Hadoop cluster.
  • Managing Hadoop clusters: Monitor, maintain, setup, and scheduling jobs on Hadoop Cluster.
  • Used QualityStage stages such as investigate, standardize, match and survive for data quality and data profiling issues during the designing.
  • Strong Knowledge of Data Profiling and Data Quality.
  • Developed incremental and full load data jobs using CDC (change capture stage), which were scheduled to run on daily, weekly or monthly basis.
  • Received the master data and populated the dimension tables, time generation, surrogate key generation.
  • Defined the data definitions and created the target tables in the database.
  • Penned transformation routines to transform the data according to business requirements.
  • Designed Technical Design Document based upon jobs built.
  • Optimized SQL queries for maximum performance.
  • Used Toad for analyzing data, writing SQL, PL/SQL scripts performing DDL operations.

Environment: IBM WebSphere DataStage 9.1, 11.3,, Erwin, SQL, PL/SQL, DB2, XML files, DOM, Oracle 11g/10g, Windows XP Professional, DB2, Teradata V2R5, Business Objects, Korn Shell Scripting, UNIX Shell Scripting, Jil Script, AIX Scripting.

Confidential, Dallas,TX

Sr. ETL Data stage Developer

Responsibilities:

  • Involved in team meetings and interacted with the business analyst to get the business rules.
  • Working as a DRA calling to customers from the data provided and finding dues from the mainframes and resolving queries to customers and making follow-ups till the payment collected.
  • Developed server and parallel jobs for extracting, cleaning, transforming, integrating and loading data into data warehouse database using DataStage Designer.
  • Checking details of the customer and intimating dues from the mainframes.
  • Worked with DataStage to import/export metadata, jobs and routines from repository and also created data elements.
  • Designed and developed the front end of the application using Struts Tiles, JSP, Java script, HTML, Ajax and CSS
  • Scheduled jobs using DataStage Director, which are controlled by DataStage engine and also for monitoring and performance statistics of each stage.
  • Involved in Deployment and Administration of SSIS packages with Business Intelligence development studio.
  • Developed SSIS Templates which can be used to develop SSIS Packages in such a way that they can be dynamically deployed into Dev, Test and Production Environments.
  • Used Quality stage to design jobs that extract information from the source systems and then measure, cleanse, consolidate, enrich and load into the target systems.
  • Designed Parallel jobs using various operators like join, merge, remove duplicates, filter, dataset, lookup file set, aggregator, change capture, slowly changing dimension and funnel stages.
  • Experience in creating standard/custom quarterly, annual and ad-hoc reports as needed by business and converting existing PeopleSoft reports to Workday Reports as part of migration.
  • Developed data driven testing for web services for large set of data using ReadyAPI
  • Involved in designing and developing the webforms in Hyperion Planning.
  • Design and developing Cognos Reports using Workspace and Workspace Advanced and Report Studio etc
  • Monitored Hadoop cluster job performance and capacity planning.
  • Worked on creating the reports using the Confidential Cognos reporting tools using bursting technique
  • Involved in requirement analysis, ETL design and development for extracting data from the source systems like sales force, Mainframe, DB2, sybase, Oracle, flat files and loading into Netezza.
  • Escalation of unusual activity to the Enterprise AML Unit.
  • Responsible for the operation, maintenance and integrity of a distributed, networked AIX based environment
  • Setting Environment variables, Parameters and creating Parameter sets to make the jobs more flexible for development as well as debugging
  • Enhanced the reusability of the jobs by making and deploying shared containers and multiple instances of the jobs.
  • Collaborated in developing Java Custom Objects to derive the data using Java API.
  • Experience in migrating the DataStage code to various environments and RTC to backup the code
  • Used Confidential WebSphere DataStage 8.0 as ETL tool to Extract, Transform data from source systems such as Oracle, Flat files and load into Billing & Payment tables.
  • Developed Billing batch process (Invoicing) including ETL architecture design and development.
  • Used JMS (Java Messaging Service) for asynchronous communication between different modules.
  • Developed Payment batch process (Vouchering) including ETL architecture design and development.
  • Developed ETL audit routine and reusable audit process job.
  • Worked with System Integration Testing (SIT) support and resolving ETL Issues.
  • Worked with ETL Performance tuning for various processes.
  • Developed Technical Design/Design Specification Documents, Mapping Specification Documents, and ETL Component Specification Documents and ETL
  • Derivation specifications for various processes involved in the migration of DataStage jobs from development to production environment.

Environment: Confidential Infosphere DataStage 9.1, Oracle 10g, SQL, PL/SQL, UNIX,Python,AIX,KORN,TOAD, Netezza, Cognos, Windows XP Professional, MS Visio, Win SQL, Business Objects.

Confidential, Syracuse, NY

Sr. ETL DataStage Developer

Responsibilities:

  • Extracted data from different sources - relational databases, oracle database, flat files, XML documents, and loaded into data warehouse.
  • Analyzed, designed, developed, implemented and maintained Parallel jobs using Enterprise Edition of DataStage.
  • Used several J2EE design patterns like DAO, DTO, Business Delegate, Front Controller and MVC- Model along with Struts to develop application.
  • Involved in design of dimensional data model Star schema and Snow Flake Schema.
  • Generating DB scripts from Data modeling tool and Creation of physical tables in DB.
  • Successfully implemented pipeline and partitioning parallelism techniques and ensured load balancing of data.
  • Deployed different partitioning methods like Hash by field, Round Robin, Entire, Modulus, and Range for bulk data loading.
  • Implemented various Shared container for multiple jobs and Local containers for same job as per requirements.
  • Worked on Autosys scheduling scripts to schedule the datastage jobs.
  • Designed and developed SSIS packages to move data from different environments within the organization.
  • Involved in performing incremental loads while transferring data from OLTP to data warehouse using different data flow and control flow tasks in SSIS.
  • Implemented multi-node declaration using configuration file (APT Config File) for performance enhancement.
  • Designed and analyzed J2EE architecture using struts through java servlets.
  • Installed, monitored and supported Web and Application Servers on AIX and Linux environments.
  • Used SaaS, ClickView for visualization purposes.
  • Used Transformer stage for different transformations and aggregations.
  • Responsible for creating/executing and scheduling DataStage jobs.
  • Designed/Developed and tested DataStage jobs to lead data into DW.
  • Replaced manual extraction with automatic process using DataStage jobs.
  • Used Data Stage Manager to import metadata, new job categories and creating new data elements as well as to export job categories.
  • Worked on creating the reports using the Confidential Cognos reporting tools using bursting technique.
  • Created several general routines (Before-After, Transform function) used across the project.
  • Used the ETL Data Stage Director to schedule running the solution, testing and debugging its components and monitor the resulting executable versions.
  • Interacted with the reports developers to validate presented data.

Environment: Confidential WebSphere DataStage 8.0.1, Erwin, SQL, PL/SQL, DB2, XML files, DOM, Oracle 11g/10g, TOAD, Windows XP Professional, DB2, Teradata V2R5, Business Objects UNIX Shell Scripting,Python, Jil Script, AIX Scripting.

Confidential, OH

DataStage Developer

Responsibilities:

  • Involved in identifying source systems, Responsible for scheduling client interviews to identify commonalities in data residing on various source systems.
  • Used Parallel Extender for splitting and organizing the data into subsets and to achieve better job performance.
  • Developed the middle tier application using the Java Servlet API.
  • Responsible for analyzing and understanding Metadata and data.
  • Responsible for setting-up DEV, TEST and PROD Environments on DataStage.
  • Designed and developed DataStage Data flow integrating multiple sources.
  • Proficient in creating CSV files for SAP-BW and using BW plug-in Stages.
  • Involved in Performance Tuning of Jobs.
  • Participated in discussions with Project Manager, Team leader, Group Members and Technical Manager Regarding any Technical and/or Business Requirement issues.
  • Writing documentation for detail transactions data for operational data store.
  • Transformations including aggregation and summation construct from operational data source to Data warehouse.
  • Involved in SDLC design and development of the back-end system in Java.
  • Developed job sequencers and implemented restartability using various checkpoints.
  • Extensively worked on DataStage Director, DataStage Manager and DataStage Administrator.
  • Used DataStage Designer for developing various jobs to extract data from different sources and loading data into temp tables for validation testing and Production run.
  • Developed PX jobs in using different stages like Change Capture, Aggregator, Join, Merge, Lookup, Source Dataset, External Filter, Row generator, Column generator and Peak stages.
  • Design, Development, testing and implementation of and Korn shell scripts.
  • Used Java Architecture for XML Binding (JAXB) for marshaling and un-marshaling java objects and XML.
  • Used DataStage Director and the runtime engine to schedule running the server jobs, monitoring scheduling and validating its components.
  • Involved in Unit Testing, SIT and UAT. Worked with the users in data validations.
  • Extensively worked in improving performance of the jobs by avoiding as many transforms as we can.
  • Worked with environment variables like APT CONFIG FILE and APT DUMP SCORE.
  • Involved in the development of Common Error Management to capture and handle the error records.
  • Preparing documentation for unit, regression, integration, and final end - to - end testing.
  • Involved in the unit testing, regression testing, and integration testing for transition data.

Environment: Ascential DataStage 7.5.2, Oracle 9i, TOAD, SQL Loader SQL, PL/SQL, UNIX,Batch Scripting, Korn.

Confidential, MN

DataStage Developer

Responsibilities:

  • Involved in understanding business processes and coordinated with business analysts to get specific user requirements.
  • Involved in understanding logical and physical models for the subject areas.
  • Worked on creating mapping documents from the business requirements and designed the ETL Specification Documents.
  • Implemented J2EE design patterns as a part of application development
  • Identified and documented data sources and transformation rules required to populate and maintain data warehouse.
  • Extensively used DataStage Designer for creating new job categories, metadata definitions and data elements, import/export of projects, jobs and DataStage components, viewing and editing the contents of the repository as well as writing routines and transforms.
  • Used DataStage Designer to design and develop jobs for extracting, cleansing, transforming, integrating, and loading data into different Data Marts.
  • Used several stages like Sequential file, Aggregator, Join, Merge and Lookup during the development process of the DataStage jobs.
  • Used QualityStage stages such as investigate, standardize, match and survive for data quality and data profiling issues during the designing.
  • Strong Knowledge of Data Profiling and Data Quality.
  • Developed incremental and full load data jobs using CDC (change capture stage), which were scheduled to run on daily, weekly or monthly basis.
  • Received the master data and populated the dimension tables, time generation, surrogate key generation.
  • Defined the data definitions and created the target tables in the database.
  • Penned transformation routines to transform the data according to business requirements.
  • Designed Technical Design Document based upon jobs built.
  • Optimized SQL queries for maximum performance.
  • Used Toad for analyzing data, writing SQL, PL/SQL scripts performing DDL operations.
  • Worked on Job scheduling tool ‘Autosys’ to automate the Datastage jobs on daily, weekly, monthly basis with proper dependencies.
  • Created reports based on OLAP system built.
  • Involved in Reporting tool Business objects to generate reports for end users.

Environment: Confidential Web sphere Data Stage 8.0.1 (Designer, Director and Administrator), Confidential AIX UNIX, Quinetix, SQL Server, DB2, Flat files, Autosys, Scripts, MS Visio.

Confidential, New York, NY

DataStage Consultant

Responsibilities:

  • Used Information Analyzer to provide complete analysis of source systems and target systems, and assesses the structure, content, and quality of data.
  • Used Quality Stage which standardizes stage to reformat data from multiple systems for effective matching and output formatting.
  • Used Quality Stage investigation stage to create input into cleansing process.
  • Involved in the design of an efficient, reliable ETL mechanism for updating the Data Warehouse, Data Marts and downstream systems.
  • Processed Cleansing, Purging and Optimizing the data in warehouse. Developed and implemented all ETL (Extract, Transform and Loading) Components based on the filter rules to obtain needed data from different source systems for calculating required metrics using PL/SQL.
  • Implemented event handling using Java and JavaScript.
  • Used Resource Registry extensively to improve system portability.
  • Involved in creating logical and physical data model with use of Oracle Designer.
  • Used Parallel Jobs for splitting the data into subsets and flowing of data concurrently across all available processors to achieve job performance.
  • Worked extensively on different types of stages like Transformer, Sorter, Aggregator, Lookup, folder, Joiner, OCI, Flat file and Oracle Enterprise.
  • Created/Modified Universes by Adding objects, Tables/Derived tables with Oracle and as Backend Databases.
  • Involved in performance tuning of Business Objects reports. Using hints/ aggregate aware, index aware and other optimizing techniques to improve performance.

Environment: Confidential Websphere DataStage 8.0.1, Quality Stage, Profile stage, PL/SQL, SQL Server, Oracle 10g, UNIX shell script, TOAD, ERwin4.0, Windows XP,Infosys,Autosys.

Confidential

DataStage Developer

Responsibilities:

  • Involved in functional meetings with business users to gather requirements and worked with business to sign-off the requirement.
  • Extensively worked on designing the ETL process and creating source to target mapping.
  • Worked on developing ETL jobs using DataStage/QualityStage Designer using stages like Salesforce.com stage, DB2 Enterprise Stage, DB2 API Stage, Oracle Enterprise Stage, Transformer Stage, Join and Lookup stages etc.
  • Designed and developed DataStage jobs to extract data from PeopleSoft, Mainframes and saleforce.com (SFDC) and commercial customer database (CCDB) into Enterprise Data warehouse.
  • Involved in data modeling using Embarcadero ERStudio.
  • Built commercial fact tables Confidential a grain of customer, store, data, products etc.
  • Extensively worked on building dimension tables like Customer, Store, Product, and Time etc.
  • Worked with DB2 DBA team building replicated dimensions.
  • Extensively used DataStage Director to run, schedule, monitor and reset DataStage and QualityStage jobs.
  • Worked on Change capture stage and Slowly Changing Dimension (SCD) stage.
  • Extensively worked on customizing Salesforce Object Query Language (SOQL) to extract data from SFDC.
  • Extensively worked on customizing DB2 SQL and created truncate and run stats scripts and used in before and after job routines.
  • Extensively worked on extracting data from PeopleSoft HR data into EDW.
  • Extensively worked on building ETL jobs to extract and load data into PeopleSoft EMP(EMP OWS, OWE and MDW).
  • Worked on customizing EPM ETL jobs as per the client requirements.
  • Processed Sales and transaction counts to identify a primary store for commercial customers.
  • Used DataStage Designed to create and compile jobs, importing/export objects.
  • Worked on UC4 to schedule DataStage jobs, UNIX scripts.

Environment: Ascential DataStage 7.5, Confidential DB2 9.1, Oracle 9i, PeopleSoft HRMS, PeopleSoft EPM 8.9, Business Objects 6.5, AIX 5.3, Toad, Windows XP

We'd love your feedback!