We provide IT Staff Augmentation Services!

Senior datastage Developer Resume

0/5 (Submit Your Rating)

Minneapolis, MN

SUMMARY

  • 12+ years of solid experience in building data warehouse/Data marts especially with ETL tools like IBM Information Server DataStage 9.1/11.7/11.5
  • Extensive knowledge of Software Development Life Cycle (SDLC), having thorough understanding of various phases like Requirements, Analysis/Design, Development and Deployment.
  • Expertise as a Data Warehousing Developer using ETL Tool DataStage (Designer, Administrator, Director and Manager) Parallel Jobs, QualityStage.
  • Performed Debugging, Troubleshooting and performance tuning of DataStage Jobs.
  • Used complex flat file stage in complex logic handling from the mainframe data source.
  • Worked extensively with Data - Mart/Warehouse/Lake, Data migration, Data Cleansing, ETL Processes.
  • Experience in designing and working with DB2, Teradata, SQLServer, Oracle and writing SQL queries, aggregate functions.
  • Proficient in writing Unix Shell scripts and Python Shell Scripts using Pandas.
  • Involved extensively in Testing phase planning, preparation and execution.
  • Experience in creating schema objects (Physical Data Modelling), Performance Tuning of SQL statements
  • Excellent Microsoft Office skills used for documenting the analysis and work done.
  • Strengths include excellent communication skills and interpersonal skills, good analytical skills and logical approach to problem solving.
  • Hands-on with GitLab, Cloning the code form the Master branch, changing the code according to business requirement and pushed the code to master branch.
  • Hand on with UCD (Urban code deployment) for deploying the code to production.
  • Worked on AWS S3 Bucket data movement jobs that will be used in Snow-flake.
  • Worked on Snowflake tables load (6 months).

PROFESSIONAL EXPERIENCE

Confidential, Minneapolis, MN

Senior DataStage Developer

Responsibilities:

  • Work with the BA and technical architect to prepare the design douments and mapping updates required.
  • Provided solutions to implement and design new data elements into data models and enable flow of data to different domains.
  • Worked with technical architect to setup the end-to-end various components of ETL framework for this project.
  • Designed and developed jobs using ETL datastage to handle claims data. Worked in Lab and Galaxy exchange data to capture data from the galaxy, oxford and UDW sources.
  • Developed jobs using ETL Datastage 11.7 to process RX Claim data for Retrospective and Prospective runs. This includes the data analysis and data generation for multiple sources in ORX.
  • Look-ups on flat files and databases, aggregation and transformation stages involved before loading to target.
  • Involved in writing shell scripts to handle Squid process and Secure file transfer(FTP/SFTP) of the data files, audit and error files which includes various level of data and transfer validation.
  • Involved in unit testing and prepared unit test cases document. Coordinated with QA team helping them with regression testing for RX Claims domain.
  • Worked with data fabric team in running squid reports and generating packaging for measure analysis.
  • Created Shell Scripts for invoking SQL scripts and scheduled those using TWS.
  • Used DataStage Director and TWS (Tivoli Integrated Portal) to schedule running the solution, testing and debugging its components, and monitoring the results executable versions (on an ad hoc or scheduled basis).
  • Involved in developing Source to Target mapping document for all the ETL jobs including the Test Cases.
  • Tuned DataStage jobs using appropriate usage of Environment variables.
  • Performed SQL and PL/SQL tuning and Application tuning using tools like EXPLAIN PLAN Involved in creation of database objects like tables, views, materialized views, procedures and packages using oracle tools like Toad, PL/SQL Developer and SQL* plus.
  • Handled errors using Exception Handling extensively for the ease of debugging and displaying the error messages in the application.
  • Involved in migrating Datastage codes to higher environment and used github to maintain version control.
  • Designed the application system structure and functional modules. Used the functional document to design logical and physical structure.

Environment: DataStage 11.5/11.7, Teradata, SQL, PL/SQL, Teradata Studio 15.0, UNIX shell Scripting, TWS, Github.

Confidential, Plano, TX

Senior DataStage Developer

Responsibilities:

  • Working in the Agile environment.
  • Involved in analysis, requirements gathering, function/technical specifications, development, deploying and testing.
  • Preparing the detail design document for the feature and getting approvals from the architects.
  • 6 months of Snowflake experience for performing the OLTP and OLAP by querying snow SQL.
  • Developed/Tested and implemented reusable scripts to move data to Amazon S3 buckets.
  • Attending the CAB meetings to get the approvals for migrating the code to the Production.
  • Hands-on with test creation, planning and execution.
  • Created the DataMarts (DM) for running the model runs for the business.
  • Extensively used Data Stage Designer stages such as ODBC, Aggregator, Transformer, Join, Pivot, FTP and Merge.
  • Extensively used Email Notification, Nested Condition, Sequencer and Terminator activities in Job Sequences.
  • Adding the file watcher jobs for generating the email notification for Business Users if there is any dependency.
  • Developed Routines for Error handling and also developed before/after job subroutine.
  • Used the Data Stage Administrator to assign privileges to users or user groups (to control which Data Stage client application or jobs they see or run), move, rename or delete projects and manage or publish jobs from development to production status.
  • Performed through data profiling by using the Investigate stage of QualityStage and also by writing PL/SQL queries to identify and analyze data anomalies, patterns, inconsistencies etc.
  • Used QualityStage (Integrity Stage) for quality checking and error detection process.
  • Used Director for executing, analyzing logs and scheduling the jobs.
  • Developed Hash files for performance improvement by reducing the reference lookup time.
  • Knowledge on Store procedures, Functions and packages in PL/SQL for Data ETL.
  • Written SQL scripts to create and drop the indexes those are passed as parameters in the pre & post sessions.
  • Involved in investigating & solving the data integrity issues.
  • Worked on scheduling tool control M for monitoring and scheduling jobs.
  • Wrote UNIX shell Scripts for file validation and scheduling DataStage jobs.
  • Sources include all Databases, API data, Flat-files from various systems including Mainframes and target DB's include SQL, Netezza, Oracle, Teradata.

Environment: IBM Information Server 11.7/11.5, Erwin 4.1, Windows 7, Unix Shell scripting, Oracle 10G, Python, Pandas, Control-M, XML, SQL, DM

Confidential, Plano, TX

Senior DataStage Developer

Responsibilities:

  • Worked in the RES team and developed several Staging Jobs, Fact Jobs and Metrics
  • Worked with requirement analyst to identify, develop business requirements, and transform it into technical requirements.
  • Implemented Aggregate, Filter, Join, Lookup, Rank and Update Strategy transformations.
  • Extensively worked with DataStage 8.5 - Designer and Director to load data from source extract files to warehouse.
  • Worked on the Hadoop to load the data to DS or write data to the Files on Hadoop Cluster.
  • Worked with promotion of Jobs to QA, UAT and Production.
  • Worked on several tickets to resolve production issues.
  • Created DataStage jobs to load data from sequential files, CSV, Flat files and DB2
  • Cleansed, standardize data using Quality stage.
  • Worked towards optimal performance when using Stages like LOOKUP, JOIN, and MERGE.
  • Designed and developed DataStage jobs for Loading Staging Data from different sources like Flat files, DB2 into Data Warehouse applying business rules which consists data loads, data cleansing, and data massaging.
  • Used the DataStage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions
  • Created Shared Container to simplify the DataStage Design, and used it as a common job component throughout the project.
  • Worked with Metadata Workbench, Import and Export of DataStage jobs using DataStage tools functionality.
  • Created Parameters and Parameter sets where necessary.
  • Tuned DataStage jobs for better performance by creating DataStage Hash files for staging the data and lookups.
  • Created job docs for several batch jobs that are scheduled in Control M and provided production support for the monitoring and rescheduling of jobs when needed.
  • Mentor offshore resources for design of the jobs and coordinate Development efforts.
  • Scheduled the server jobs using DataStage Director, which are controlled by DataStage engine and also for monitoring and performance statistics of each stage.
  • Performed functional testing for new release enhancements.
  • Participated actively in the team meetings with the developers offshore and onsite.
  • Developed Parallel jobs using Parallel stages like Merge, Join, Lookup, Transformer (Parallel), Funnel, Dataset.

Environment: IBM Information Server - DataStage 8.5, SVN, DB2, Control M 8.0, Teradata, Redhat Linux, and Windows 7

Confidential

DataStage Developer

Responsibilities:

  • Worked on all phases of software development life cycle from planning to deployment.
  • Performed requirement gathering, analysis and designing decisions based on business analysis and technical design discussions with the stakeholders.
  • Coordinated with the Business Analyst to understand and design the explanation of benefits and monthly bill reporting to ease the report generation process from the enterprise data warehouse. Designing DataStage parallel jobs involving complex business logic, update strategies, transformations, filters, lookups and necessary source-to-target data mappings to load the target.
  • Extensively working on job sequences to control the execution of the job flow using various activities & triggers (conditional and unconditional) like job activity, wait for file, email notification, sequencer, exception handler activity, routines (threshold) and execute command activity.
  • Extensively using the sequential file, modify, dataset, filter, funnel, join, lookup, copy, aggregator, transformer, remove duplicate and sort during ETL development
  • Implemented complex ETL jobs depending on the requirements like member eligibility, billing/payments, id card data, surprise billing, copay/deductible and access to the appropriate benefits available according to the plans/groups/class.
  • Developed parallel jobs to achieve complex change capture process to maintain history of customers.
  • Used parameters and parameter sets to aid code consistency of modules across environments.
  • Prepared and performed unit test cases according to test plan to validate the data generated.
  • Extensively used sql queries for retrieving and processing data in databases and DataStage.
  • Developed Unix shell scripts for scheduling, supplying parameter values and performing business requirements, ftp and audit activities.
  • Responsible for using different types of stages such as ODBC Connector, Oracle Connector, DB2 Connector, Teradata Connector, Transformer, Join, Sequential File to develop different jobs.
  • Developing common jobs, shared containers and server routines, which are used across the project in most of the interfaces.
  • Using Data Stage director and its run-time engine for job monitoring, testing and debugging its components, and monitoring the resulting executable versions on ad hoc or scheduled basis.
  • Conversion of old jobs in Server-version which had hashed files to a parallel version to improve performance.
  • Experience in working using Agile (SCRUM)Development Methodology.
  • Experience in logging tickets using ServiceNow, Azure DevOps CI/CD Pipeline.
  • Experience working with offshore development teams.

Confidential, Chicago, IL

DataStage Developer

Responsibilities:

  • Analyzed, conceptualized/designed the database that serves the purpose of proving critical business metrics.
  • Developed ETL procedures to ensure conformity, compliance with standards and lack of redundancy, translates business rules and functionality requirements into ETL procedures using Informatica -PowerMart.
  • Worked with ERwin tool in Data Modeling (both Physical and Logical Design)
  • Developed and documented data Mappings/Transformations, Audit procedures and Informatica sessions.
  • Assisted in the design and Maintenance of the Metadata environment.
  • Developed and tested all the backend programs, Informatica mappings and update processes.
  • Effectively managed the migration of the transformations/mappings from development to Production.
  • Developed various bulkload and update procedures and processes using SQL * Loader and PL/SQL.
  • Involved in the error checking and testing of the ETL procedures and programs of Informatica session log.

Confidential

DataStage Admin

Responsibilities:

  • DataStage Administration from implementation Stage to Support Stage with varying complex day to day functions. Implementation in customized environment including High Availability, DR Solution and Load balancing.
  • Level III DataStage Support and experience in debugging and arranging fix through patch and release deployment.
  • Working closely with IBM Engineering to identify bugs and plan Bug-fix deployment.
  • Routine maintenance activities including Start up and shut down of DataStage server, Cleanup operations and log maintenance, reporting.
  • ETL User Administration and policy enforcement for effective security.
  • Project level variable administration. Automated scripts to enable Job status information.
  • Platform support to add/modify new projects, data connections and environment.
  • Assist in Disaster recovery tasks.
  • Installation, upgradation and migration project between various versions and environments including Unix Solaris on Sun OS, Linux Redhat and Windows Server 2003.
  • Deployed SAP Plugin for DataStage. Worked with Customizing ABAP codes to extract data.
  • Deployed High availability solution for DataStage 7.5.1 on Unix Solaris Os with incorporating custom scripts and Veritas cluster software.
  • Migration of jobs from DataStage Version 6.5, 7.1 and 7.5.1 to Information Server 8.1.1.
  • Loading and maintaining Data Warehouses and Data Marts using key component DataStage (Manager, Designer, Director, and Administrator) ETL processes.

We'd love your feedback!