We provide IT Staff Augmentation Services!

Senior Etl Consultant Resume

5.00/5 (Submit Your Rating)

SUMMARY

  • 5 years of IT experience with special emphasis on system analysis, design, development and implementation of ETL methodologies in all phases of Data warehousing life cycle and Relational databases using IBM DataStage 11.3/9.1/8.7/8.5/8.1/7.5
  • Expert in Banking domain.
  • Strong Enterprise data warehousing experience using IBM DataStage Components like DataStage Designer, DataStage Director, DataStage Administrator and Oracle, DB2, Teradata and involved in all the stages of Software Development Life Cycle (SDLC).
  • Thorough understanding of DW principles (Fact Tables, Dimensional Tables, Dimensional Data Modeling - Star Schema and Snow Flake Schema).
  • Expert in Data Warehousing techniques for Data Cleansing, Slowly Changing Dimension phenomenon (SCD), Surrogate Key assignment and CDC (Change Data Capture).
  • Experienced in incorporation of various data sources like Oracle, DB2, Teradata and Flat files into the staging area.
  • Experienced in developing UNIX shell scripts for file validations, to run the batch processing and summarized report of data load.
  • Experience in implementing full lifecycle management to capture and migrate various DataStage ETL metadata including data mapping and other data integration artifacts (such as schedulers, scripts, etc.,) across environments including the establishment of standards, guidelines and best practices.
  • Experienced in Data Warehousing, Application Development and Production Support.
  • Experienced in creating ETL architecture design
  • Experienced in conducting design review session with different stake holders and code review sessions with developers.
  • Good experience with Oracle, Teradata and DB2.
  • Experienced in Onshore - Off Shore coordination Development and Production Support Team.
  • Excellent understanding of the DBA functions including creating tables, table spaces, databases and indexes.
  • Experience in creating Source to target mapping
  • Extensive experience in UNIX Shell Scripting
  • Worked on Scheduling tools like ControlM, Autosys for automating jobs run.
  • Excellent track record as a strong team player with effective communication, analytical and multi-tasking skills, resourceful, result driven and self-motivated.

PROFESSIONAL EXPERIENCE

Confidential

Senior ETL Consultant

Responsibilities:

  • Lead and guide development of an Datastage based ETL architecture.
  • Head complex ETL requirements and design.
  • Implement a Datastage based ETL solution fulfilling stringent performance requirements.
  • Collaborate with the reporting teams to load the data as per the business requirement to be populated on the end user reports.
  • Worked on creating source to target mappings and designing ETL architecture
  • Assess requirements for completeness and accuracy.
  • Determine if requirements are actionable for ETL team.
  • Conduct impact assessment and determine size of effort based on requirements.
  • Develop full SDLC project plans to implement ETL solution and identify resource requirements.
  • Perform as active, leading role in shaping and enhancing overall ETL Datastage architecture.
  • Identify, recommend and implement ETL process and architecture improvements.
  • Assist and verify design of solution and production of all design phase deliverables.
  • Manage build phase and quality assure code to ensure fulfilling requirements and adhering to ETL architecture.
  • Resolve difficult design and develop issues.
  • Identify bugs when developers are not able to do so.

Environment: IBM InfoSphere DataStage 11.3, Oracle 11g, ControlM, LINUX Shell Scripting,Congnos 10.01

Confidential

Senior Software Engineer

Responsibilities:

  • Assisted in the creation of an enterprise operational data store and analytical data warehouse.
  • Built DataStage ETL interfaces to aggregate, cleanse and migrate data across enterprise-wide MDM ODS and Data Warehousing systems using staged data processing techniques, patterns and best practices.
  • Implemented full lifecycle management to capture and migrate various DataStage ETL metadata including data mapping and other data integration artifacts (such as schedulers, scripts, etc.,) across environments including the establishment of standards, guidelines and best practices.
  • Conducted sessions on Datastage technical training at the Business unit level.
  • Conducted design review session with different stakeholders.
  • Responded to customer needs; self-starter and customer service oriented.
  • Experience with ETL Unit and Integration Test creation and verification.
  • Worked within the team to make appropriate, effective decisions related to project responsibilities and to initiate and follow-up on assigned tasks without supervision.
  • Provided support and guidance by creating Release, Deployment & Operation guide documents.
  • Worked on various defects raised by the concerned business teams from various entities.
  • Worked on various stages like Transformer, Join, Lookup, Sort, Filter, Change Capture and Apply stages.
  • Involved in Unit Testing, SIT and UAT Worked with the users in data validations.
  • Extensively worked in improving performance of the jobs by avoiding as many transforms as possible.
  • Prepared documentation for unit, integration and final end - to - end testing.
  • Helped in preparing the mapping document from source to target.
  • Designed and developed ETL processes using DataStage designer to load data from Main Frame files, DB2 UDB, Sequential Files (Fixed Width) to staging database and from staging to target Data Warehouse database.
  • Used DataStage stages namely Sequential file, Transformer, Aggregate, Sort, Datasets, Join, Funnel, Row Generator, Remove Duplicates, Copy stages in accomplishing the ETL Coding.
  • Developed job sequencer with proper job dependencies, job control stages, triggers, and used notification activity to send email alerts.
  • Excessively used DS Director for monitoring Job logs to resolve issues.
  • Documented ETL test plans, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.
  • Used ControlM job scheduler for automating the monthly regular run of DW cycle in both production and UAT environments.
  • Wrote Shell Scripts to check for the existence of files and to check for the actual rows as against the expected rows and implemented the script Before-job Subroutines.
  • Worked closely with QA Testers for the resolution of the data defects identified by them through the Application Lifecycle Management.
  • Participated in discussion with Project Manager, Business Analysts and Team Members on any technical and/or Business Requirement issues in weekly status meetings.

Environment: IBM InfoSphere DataStage 8.5/7.5, Oracle 10g, Teradata 13, Sequential files, ControlM, UNIX Shell Scripting, COGNOS10.01.

Confidential

Software Engineer

Responsibilities:

  • Involved in day to day production support activities.
  • To check if the files are available in the landed directory and if any files missing raise ticket to the concerned team for missing files
  • Monitored the production batch cycle to ensure the successful completion
  • Investigate on the failures if any and take appropriate action to fix the issue
  • Maintained service tracker sheet to track all the failures, root cause of the failures and fixes applied in the production cycle
  • Hold the jobs, Force Ok the jobs, ForceRun the jobs, Delete the jobs from schedule in control m scheduler depending on the situation
  • Involved in the enhancements of the process of the existing production process
  • Implemented table partitioning for oracle tables, to increase the performance of DataStage jobs
  • Optimized/Tuned DS jobs for better performance and efficiency
  • Interacted with End user community to understand the business requirements and with Functional Analyst to understand the Functional Requirements identifying data sources and its implementations.
  • Analyzed the existing informational sources and methods to identify problem areas and make recommendations for improvement. This required a detailed understanding of the data sources and researching possible solutions.
  • Worked with DBAs, Unix system Admins and several teams to fix the production issues
  • Monitored the disk spaces on the Unix server
  • Created Unix Shell scripts for file monitoring,file validations,archiving the files and purging the files that are older than retention period
  • Created Unix shell scripts to run the batch jobs and sql files
  • Created automation scripts to generate the statistical information for all the tables loaded on that day

Environment: IBM InfoSphere DataStage 8.0/7.5, Oracle 10g, Teradata, Sequential files, ControlM, UNIX Shell Scripting, COGNOS10.01.

We'd love your feedback!