We provide IT Staff Augmentation Services!

Sr. Etl/data Integration Consultant Resume

3.00/5 (Submit Your Rating)

SUMMARY:

  • Over 10 years of experience in design, development, analysis and modeling of ETL processes using IBM Infosphere Information Server Suite of products 11.x, 9.x, 8.x, Ascential DataStage 7.x/6.x, Parallel Extender 6.0
  • IBM Certified professional with experience working on MPP (Massively parallel processing) and SMP (Symmetric Multi - Processing) environments
  • Proficient in ETL techniques, Data Warehousing concepts - Slowly Changing Dimension phenomenon, surrogate key assignment and change data capture
  • Extensive knowledge in handling high volumes data and performance tuning
  • Experience in Installation, development and administration of DataStage
  • Experience in Design Optimization and Performance Tuning of DataStage jobs
  • Experience with complete SDLC and Agile application development methodologies
  • Experience in OBIEE 11g/10.x Architecture, Development, Administration and Upgrade
  • Expertise in developing Oracle BI Repository (.rpd - Physical Layer, Business Model and Presentation Layer), Time Series Objects, Interactive Dashboards / Reports with drill-down and drill-across capabilities
  • Worked on Configuration, Security setup, User Authorization/Authentication
  • Worked on Reporting Application migration from Hyperion to OBIEE
  • Strong experience on databases Oracle 11i/10gR2/10g/9i/8i, MS Access, SQL Server 2000 and Operating systems Linux, Unix and Windows
  • Experience in evolving strategies and developing Architecture for building a Data warehouse
  • In-depth knowledge of RDBMS concepts
  • Strong experience in SQL & PL/SQL stored procedures development for data cleansing
  • Strong experience in converting the business requirements into technical specifications
  • Proven problem solving skills with excellent analytical, communication and interpersonal skills
  • Ability to rapidly learn & apply new technologies and improve processes to make an impact as a productive individual contributor
  • Strong analytical experience in understanding Product specifications, functional requirement and Technical requirements

TECHNICAL SKILLS:

ETL/Reporting Tools: IBM InfoShpere Information Server 9.1, 8.5, Ascential DataStage 7.5.3/7.5.2 /6.x, OBIEE 10.x, Hyperion 8.x

Languages: C, C++, SQL, PL/SQL

Databases: Oracle 11i/10gR29i/8i, SQL Server, MS Access, Green Plum

Platforms: HP-UNIX, Linux, Windows

PROFESSIONAL EXPERIENCE:

Confidential

Sr. ETL/Data Integration Consultant

Responsibilities:

  • Architected and Designed a Common ETL Framework using IBM Infosphere for data extraction and load into multiple Data centers
  • Optimized the performance of the ETL framework by leveraging parallel processing techniques
  • Integrated the DS jobs with Green Plum DB connector for data extraction and load
  • Designed the jobs to handle high volumes and complex data masking requirements
  • Recommended and Developed a reusable dynamic module for data reconciliation and auditing
  • Created Unix Shell scripts for automation of file manipulations, error and exception handling
  • Written JIL scripts for scheduling the ETL batch jobs in Autosys
  • Responsible for Impact Analysis, Enhancements and Bug Resolutions
  • 24X7 Support and maintenance of the Applications

Environment: IBM Infosphere Information Server 11.3 / 9.1, Green Plum 4.3, Oracle 12.1, Linux, UNIX, Autosys, JIRA, PVCS, ClearQuest, Service Now

Confidential, NJ

Data Architect / Sr. DataStage Consultant

Responsibilities:

  • Developed ETL/data integration processes and programs to support the data warehousing and Business Intelligence initiatives
  • Designed and developed several Data Mart applications using IBM Infosphere Information Server Suite of Products
  • Converted the Batch processes developed using custom coding into DS Jobs
  • Built Extract/Transform/Load processes integrating with Oracle and SQL Server databases
  • Achieved performance improvements and increased productivity by distributing processing loads across multiple nodes in a Grid environment
  • Developed Multiple instance DS jobs with throttling capabilities to meet the SLA
  • Configured jobs to run using Dynamic Configuration files
  • Extensively worked on Partitioning, CDC and SCD concepts
  • Implemented Parameterization using Parameter sets and Value files
  • Defined Restartability, Exception handling and Error handling in Job sequences
  • Configured database connections that utilize ODBC and native database drivers
  • Used Information Server Manager for DS Code deployment, code comparison and Version Control.
  • Scheduled Daily/Weekly/Monthly DS job streams using ESP
  • Created shell scripts for running DS jobs, Back up datasets, DS jobs log purge
  • Created PL/SQL stored procedures, functions and packages for Audits and Controls
  • Handled environment upgrades/Migrations between multiple versions of DataStage; Upgrades for Datastage technical infrastructure
  • Documented Guidelines on Datastage development Standards, Best practices and Fine Tuning ; Supported Confidential application developers in design challenges
  • Developed Daily/Weekly Datastage batch streams for processing flat files and loading into repository
  • Created shell scripts for data validations, balancing and file transfers
  • Fine-tuned handling of large volumes of data and sort operations
  • Worked on back up, archive and purge process
  • Gathered functional and technical requirements; Created interface agreements
  • Developed Datastage job streams and scheduled them using ESP
  • Built Datastage routines for Date transformations
  • Created shell scripts for error and exception handling
  • Developed DS jobs to cleanse, transform and load historic employee data into oracle database
  • Developed pre and post process validations and generated statistical data status reports
  • Designed and developed DS jobs involving complex dynamic data mapping
  • Designed and developed OBIEE metadata repository (.rpd) that includes physical, BMM and presentation layers with Facts / dimensions, aggregates, session variables, data filters, external table security, multiple subject areas
  • Developed and modified ETL processes to support BI capabilities
  • Leveraged a BI Common security model (BICS) and LDAP servers for user authorization/Authentication
  • Created reports that existed in Hyperion reporting tool in OBIEE
  • Extensively developed and debugged Dashboards involving various analytical views (Pivot, Column Selector)

Environment: IBM Infosphere Information Server 8.5, Ascential Datastage 7.5.3, Oracle 11g/10gR2, DB2, SQL Server, Linux, OBIEE 10.x, Hyperion 8.x, Ganglia, SQL Developer, ESP, PVCS Serena Changeman

Confidential, TN

Sr. DataStage Developer

Responsibilities:

  • Used the DataStage Designer to develop processes for Extracting, Transforming, Integrating, and Loading data into Oracle database from external Source Systems
  • Designed DataStage Parallel jobs involving complex business logic, update strategies, transformations, filters, lookups and necessary source-to-target data mappings to load the target
  • Extensively worked on Dataset, Sequential File, Join, Merge, Look Up, Filter, Aggregator stages
  • Created several Job Sequences for the maintenance of Data Stage jobs using Wait for file, Job Activity, Execute Command, Exception Handler, Job Sequencers and User Variable stages
  • Developed solutions for complex logic by writing Before/After Routines and contributed in Parameterization of DataStage jobs through parameter file
  • Highly focused on Tuning of Data Stage jobs for better performance
  • Worked with DataStage Manager to import/export metadata, DataStage Components between the projects
  • Used DataStage Director to Run and Monitor the Jobs for Performance Statistics
  • Responsible for monitoring/troubleshooting DataStage jobs during the production data load processes
  • Created database objects like Tables, Views, Indexes, Procedures using Oracle tool - SQL Developer
  • Extensively wrote user-defined SQL coding for overriding for Auto generated SQL query in DataStage
  • Responsible for Documentation of the Test cases, completed modules and the results of acceptance testing
  • Interacted with Business Analysts and Subject Matter Experts to identify information needs and business requirements

Environment: Ascential DataStage 7.5.2 Enterprise Edition (Designer, Director, Manager), Oracle 10g, UNIX AIX 4.2, UNIX Shell Scripts, SQL Developer, Windows Xp

Confidential, WA

ETL Consultant

Responsibilities:

  • Developed DataStage jobs for Extracting, Cleansing, Transforming and Loading of the data into Data Warehouse from the Facets Source system
  • Extensively worked on Hash-file Stage for look- Confidential, ODBC, Hashed file, Aggregator, Sequential file, Link Partitioner and Link Collector stages
  • Created several general routines (Before-After, Transform function) used across the project
  • Created and used local containers, shared containers for multiple jobs, which have the same business logic.
  • Developed and implemented strategies for Slowly Changing Dimensions, surrogate key generation and for Incremental data loading
  • Involved in Tuning of Data Stage server jobs for better performance
  • Used the DataStage Director extensively to run, monitor, debug and test the job on development, and to obtain the performance statistics.
  • Performed Import and Export of DataStage components and table definitions using DataStage Manager
  • Developed stored procedures for Data testing, Data Quality on Monthly basis, Data validations on a Weekly / Monthly basis
  • Created Windows script files (wsf) for automation of file manipulation and data loading procedures
  • Responsible for monitoring/troubleshooting DataStage jobs during the production data load processes.
  • Participated in Code reviews, meetings with Users and Business Analysts.

Environment: Ascential DataStage 7.5 (Designer, Director, Manager) SQL server 2000, PVCS, Windows Script Files, VB Script, Syncsort 3.9.0, Windows Xp

We'd love your feedback!