Sr. Etl/data Integration Consultant Resume
SUMMARY:
- Over 10 years of experience in design, development, analysis and modeling of ETL processes using IBM Infosphere Information Server Suite of products 11.x, 9.x, 8.x, Ascential DataStage 7.x/6.x, Parallel Extender 6.0
- IBM Certified professional with experience working on MPP (Massively parallel processing) and SMP (Symmetric Multi - Processing) environments
- Proficient in ETL techniques, Data Warehousing concepts - Slowly Changing Dimension phenomenon, surrogate key assignment and change data capture
- Extensive knowledge in handling high volumes data and performance tuning
- Experience in Installation, development and administration of DataStage
- Experience in Design Optimization and Performance Tuning of DataStage jobs
- Experience with complete SDLC and Agile application development methodologies
- Experience in OBIEE 11g/10.x Architecture, Development, Administration and Upgrade
- Expertise in developing Oracle BI Repository (.rpd - Physical Layer, Business Model and Presentation Layer), Time Series Objects, Interactive Dashboards / Reports with drill-down and drill-across capabilities
- Worked on Configuration, Security setup, User Authorization/Authentication
- Worked on Reporting Application migration from Hyperion to OBIEE
- Strong experience on databases Oracle 11i/10gR2/10g/9i/8i, MS Access, SQL Server 2000 and Operating systems Linux, Unix and Windows
- Experience in evolving strategies and developing Architecture for building a Data warehouse
- In-depth knowledge of RDBMS concepts
- Strong experience in SQL & PL/SQL stored procedures development for data cleansing
- Strong experience in converting the business requirements into technical specifications
- Proven problem solving skills with excellent analytical, communication and interpersonal skills
- Ability to rapidly learn & apply new technologies and improve processes to make an impact as a productive individual contributor
- Strong analytical experience in understanding Product specifications, functional requirement and Technical requirements
TECHNICAL SKILLS:
ETL/Reporting Tools: IBM InfoShpere Information Server 9.1, 8.5, Ascential DataStage 7.5.3/7.5.2 /6.x, OBIEE 10.x, Hyperion 8.x
Languages: C, C++, SQL, PL/SQL
Databases: Oracle 11i/10gR29i/8i, SQL Server, MS Access, Green Plum
Platforms: HP-UNIX, Linux, Windows
PROFESSIONAL EXPERIENCE:
Confidential
Sr. ETL/Data Integration Consultant
Responsibilities:
- Architected and Designed a Common ETL Framework using IBM Infosphere for data extraction and load into multiple Data centers
- Optimized the performance of the ETL framework by leveraging parallel processing techniques
- Integrated the DS jobs with Green Plum DB connector for data extraction and load
- Designed the jobs to handle high volumes and complex data masking requirements
- Recommended and Developed a reusable dynamic module for data reconciliation and auditing
- Created Unix Shell scripts for automation of file manipulations, error and exception handling
- Written JIL scripts for scheduling the ETL batch jobs in Autosys
- Responsible for Impact Analysis, Enhancements and Bug Resolutions
- 24X7 Support and maintenance of the Applications
Environment: IBM Infosphere Information Server 11.3 / 9.1, Green Plum 4.3, Oracle 12.1, Linux, UNIX, Autosys, JIRA, PVCS, ClearQuest, Service Now
Confidential, NJ
Data Architect / Sr. DataStage Consultant
Responsibilities:
- Developed ETL/data integration processes and programs to support the data warehousing and Business Intelligence initiatives
- Designed and developed several Data Mart applications using IBM Infosphere Information Server Suite of Products
- Converted the Batch processes developed using custom coding into DS Jobs
- Built Extract/Transform/Load processes integrating with Oracle and SQL Server databases
- Achieved performance improvements and increased productivity by distributing processing loads across multiple nodes in a Grid environment
- Developed Multiple instance DS jobs with throttling capabilities to meet the SLA
- Configured jobs to run using Dynamic Configuration files
- Extensively worked on Partitioning, CDC and SCD concepts
- Implemented Parameterization using Parameter sets and Value files
- Defined Restartability, Exception handling and Error handling in Job sequences
- Configured database connections that utilize ODBC and native database drivers
- Used Information Server Manager for DS Code deployment, code comparison and Version Control.
- Scheduled Daily/Weekly/Monthly DS job streams using ESP
- Created shell scripts for running DS jobs, Back up datasets, DS jobs log purge
- Created PL/SQL stored procedures, functions and packages for Audits and Controls
- Handled environment upgrades/Migrations between multiple versions of DataStage; Upgrades for Datastage technical infrastructure
- Documented Guidelines on Datastage development Standards, Best practices and Fine Tuning ; Supported Confidential application developers in design challenges
- Developed Daily/Weekly Datastage batch streams for processing flat files and loading into repository
- Created shell scripts for data validations, balancing and file transfers
- Fine-tuned handling of large volumes of data and sort operations
- Worked on back up, archive and purge process
- Gathered functional and technical requirements; Created interface agreements
- Developed Datastage job streams and scheduled them using ESP
- Built Datastage routines for Date transformations
- Created shell scripts for error and exception handling
- Developed DS jobs to cleanse, transform and load historic employee data into oracle database
- Developed pre and post process validations and generated statistical data status reports
- Designed and developed DS jobs involving complex dynamic data mapping
- Designed and developed OBIEE metadata repository (.rpd) that includes physical, BMM and presentation layers with Facts / dimensions, aggregates, session variables, data filters, external table security, multiple subject areas
- Developed and modified ETL processes to support BI capabilities
- Leveraged a BI Common security model (BICS) and LDAP servers for user authorization/Authentication
- Created reports that existed in Hyperion reporting tool in OBIEE
- Extensively developed and debugged Dashboards involving various analytical views (Pivot, Column Selector)
Environment: IBM Infosphere Information Server 8.5, Ascential Datastage 7.5.3, Oracle 11g/10gR2, DB2, SQL Server, Linux, OBIEE 10.x, Hyperion 8.x, Ganglia, SQL Developer, ESP, PVCS Serena Changeman
Confidential, TN
Sr. DataStage Developer
Responsibilities:
- Used the DataStage Designer to develop processes for Extracting, Transforming, Integrating, and Loading data into Oracle database from external Source Systems
- Designed DataStage Parallel jobs involving complex business logic, update strategies, transformations, filters, lookups and necessary source-to-target data mappings to load the target
- Extensively worked on Dataset, Sequential File, Join, Merge, Look Up, Filter, Aggregator stages
- Created several Job Sequences for the maintenance of Data Stage jobs using Wait for file, Job Activity, Execute Command, Exception Handler, Job Sequencers and User Variable stages
- Developed solutions for complex logic by writing Before/After Routines and contributed in Parameterization of DataStage jobs through parameter file
- Highly focused on Tuning of Data Stage jobs for better performance
- Worked with DataStage Manager to import/export metadata, DataStage Components between the projects
- Used DataStage Director to Run and Monitor the Jobs for Performance Statistics
- Responsible for monitoring/troubleshooting DataStage jobs during the production data load processes
- Created database objects like Tables, Views, Indexes, Procedures using Oracle tool - SQL Developer
- Extensively wrote user-defined SQL coding for overriding for Auto generated SQL query in DataStage
- Responsible for Documentation of the Test cases, completed modules and the results of acceptance testing
- Interacted with Business Analysts and Subject Matter Experts to identify information needs and business requirements
Environment: Ascential DataStage 7.5.2 Enterprise Edition (Designer, Director, Manager), Oracle 10g, UNIX AIX 4.2, UNIX Shell Scripts, SQL Developer, Windows Xp
Confidential, WA
ETL Consultant
Responsibilities:
- Developed DataStage jobs for Extracting, Cleansing, Transforming and Loading of the data into Data Warehouse from the Facets Source system
- Extensively worked on Hash-file Stage for look- Confidential, ODBC, Hashed file, Aggregator, Sequential file, Link Partitioner and Link Collector stages
- Created several general routines (Before-After, Transform function) used across the project
- Created and used local containers, shared containers for multiple jobs, which have the same business logic.
- Developed and implemented strategies for Slowly Changing Dimensions, surrogate key generation and for Incremental data loading
- Involved in Tuning of Data Stage server jobs for better performance
- Used the DataStage Director extensively to run, monitor, debug and test the job on development, and to obtain the performance statistics.
- Performed Import and Export of DataStage components and table definitions using DataStage Manager
- Developed stored procedures for Data testing, Data Quality on Monthly basis, Data validations on a Weekly / Monthly basis
- Created Windows script files (wsf) for automation of file manipulation and data loading procedures
- Responsible for monitoring/troubleshooting DataStage jobs during the production data load processes.
- Participated in Code reviews, meetings with Users and Business Analysts.
Environment: Ascential DataStage 7.5 (Designer, Director, Manager) SQL server 2000, PVCS, Windows Script Files, VB Script, Syncsort 3.9.0, Windows Xp
