Infosphere Datastage Project Lead Resume
SUMMARY
- He has over 14+ years of experience in the Software industry specializing in, Data Integration, Business Intelligence, and Analytics & Data Visualization practice serving diverse organizational landscapes to some of large Fortune 500 clients across industries like Banking & Financial, Telecom, Insurance and Health.
- Experienced in all phases of the SDLC including Requirement gathering, Architecture, Modelling, design & development, and Testing & implementation.
- Expert in designing Business Models to meet the complex reporting requirements using IBM InfoSphere DataStage, AWS, SNOWFLAKE.
- Excellent working experience in Data integration ETL tools like IBM DataStage and Informatica for transforming and loading data into reporting data marts.
- Good experience in Enterprise Data Governance, Data Quality Reporting, Data Quality Exception tracking and creating Data Quality KPI Reporting matrices.
- Expert in designing Parallel jobs using various stages like Join, Merge, Lookup, Sort, Filter, Dataset, Lookup file set, Complex flat file, Modify, Aggregator, XML. Experience in analyzing the data generated by the business process, defining the granularity, source to target mapping of the data elements, creating Indexes and Aggregate tables for the data warehouse design and development.
- Proficient in dimensional modeling (Star Schema modeling, and Snowflake modeling).
- Excellent working experience in creating Data models for reporting data marts using base tables, aggregate tables, materialized views etc.
- Strong working experience in writing SQLs in databases like Teradata, Oracle, DB2, SQL Server and writing PL/SQL on Oracle DB.
- Expert in designing interactive drill down reports, drill through reports, bursting reports, Geo - Spatial dashboards, advanced visualization dashboards and implementing object & data level security.
- Expert in designing Application specific dashboards using Splunk.
- Experienced in implementing end-to-end DevOps pipeline using Jenkins and Bitbucket (Git repo) using declarative/scripted Jenkins’s file pipeline.
- Excellent understanding of Cloud concepts and Data engineering concepts (AWS).
- Good experience working in agile methodology projects, adhering to scrum best practices and deliverable tracking using JIRA boards.
- Well versed in Business Intelligence Architecture, Installation & Maintenance, Content & User administration and setting up security.
TECHNICAL SKILLS
ETL Tools: IIS Suite, DataStage 11.5/8.X/7.X, IA
Cloud: AWS
Databases & Tools: SQL, DB2, Oracle11i /12c, Teradata
Data Warehouse Model: Snowflake, Star Schema, Snowflake Schema
Scripting: Linux/Unix, Python, Basic
Big Data & Eco Systems: HDFS, Hive, Pig, Sqoop, Oozie, Zookeeper
Other Utilities: Data Warehousing, Quality Stage, Lotus Notes
Operating System: Windows2007, XP/Unix, RedHat Linux
Programming Languages: C, C++, Perl, Java
PROFESSIONAL EXPERIENCE
Confidential
Infosphere DataStage Project Lead
Responsibilities:
- Create ETL mappings
- Render solutions for requirements and enhancements and provide designs for the same.
- Review Detailed Technical designs
- Carry out Historical data load on production (first time run)
- Co-ordinate with the data sourcing team and ensure on-time source data availability.
- Distribute the daily load flows, monthly load flows responsibility between onshore and offshore teams to enable continuous data loads.
- Monitor execution and ensure successful data loads.
- Load the historical data in AWS S3
- Test, conclude and report the benchmark time for all dimensions and facts loads.
- Create templates/standard documents such as ETL estimation, delivery packet templates, mapping docs etc.
- Prepare SQL queries and assist team in the same to perform SIT/Preproduction testing
- Review code / Performance improvement of ETL jobs
- Handled the XML as source files and involved in performance tuning with XML stages.
- Created checker scripts for validating the fact and dimensions records and incorporated the same in Unix scripts after loading.
- Conducted Work Product Audit for each deliverable and share the documents with the clients.
- Extensively used the stages SAP connector/ XML/CDC /Transformer/Funnel/Filter and most of all other ETL stages.
- Developed ETL transformations that sourced from a variety of Heterogeneous sources including Microsoft Access, Text files, CSV files, XML files.
- Implemented complex business requirements in the backend using efficient SQL queries and facilitated easy implementation of front-end applications.
- Built efficient, complex, parameterized SQL queries and stored procedures to produce output data sets.
- Supported the Project in post-Production for 2 weeks.
- Developed shell script for data merge and scheduling.
- Working with the ETL specialist and OLAP/reporting administrator/developer to schedule jobs optimally.
- Prepare project best practice document and Production Support documents like scheduling doc/job monitoring doc etc.
- Working on POC to load the data into Snowflake through AWS S3 tables.
Confidential
Infosphere Migration Project Lead - Development
Responsibilities:
- InfoSphere 11.5 Platform Initial Setup and AD group configuration setup/ Participated in Architecture design and its documentation.
- Involved in estimation and deliverables for DataStage server migration.
- Configured the SP BW connection for DataStage 11.5.
- Analyze existing Infrastructure and DataStage jobs, ensuring best practices are being followed, and recommending short term and long-term improvement roadmap.
- Provide technical expertise, direction, and development support for the ETL development team as well as support to the developers.
- Migrated applications from 8.7 to 11.5 DataStage application.
- Migrated the databases from oracle 11g to 12c.
- Execute and write Metadata queries.
- Effectively managed product gaps from business specifications to product enhancement and / or business process change
- Used various stages SAP connector / XML/Transformer/Funnel/Filter and most of all other ETL stages.
- Developed ETL transformations that sourced from a variety of Heterogeneous sources including Microsoft Access, Text files, CSV files, XML files.
- Implemented complex business requirements in the backend using efficient SQL queries and facilitated easy implementation of front-end applications.
- Built efficient, complex, parameterized SQL queries and stored procedures to produce output data sets.
- Optimized and performance tuned existing reports to provide smooth user functionality.
- Analyzed, converted, tested, reconciled, and implemented reports in the Ease Oscar / VSC various application.
- Implemented best PR Configurations to reduce maintenance overhead and complexity.
- Created mapping specification documents to define and document source and target attributes.
- Implemented user level security by creating a table that stored usernames, user groups and their specific permissions.
- Implement procedures for maintenance, monitoring, backup, and recovery operations for the DataStage.
- Developed a parallel version data comparison utility to compare the data between the older version and newer version for critical projects and PII Data.
- Effectively tested the PII data without violating the security violations.
Confidential
InfoSphere sustain offshore lead - Sustain
Responsibilities:
- I was a project lead. As part of my role, I used to perform trouble shoot on critical Application sustain issues and provide constructive solution.
- I am providing solutions to the Business Glossary/ Information Analyzer which is unique skill set. I am contributing to InfoSphere information server standards, Policies, and procedures and collaborate with other stake holders to resolve key issues in scope.
- I have conducted a code review which are developed by application teams and ensures that the optimized functional code will be moved to production. I have been through understanding of Ally Info Sphere information server architecture and a good grasp of the surrounding interfaces to contribute in design, coding, testing, support and debugging of existing applications.
- I actively participate in Business/Client Meetings and continuously track and report on progress to plan. I am currently implementing/Suggesting the critical project performance improvement strategies and have strong knowledge in Grid architecture.
- Provided 24/7 support. Maintain ownership of release activities which interact with ETL projects. Work with Prod Support to maintain and administer the ETL deployment environment.
Confidential
InfoSphere Migration DCC offshore lead
Responsibilities:
- I was a project lead for this project and involved in Analysis of Business Requirements, functional Requirements, and performance tuning techniques and standardize the code in Ally format.
- I have code Reusable components in DataStage and developed unique DataStage accelerators tool to avoid manual efforts. I have involved in test Data preparation, Unit Testing and Code Review and Defined business specifications with the internal user community for the global deployment of the application.
- I effectively managed product gaps from business specifications to product enhancement and / or business process changes. I have provided technical support for implemented applications; diagnosing and reporting bugs, applying patches and upgrades as needed.
- I was interacted with senior management within product development, Business organizations and global IT provided technical assistance and support to customers in a professional manner while working with other members of a team.
Confidential
InfoSphere Migration DCC offshore leadResponsibilities:
- Analyzed, converted, tested, reconciled, and implemented reports in the Ease Oscar / VSC various application.
- Implemented complex business requirements in the backend using efficient SQL queries and facilitated easy implementation of front-end applications.
- Built efficient, complex, parameterized SQL queries and stored procedures to produce output data sets.
- Implemented best practice Configurations to reduce maintenance overhead and complexity.
- Created mapping specification documents to define and document source and target attributes.
- Implemented user level security by creating a table that stored usernames, user groups and their specific permissions.
