Etl Support
SUMMARY:
- Senior IT Professional with over 10 years of experience providing data integration and data visualization solutions with extensive experience in design, development, administration and maintenance of ETL projects with large OLTP and OLAP systems, as well as Big Data Hadoop platforms, in Finance, Healthcare, Retail and Insurance domains.
- Over 10 years of experience in Data warehouse development and maintenance projects, including business requirements gathering, technical design, development, testing, implementation and production support following Data warehousing and ETL Best Practices
- Advanced Knowledge and expertise in designing and developing ETL jobs using IBM Infosphere Datastagev11.x/9.x/8.x
- Experience working on Big Data Hadoop platforms such as IBM Biginsights and Hortonworks.
- Hands on experience with Hadoop components using Hive, Sqoop, Pig, Spark and Ambari.
- Hands on experience in Datastage Administration - Installation, Configuration and Server Maintenance.
- Extensive experience in writing advanced SQL Queries for relational databases Oracle, MS SQL, Teradata, Netezza, DB2, and Oracle Exadata.
- Experience in writing PL/SQL stored procedures, functions and packages.
- Extensive experience with SAP Business Objects including Universe creation, Webi reports and Dashboards
- Hands on experience in Data visualisation tools like SAS and Tableau.
- Extensive experience working with Unix Operating System - Suse, Red Hat, AIX.
- Experience in writing complex Unix Shell Scripts
- Experience in Data Profiling to identify and fix data quality issues while working with source application teams and end users.
- Expertise in Creating Deployment/Implementation Plans for code migration to Production Environment.
- Extensive experience in Unit Testing, User Acceptance Testing, Integration Testing, Performance Testing and Regression Testing.
- Experience in Datastage Upgrade and Migration projects - from planning to execution.
- Strong data warehousing concepts and Dimensional Modelling Concepts. (Fact/Dimension Tables, Star and Snowflake schema modelling)
- End to End experience in Software Development Life Cycle including analysis, design and implementation of software applications.
- Vast experience in Agile software development methodology and Waterfall methodology.
- Experience in creating and maintain high quality Project Documentation: Technical Design documentation, Test documentation (Test Plan, Test Cases and Test Data), job scheduling details and Implementation Plans.
- Extensive Knowledge of production support /maintenance processes and tools. (Incident, Defect and Change Management)
- Extensive Experience in analysing and troubleshooting production job failures and data discrepancies.
- Experience in ETL Job Monitoring and Scheduling using tools ESP, UC4 and Control M.
- Proven expertise in identifying performance bottlenecks and performance tuning of ETL jobs
- A self-motivated individual with excellent communication, time management and organization skills with the ability to carry out work in both team environment and working independently.
TECHNICAL SKILLS:
- Windows, UNIX, Linux
- Infosphere Datastage(v11.x/9.x/8.x), Ab-Initio, Informatica, Talend
- SQL, PL/SQL, UNIX Shell Scripting, XML, Python, C, C++, Java
- Oracle, MS SQL, Teradata, Netezza, DB2, Oracle Exadata
- Toad, WinSQL, SQLDbx, SQL Developer, Squirrel, Aginity
- SAP Business Objects, SAS, Tableau
- ESP, UC4, Control M
- ClearCase, SVN
- Hadoop, Sqoop, Pig, Hive, Amabri, Spark
- AIRS, ALM Defect Manager, Service Now, JIRA Agile, RTC, WinSCP, CoreFTP, MS Office Suite
PROFESSIONAL EXPERIENCE:
Confidential
Environment: -Datastage Server: AIX 7.1, Oracle 11g SQL, Netezza SQL, Datastagev9.1/11.3
ETL Support
Responsibilities:
- Business Requirement Gathering, Creating Design Solution for ETL applications, Development of Datastage ETL Jobs, Unit Testing, UAT Testing, Creating Implementation Plans and Deployment to Production.
- Data processing in Hadoop components using Hive, Sqoop, Pig, Ambari and Spark.
- Data profiling to identify data quality issues that can be addressed at Source System or ETL level
- Data visualization and report creation to server business users using SAP BO suite of tools
- Extract and load data into big data servers using Hive to support enterprise level data archiving
Confidential
Environment: Datastage Server: AIX 7.1, Oracle 11g SQL, Exadata, Netezza SQL, Datastagev 8.5/9.1/11.3
ETL Support
Responsibilities:
- Initial IIS 9.1 server setup on the new AIX 7.1 platform and subsequent routine patching.
- Business Requirement Gathering, Creating Design Solution for ETL applications, Development of Datastage ETL Jobs, Unit Testing, UAT Testing, Creating Implementation Plans and Deployment to Production.
- Datastage Administration, server maintenance, user account creation and managing UNIX file systems.
- Data profiling to identify data quality issues that can be addressed at Source System or ETL level
- Onsite Co-ordinator for Offshore Team
Confidential
Environment: Host Datastage Server: Solaris v 5.1, Teradata SQL,Oracle 10g, Datastagev8.1/9.1.
Responsibilities:
- Onsite Project Lead (8 Member Offshore team) for entire testing and enhancement effort for 8500 Datastage jobs in 100 plus Datastage projects. Responsible and accountable for Planning and designing the approach for the upgrade process
- Single Point of Contact for Business and other external teams to sort out the dependencies and impact related issues.
- Owner of entire Project documentation and tracking.
- Responsible for providing Project Status report to higher management.
- Onsite ETL Tech Lead for enhancement and development efforts for new and existing data marts.
Confidential
Offshore Project Lead
Responsibilities:
- Business Requirement Gathering, Creating Design Solution for ETL applications, Development of Datastage ETL Jobs, Unit Testing, UAT Testing, Creating Implementation Plans and Deployment to Production.
- Job Monitoring, analysis and troubleshooting Production Job Failures to ensure SLA compliance.
- Communicating with stakeholders.
Confidential
Offshore Project LeadResponsibilities:
- Business Requirement Gathering, Creating Design Solution for ETL applications, Development of Ab-Initio ETL Jobs, Unit Testing, UAT Testing, Creating Implementation Plans and Deployment to Production.
- Job Monitoring, analysis and troubleshooting Production Job Failures to ensure SLA compliance.
- Creating and maintaining project documents.
Environment: Host Datastage Server: Solaris v 5.1, Oracle 10g, DB2, Datastage 7.5
Confidential
Offshore Project LeadResponsibilities:
- Business Requirement Gathering, Creating Design Solution for the project, Development of Datastage ETL Jobs, Unit Testing, UAT Testing, Creating Implementation Plans and Deployment to Production.
Environment: -Host Datastage Server: Solaris v 5.1, Target: Oracle 10g, Informatica v8/v7