Sr Data Stage Administrator Resume
SUMMARY
- IT professional with over 8+ year experience in Development, Administration and Sustaining of IBM Datastage v 11.3
- Experienced in installation, configuration and setup of Datastage on Linux and Unix Servers
- Experience in sustaining Jobs/hot fix on IIS 11.x PRD environment (correct job variables, unlock jobs, recompile jobs)
- Experience in configuring PAM authentication in Information Server 11.x environments
- Expertise in providing capacity estimates for Datastage, Database servers
- Experienced in applying Hot fixes and incremental patches across all the datastage environments
- Experience with configuring connectors, SAP packs and ODBC driver
- Experience in Release Management, Code versioning and Deployments
- Experience in SOX and Security remediation’s of production datastage servers
- Experience in capacity sizing and resource estimates for and Active - Active setup
- Experience Onboarding users and setting up the users for accessing Datastage, Information Analyzer and Metadata workbench
- Experienced in automating the maintenance tasks, backups and deployment packages
- Good experience in migrating from Datastage version 8.7 to 9.1 and from 9.1 to 11.3
- Excellent experience in working with Parallel jobs, Sequencer Jobs, debugging, troubleshooting and performance tuning.
- Experienced in production support and proactive monitoring of datastage projects
- Extensively worked with Data stage Parallel Extender while working with high volume data sources and performed debugging, troubleshooting and administration activities.
- Proficient in interaction with the business users. Experienced with load strategies of loading staging area and data marts. Dealt with SCD Type1/Type2 loads.
- ETL Performance Monitoring and Tuning to enhance the Analyze ETL workflows to identify performance bottlenecks by appropriately using the Datastage job stages and Partition methods.
- Strong understanding of the principles of Data Warehouse using Fact Tables, Dimension Tables, Star Schema modeling and Snowflake Schema modeling.
- Experience in developing datastage parallel that involves complex transformations and parsing unstructured data
- Worked with SQL, SQL*PLUS, Table Partitions, Triggers, SQL queries, and loading data into Data Warehouse/Data Marts
- Experience in writing UNIX Shell scripts for various purposes like file validation, automation of ETL process and job scheduling using CA Work Load Automation (Autosys) and Crontab.
- Experience in integration of various data sources like Oracle and Flat files into the Staging Area.
- Possess strong communication skills and believes in team work and cooperation.
- Good aptitude for problem solving and logical analysis. Excellent coordination skills and work experience as a team member.
TECHNICAL SKILLS
Tools: Infosphere 11.3/8.7(DataStage, Quality Stage, Information Analyzer, Metadata WorkBench, FastTrack, Business Glossary), Erwin, IBM Connect Direct, Message Queue, Informatica 8.6.1
Database: Teradata 14, Oracle 12 C/11g, SQL Server 2012
Big data/Hadoop: Hadoop, HDFS, Hive, Pig, Sqoop, Flume, Map Reduce, Horton Works, and Cloudera.
Scheduler: CA Autosys, Tidal, Tivoli Work SchedulerReporting Cognos 10.2, Tableau 9.2
Platform: Suse Linux, Redhat Linux and Oracle Enterprise Linux
Scripting: PL/SQL, UNIX
PROFESSIONAL EXPERIENCE
Confidential
Sr Data Stage Administrator
Responsibilities:
- Involved in analysis of source systems, business requirements and identification of business rules.
- Performed Installation and migration of IBM Infosphere Information Server 11.3.1.2/8.7 on Linux platforms.
- Performed Project creation, Project environment variable setup, and Backup automation.
- Implemented deployment workflow and source code control automation ITLAB, DEV, Pre-Prod and Prod Environments.
- Performed security scan remediation’s for communication layer protocol and installed third party security s
- Configured an SMP and MPP systems on blades with Suse,Redhat and Oracle Enterprise Linux
- Configured information analyzer and Information governance catalog and resolved any issues with IBM support by creating PMR.
- Part of Data Management and Analytics platform that performs Code versioning and Code deployments for all the projects.
- Worked on migrating from datastage 7.5.3 to Information server 8.7 and from 8.7 to 11.3.1.2.
- Created scripts to start/stop datastage engine, ASB server and ASB agent daily before the nightly batch cycle starts.
- Enhanced the Job Performance by using proper partitioning methods and analyzing the resources utilized using Job Monitor.
- Perform connection management with Databases
- Configured LDAP authentication for Information Server installation.
- Performed code changes/created new ETL's as part of Enhancement Changes.
- Implemented the Slowly Changing Dimension (SCD) strategy in Datastage, for Dimension tables for storing history data.
- Created SQL validation scripts to monitor the quality of daily batch cycle.
- Worked on setting up Autosys jobs and migrating Autosys jobs across environments.
- Production support in Datastage and UNIX with Backend database oracle.
- Worked on production defects with in the environment which includes Datastage job, shell scripts, Autosys and Oracle Database related.
- Worked on data analysis and fixes related to data inconsistency.
- Worked on performance analysis and performance enhancement of ETL jobs.
Confidential
Sr Data Stage Consultant
Responsibilities:
- Involved in analysis of source systems, business requirements and identification of business rules.
- Created common ETL Patterns to reduce/automate the Code Development effort and help reduce the clients demand
- Created Technical design document and Data mapping documents.
- Involved in a POC to parse JSON data and write the exceptions of vehicle diagnostic data collected to EDW.
- Implemented Audit, Error Handling and Restart ability frameworks.
- Provided the estimation for the Datastage jobs based on the job complexity.
- Used IBM Info Sphere Data Quality for cleansing and standardization of addresses and customer names
- Created DDL’s, Triggers and Stored Procedures.
- Data Stage job design, development & debugging to populate data to the target tables.
- Created job sequences, subsequences and master sequences to control the flow of jobs.
- Used Information Analyzer to perform column analysis
- Used Database Connectors to Extract and Upsert the data.
- Designed Sequencer to automate the whole process of data loading.
- Developed ETL test plans based on test strategy.
- Created and executed test cases and test scripts based on test strategy and test plans based on ETL Mapping document.
- Created SQL Scripts required for extracting data from various tables.
- Performed Unit and System Testing and validated the test cases by comparing the actual results with expected results.
- Assisted in user acceptance testing of code in UAT and Pre-production environments.
- Prepare and schedule the ETL workflows using Autosys for Scheduling and to automate the whole process of data loading the Jobs based on the dependency.
- Participate in design walk-throughs and code walk-throughs
- Worked on HP Quality center to raise and resolve defects identified in Test and UAT environments
Confidential
ETL Datastage Specialist
Responsibilities:
- Developed ETL jobs involving complex data extractions and transformations using Transformer, Sequential Files, Funnel, Oracle Connector, Lookup and Join stages.
- Developed Routines and Shared Containers to implement the error logging logic.
- Knowledge in analyzing the data dependencies using Metadata stored in the Repository and preparing batches for the existing sessions to facilitate scheduling of multiple sessions.
- Created UNIX shell scripts for executing the sequence jobs across monthly and quarterly.
- Testing is performed and the data reports are generated automatically by developed scripts confirming completeness and ensuring job correctness.
- Expert in troubleshooting of Datastage Jobs and addressing production issues such as performance tuning and enhancement.
- Providing reusable and scalable architecture for designing Datastage Jobs loading staging and Operation Data Store.
- Understanding the volume of data, Tuning Datastage Job configurations and SQL queries to meet SLA requirements.
- Documenting modifications and enhancements made to warehouse as required by the project, also involving Architecture Design Documents, Technical design documents.
- Designing a common Datastage interface which can validate the files based on data validation rules and provide a result on the status of the file acceptance.
- Fixing the defects using Quality Center for Systems Integrations and Performance testing. Incident tickets were addressed during production.Coordinating with Tivoli scheduling team, production support team and development team to deploy code in production environments and creating documents defining company standard procedures and specifying the ETL logic implementations including version details for analysis and debugging.
Confidential
Datastage Developer
Responsibilities:
- Designing, executing and unit testing DataStage jobs
- Designing jobs to accommodate historical data migration, data captured during historical data migration and daily and monthly interfaces
- Generating Cognos reports for audit and error records
- Creating PL/SQL scripts to perform unit and regression testing
- Understanding how the data is spread across various systems and arrange the data in a chronological order right from data from which extended warrant was originated to latest available date
- Design DataStage jobs that processes data from all the source systems arrange them in an order and load iWarrant back end database
- Design reconciliation scripts for unit and regression testing,
- Creating technical design and unit test case documents
Confidential
PL/ SQL Developer
Responsibilities:
- Work Closely with Business Users to understand requirements and Creating Design specification
- Created new Procedures, Functions, Triggers, Materialized Views, Packages, Simple, Ref & Traditional Cursors, Table functions as part of Project/Application requirements.
- Worked on creating various scripts and package for Financial Reconciliation processing.
- Involved in Unit Testing Stored Procedures and Functions.
- Created Materialized Views and partitioning tables for performance reasons.
- Worked on various back-end Procedures and Functions using PL/SQL.
- Coordinate with the front end design team to provide them with the necessary stored package and procedures and necessary insight into the data.
- Designing Tables, Constraints, Views, and Indexes etc. in coordination with the application development team
- Used TOAD, PL/SQL developer tools for faster application design and developments
- Tuned complex Stored Procedures for faster execution and Developed database structures, according to the requirements