Datastage Developer Resume
TX
SUMMARY:
- Over 8 years of experience in Design, Modeling, Analysis, Development, Testing and Implementation of Data Warehouse/Data Mart Applications and Client/Server Applications on Windows and UNIX platforms using software methodologies like SDLC/Scrum Agile.
- Extensive experience in using the Data Warehousing tools, DataStage 7.5/8.5/8.7/9.1 (IBM Information server Console, Manager, Designer, Director and Administrator); extensive experience with DataStage Parallel Extender (EE),Talend - Data Integration
- Good Understanding of Hadoop ecosystem such as Job Tracker, Task Tracker, Name Node, Data Node and Map Reduce concepts,Hive,Pig and HDFS Framework
- Leadership experience to manage the technical team(off shore and on site) for specifications, design, work allocations, defect tracking, time approvals, and code reviews
- Highly expertise in performance tuning of ETL jobs and Database applications.
- Extensively worked on Datastage Parallel Jobs using various stages like Join, Lookup, Lookup File Set, Change Capture, Filter, Funnel, Copy, Column Generator, Peek, Dataset, Sequential File, Oracle Enterprise, DB2/UDB, Merge, Transformer, Aggregator, Remove Duplicates Stages, WISD Input/output stages etc.
- Extensively worked on Job Sequences to Control the Execution of the job flow using various Activities & Triggers (Conditional and Unconditional) like Job Activity, Email Notification stage, Sequencer stage, Routine activity stage and Execute Command stage.
- Excellent knowledge in Extraction, Cleansing and Modification of data from/to various relational Data Sources, Flat Files, Mainframe Systems, XML and Comma Delimited files (.csv).
- Strong knowledge in OLTP/OLAP Systems, Normalized (OLTP), Denormalized (DW and ODS) models, Dimensional Strategies, Surrogate Key, Star schema and Snowflake schema.
- Experience in UNIX Shell Programming for Scheduling, File Manipulation etc.
- Experience in integration of various data sources like DB2, Oracle and MS Access into staging area.
- Developed DataStage Routines for special jobs. Used Stage Variables, Constraints and Functions, Stored procedures, Packages (using SQL, PL/SQL).
- Experience in evolving strategies and developing Architecture for building a Data warehouse using data modeling tool ERWIN.
- Quick learner, efficient, self-motivated and success oriented. Excellent written and communication skills and ability to work independently in a time sensitive environment.
TECHNICAL SKILLS:
Languages: C, C++, CORE JAVA, HTML, SQL, T-SQL, Shell Scripting in UNIX, PL/SQL, JDBC
Databases: SQL Server 7.0/2000/2012, Oracle 11g/10g/9i/8i/7.x, MS Access, DB2
Operating Systems : Windows 95/98, Windows NT/2000, UNIX
Office Tools: MS Word, MS Excel, MS Project, MS Outlook, And MS Access
Data warehousing/DB Tools: IBM WebSphere Datastage V 8.5/8.1/8.7/9.1, Ascential Data Stage7.5, Toad, Erwin, Quality Stage (8.1), DB Visualizer
Hadoop Ecosystem: Hadoop HDFS,MapReduce,Hive,Pig,Sqoop
PROFESSIONAL EXPERIENCE:
Confidential
DataStage Developer
Environment: SQL Server 2012, Business Objects, IBM WebSphere Datastage 9.1, Oracle 11g, DB2, Control M Sc heduler, Unix Shell Scripting
Responsibilities:
- Interacted with client to gather business requirements.
- Automated the routine tasks by developing Datastage parallel jobs
- Identifying bottle necks and preparing the remedy for the same.
- Analyzed the data model to create test data and performed unit testing
- Created deployment package for migrating code to Test and Production environments
DataStage Developer
Environment: SQL Server 2012, Crystal Reports 2008, SQL Server Integration Services, SQL Server Reporting Services
Responsibilities:
- Interacted with client to gather business requirements.
- Generated Solution Strategy document.
- Performed data analysis and profiling
- Involved in remediating and developing crystal reports.
- Created and modified the existing stored procedures to accommodate the new enhancements.
- Created Technical Specification document.
- Analyzed the data model to create test data and performed unit testing
- Created deployment package for migrating code to Test and Production environments
DataStage Developer
Environment: IBM Information Server V9.1 Datastage, Oracle 10/11g, SQL Server 2012, PL/SQL, UNIX Shell Scripting, DB Visualizer,Tableau 8.1
Responsibilities:
- Gathered business requirements from the business partners and subject matter experts.
- Managing a team of 2 at onsite and 4 at offshore in the role of SME and lead designer.
- Generated HLD, LLD, Source to Target mapping, test cases and miscellaneous documents.
- Involved in designing and developing IBM Websphere Datastage ETL parallel jobs.
- Created Technical Specification and LCDO Onboarding documents.
- Created generic Datastage sequence by integrating korn shell scripts to schedule ETL jobs on Tivoli work scheduler.
- Worked extensively on performance tuning of SQL queries on source system database and data warehouse data base, and optimizing ETL jobs for high throughput.
- Responsible for extracting, transforming and loading data from SQL Server, flat files and loading into SQL Server target databases
- Created datastage jobs to extract and load data from/to Hadoop HDFS
- Created Hive tables on Hadoop HDFS to generate summarized data
- Worked with BI reporting team in designing /developing dashboard and detailed reports using Tableau
- Debugging Tableau reports and fixing data issues on Analytics datamarts
- Created deployment tar files for migrating code to Test and Production environments.
ETL Developer
Environment: IBM Information Server V9.1 Datastage, Oracle 10/11g, PL/SQL, SQL Server 2012, UNIX Shell Scripting, DB Visualizer
Responsibilities:
- Worked with Data governance team to identify the appropriate data elements for required capabilities.
- Created Datastage parallel jobs and sequences for extracting and loading the data using various stages.
- Created stored procedures using MD5 algorithm in Hashbytes function.
- Coordinated and worked closely with offshore development team.
- Integrated the design with Oracle framework for reporting and analysis.
- Performed a lead role from initial phase of capturing business requirements to final phases of testing.
- Provide designs/estimates on and allocate the work to offshore resources for development.
- Created deployment checklist and migrated the code between development, test and stage environments.
- Coordinated with QA team in various testing phases by resolving the defects and ensuring smooth execution of test cases.
DataStage Developer,
Environment: IBM Information Server V8 Datastage, Oracle 10/11g, SQL Server, UNIX Shell Scripting
Responsibilities:
- Interacted with business analysts to gather business user requirements.
- Generated HLD, LLD, Source to Target mapping, test cases and miscellaneous documents.
- Involved in designing and developing IBM Websphere Datastage ETL parallel jobs.
- Created physical design scripts for implementation on Oracle database.
- Created generic Datastage sequence by integrating korn shell scripts to schedule ETL jobs on Tivoli work scheduler.
- Worked extensively on performance tuning of SQL queries on source system database and data warehouse data base, and optimizing ETL jobs for high throughput.
- Responsible for extracting, transforming and loading data from Oracle DB, SQL Server, flat files, XML files and loading Oracle target databases
- Generated test environment and production environment migration documents.
DataStage Developer
Environment: IBM Information Server V8 Datastage, Oracle 10g/9i, DB2, UNIX Shell Scripting, Java, SSH, XML, Microsoft Visio, ERWIN, Quality Stage 8.0, Teradata, SQL Server
Responsibilities:
- Interacted with business analysts to gather business user requirements.
- Generated HLD, LLD, Source to Target mapping, test cases and miscellaneous documents.
- Involved in designing and developing IBM Websphere Datastage ETL jobs to function as Service Oriented Architecture (SOA).
- Prepared Data Quality Analysis Review (DQAR) document and identifying bottle necks in source data and preparing remedy for the same
- Created dimensional models using ERWIN.
- Created physical designs for implementation on Oracle database.
- Responsible for extracting, transforming and loading data from Oracle DB, SQL Server, flat files, XML files and loading Oracle target databases(Data Hub).
- Responsible for Extracting, Transforming and Loading data from Oracle, flat files and loading Oracle Database (Data warehouse database).
- Wrote PL/SQL scripts and invoked those using Shell scripts and Datastage ETL jobs.
- Designed, developed and tested jobs using IBM Websphere Datastage.
- Created Parallel shared containers to collect common performance audit log details from ETL jobs and to provide response to the requestor as job output
- Implemented new features of IBM Websphere Datastage V8.0 such as exposing ETL Jobs as webservices, carrying out SFTP from FTP enterprise stages, using WISD Input/output stages to enable ETL jobs to communicate with each request/response to/from requestor.
- Configured SSH on third party application server and ETL server for carrying out secure copy of files across servers.
- Carried out performance test in the performance environment and tuned the ETL application for performance optimization.
- Wrote shell scripts in UNIX environment.
- Generated test environment and production environment migration documents.
- Involved in writing assembly test cases and preparing Test data document to aid testing team
- Prepared Unit test cases and System test cases and recorded the results accordingly.
- Generated UAT test cases and coordinated the review of the test cases by Business Analysts.
ETL Programmer Analyst
Environment: Ascential Datastage 7.5.1 EE, Oracle 9i, DB2 UDB, UNIX Shell Scripting, Control-M, SSH, XML, Microsoft Visio, ERWIN, Teradata
Responsibilities:
- Interacted with business analysts to gather business user requirements.
- Prepared estimation document to estimate the effort, duration and resource requirement during each phase of the project
- Generated HLD, LLD, Source to Target mapping, test cases and miscellaneous documents.
- Prepared Data Quality Analysis Review (DQAR) document and identifying bottle necks in source data and preparing remedy for the same
- Created dimensional models using ERWIN.
- Created physical designs for implementation on DB2.
- Responsible for extracting, transforming and loading data from DB2 UDB, flat files and loading DB2 target databases.
- Responsible for Extracting, Transforming and Loading data from Oracle, flat files and loading Data warehouse databases.
- Wrote PL/SQL scripts and invoked those using Shell scripts and Datastage ETL jobs.
- Designed, developed and tested jobs using Ascential Data stage 7.5.1 EE.
- Configured SSH on Java / ATG server and ETL server for carrying out secure copy of files across servers.
- Wrote shell scripts in UNIX environment.
- Generated test environment and production environment migration documents.
- Prepared Unit test cases and System test cases and recorded the results accordingly.
- Scheduled ETL and Java application jobs on Control-M.
- Generated UAT test cases and coordinated the review of the same by Business Analysts.
- Carried out performance test in the performance environment and tuned the ETL application for performance optimization.
- Monitored Ascential Datastage jobs on Control-M scheduler and handled the troubleshooting of failure jobs.
Jr. Engineer - ORACLE DBA
Environment: Oracle 9i, 10g/11g, AIX, LINUX, Windows 2003
Responsibilities:
- Managing Imports & Exports for Backup & Recovery Purpose
- Installing and configuring Recovery Manager (RMAN)
- Manage logical storage structures like table spaces, schemas, and extents
- Revoking & invoking privileges as per request from the client, creating database links for the users to access remote objects etc
- Managing the archived redo log files when archive destination is full
- Monitoring the elongated sessions and concluding them as per the user request
- As part of disaster recovery, Involved in backup and recovery setup for many databases with the existing hot and RMAN backups
- Performed cloning of databases using RMAN & manual methods
- Have been part of 10g Installation on Linux servers and Windows based servers
- Weekend maintenance activities like DB and Listener shutdown and start-up at a particular time
- Performing Full, Incremental & Cumulative RMAN backups
- Exporting & importing the database objects like tablespaces, user schemas, tables and performing full database backups
- Monitoring database health checks
- Monitoring the alert logs and backup logs generated
- Preparing the shift handover on shift basis (Tickets to be followed up in the subsequent shifts)
- Coordinating with the senior level and giving the process updates to the team