Application Systems Analyst Resume
Detroit, MI
SUMMARY:
- IT professional, with 8 years’ experience in Design, Development and Application Support in IBM Datastage (Server and Enterprise Edition) using Components like Administrator, Manager, Designer, and Director
- Five years in the fields of data Warehousing, Data Integration, Data Migration using IBM WebSphere Datastage, Teradata, Oracle, PL/SQL, DB2, UDB, SQL Server 2000/2005/2008. SQL procedural language and Shell Scripts
- Used tools like InfoSphere Datastage Designer and Director for developing Jobs.
- Experience in Information Analyzer, Quality Stage, Metadata Workbench, Business Glossary, FastTrack etc products in IBM InfoSphere Information Server IIS 8.0/8.1 Suites and WebSphere Application Server
- Over Five years of experience in ETL methodologies in all the phases of the Data warehousing life cycle In Depth knowledge in Data Warehousing & Business Intelligence concepts with emphasis on ETL and full Life Cycle Development including requirement analysis, design, development, testing and implementation
- Familiar with Enterprise Marketing products that help deliver tailored messages to huge volumes of contacts..
- Expertise in all the phases of System development life Cycle (SDLC) using different methodologies like Agile, Waterfall.
- Primary technical skills in HDFS. Pushed and validated data files in HDFS.
- Expertise in OLTP/OLAP System Study, Analysis and Dimensional Modeling, E - R modeling .
- Involved in ODS/Designing Dimensional Model (Star Schema and Snowflake Schema) Designing logical and physical design data modeling with star schema using Erwin.
- Extensively used SQL coding for overriding the generated SQL in Datastage and also tested the data loaded into the data base.
- Extensively used Datastage- Manager to Export/Import Datastage Job components and Import Plug in Table Definitions from DB2UDB, Oracle and Sybase databases.
- Designed Server jobs , Job Sequencers , Batch Jobs and Parallel jobs .
- Designed Parallel jobs using various stages like join , merge , lookup , remove duplicates , filter , dataset , lookup file set , modify, aggregator, CFF, Transformer.
- File Stages - Lookup File Set, Dataset, Sequential File , Database Stages - DB2 Enterprise, and Sybase OCI, Surrogate Key
- Good Experience in Extraction Transformation and Loading (ETL) processes using Data Stage ETL Tool, Parallel Extender, Metastage, Quality Stage, Profile Stage
- Developed Server jobs using various types of stages like Sequential file , ODBC , Hashed File , Aggregator , Transformer , Sort , Link Partitioner and Link Collector .
- Experience in integration of various data sources like Oracle, Teradata, DB2, SQL Server, MS Access and Flat files into the Staging Area. Extensively worked with materialized views and TOAD
- Proven track record in troubleshooting of Datastage Jobs and addressing production issues such as performance tuning and enhancement
- Excellent knowledge of studying the data dependencies using Metadata stored in the Repository and preparing batches for the existing sessions to facilitate scheduling of multiple sessions
TECHNICAL SKILLS:
Data Warehousing: 8.7/8.5/8.1/8.0 / 7.5.3/7.5.2/7.5.1/7.0 (Designer, Director, manager, Administrator), Parallel extender, Server Edition, Quality Stage 7.5, InfoSphere& InfoAnalyser, ETL, Metadata, OLAP, OLTP, SQL*Plus
Databases: Oracle 12c/11g/10g/9i/8i/8.0/7.0,DB2UDB7.2/8.1/9.0,Mainframe,TeradataV2R5, DB2UDB,MSAccess 7.0/ 97/2000, MS SQL Server 2010/2008/2005/2000
Programming: SQL, Unix Shell Scripting, SQL loader, Python
ERP: Oracle Applications 11i/11.0.x (Accounts Payables (AP), Accounts Receivables (AR)) SAP R/3 4.6B, 4,6C, 4.7, ECC 5.0, 6.0 in MM, SD, PP, ABAP
Others: MS Office
Environment:: HP UX, LINUX, IBM AIX 5.3/5.2/4.2, MS DOS 6.22, Win 3.x/95/98/2000, Win NT 4.0,Win XP, Windows 7
Scheduling Tools: TWS, Tidal, Control M
PROFESSIONAL EXPERIENCE:
Confidential, Detroit, MI
Application Systems Analyst
Responsibilities:
- Followed agile methodology using 2 week sprints. Attended daily standup's to update the team on progress. This involved interactions with the Business, BA’s, DA’s ETL team and the Architect.
- Participated in the review of Technical, Business Transformation Requirements Documentation.
- Interacted with End user community to understand the business requirements and in identifying data sources.
- Analyzed the existing informational sources and methods to identify problem areas and make recommendations for improvement. This required a detailed understanding of the data sources and researching possible solutions.
- Responsible for installation, configuration, testing and migration from Information Server 8.7 projects to InfoSphere Information Server Datastage 11.5 .
- Used the Data stage Manager to import and export jobs
- Migrated, Modified and developed ETL processes using Datastage designer to load data from Oracle, MS SQL, Flat Files (Fixed Width) to staging database and from staging to the target Data Warehouse database.
- Identified source systems, their connectivity, related tables and fields and ensured data consistency for mapping.
- Modified Job Sequences with various activities like Job activity, Routine activity, and Notification activity, Execute Command Activity, Exception handler Activity, Terminator Activity, Start and End Loop Activities etc.
- Extensively used Data Stage PARAMSETs to parameterize the ETLs
- Used the Sequential File stage, Complex Flat File Stage, Hashed File Stage, Modify, Transformer Dataset, Filter, Funnel, Join, Lookup, Merge, Copy, Aggregator, and Change Capture during ETL development.
- Trouble-shoot the existing ETL code using the Datastage Debugger and director.
- Tuned Datastage transformations and jobs to enhance their performance.
- Worked with performance teams, modified the existing code without changing any functionality of the existing job as part of 11.5 Migration requirements.
- Developed, Modified UNIX shell scripts to automate the Datastage Jobs to populate/ refresh to the Data warehouse.
- Created job sequences and job schedules to automate the ETL process using Tidal
- Monitored and resolved the ticketing issues that arouse during the implementation of the jobs
- Involved in ETL Unit Testing and also in integration and Regression testing. Implementing complex deliverables in Test Driven Development (TDD) approach
- Created FDD (Functional design Documents), TDD (Technical Design Document), Issue resolution Trackers and Unit test case document
- Involved in building Secure Transport(SFTP) from Source > IS > Target
- Involved in resolving IS platform issues for file transfer setup.
- Involved in creating Change Requests in Service Now to implement code from lower to higher environment
- Responsible for monitoring all the jobs that are running, scheduled, completed and failed. Troubleshooting the failed jobs is a primer in these situations
Environment: IBM InfoSphere Information Server 11.5/8.7 (Datastage), Oracle11g,12c, Toad, SQL Developer, UNIX HP-UX and Linux, Windows 7, Ultra Edit, SVN, Tidal and Ctrl M.
Confidential, Eden Prairie, MN
Datastage Developer/Support
Responsibilities:
- Monitoring production cycle and solving Tivoli job failures.
- Reporting the batch run status to downstream and upper level management at definite intervals.
- Understand the application thoroughly in order to solve production issues.
- Working on code changes and unit testing while working on Service requests.
- Understanding the technical & functional specifications of the system.
- Doing RCA (Root cause analysis) of production abends and giving solution for the same.
- Performing analysis for RTI (Run time improvement) of the production jobs.
- Strict adherence to SLA while performing the above task.
- Involved in updating/modifying UNIX scripts which generated emails to notify the incoming data to the Tango DA team.
- Worked closely with Project lead/Manager, system admins to understand the business process and functional requirements
- Did unit testing of the jobs developed before taking them for Test and Production.
- Modified Datastage wrapper scripts written in UNIX (BASH)
- Used UNIX Shell Scripts for extracting and parsing data from files into the database tables.
- Involved in writing Shell scripts for reading parameters from files, invoking Datastage jobs, and FTP files to specific locations.
- Scheduled the jobs with Automated Scheduler, Event Coordinator for batch transfers of data.
- Using the stages like Modify, Look-up, Remove Duplicate, Aggregator in modifying the jobs already developed to improve the performance and to meet the requirements.
- Agile methodology (2 week scrums) was followed to produce the results and provide support to the ETL jobs
- Validated data flow from landing area to Hadoop
- Extensively used SQL coding for overriding the generated SQL in Datastage and also tested the data loaded into Hadoop
- Validated folder structure of files in HDFS vs file system
- Validated audit logs, recount, and hash totals between source, hadoop
- Involved in writing SQL scripts for data validation of files received from various sources.
- Implemented complex logics in Transformer stage like date validation, use of stage variables • Migrated Datastage jobs from 8.1 earlier versions to Datastage 9.2
Environment : ETL, Datastage EE 8.5/9.2, Information Analyzer 8.5, Oracle 11g, SQL Server 2010, Hadoop, Hive, HDFS Teradata Client 12.0 , Tivoli Job scheduler and HPSM.
Confidential, SanJose, CA
Datastage Developer
Responsibilities:
- Involved in building a prototype which comprised of multiple jobs without mapping documents.
- Imported a routine to convert a decimal value to over punch character.
- Gathering the ETL requirements for implementing the business rule and mapping corresponding data.
- Designed ETL jobs which populated the tables using column generator, surrogate key, join, Oracle enterprise stage
- Involved in modifying UNIX scripts which generated emails to notify the incoming file to the RITS team.
- Worked closely with Project lead/Manager, Architects, and Data Modelers, System Analyst to understand the business process and functional requirements
- Did unit testing of the jobs developed before taking them for UAT and finally Production.
- Used UNIX Shell Scripts for extracting and parsing data from files into the database tables.
- Involved in writing Shell scripts for reading parameters from files, invoking Datastage jobs, and FTP files to specific locations.
- Designed server jobs using various stages like Sequential file, Transformer, ODBC, Aggregator, Hash file, Link Partitioner
- Scheduling the jobs with Automated Scheduler, Event Coordinator for batch transfers of data.
- Using the stages like Modify, Look-up, Remove Duplicate, and Aggregator in modifying the jobs already developed to improve the performance and to meet the requirements.
- Developed job control routines for batch processing in Datastage BASIC
- Agile methodology was followed to produce the results and to perform the ETL jobs.
- Extensively used SQL coding for overriding the generated SQL in Datastage and also tested the data loaded into the data base.
- Developed Data stage basic routines for automation ETL batch process.
- Involved in writing SQL scripts for populating tables.
Environment : ETL, Datastage EE 8.7/8.5, InformationAnalyzer 8.5, Oracle11g, SQLServer 2010, SQL Navigator 6.5, SQL/PLSQL,, Control M, Windows XP.
Confidential, Orlando, FL
Datastage Developer
Responsibilities:
- Gathered the ETL requirements for implementing the business rule and mapping corresponding data.
- Modified the current jobs in the time-tracking system, to in corporate the business logic.
- Identified source systems connectivity, related tables and fields and ensure data suitably for mapping.
- Developed new Parallel jobs to populate new tables required with the Datastage Enterprise Edition.
- Used the stages like Change-Capture, Modify, Look-up, Remove Duplicate in modifying the jobs already developed to improve the performance and to meet the requirements.
- Developed custom Routines and use of stage variables in certain jobs
- Developed various one-shot jobs to fix the issues and inconsistent data in production. Also, comparing the two data warehouses and minimizing the differences with comparison.
- Gathered requirements for Data Integration needs for external data for BI
- Unit Testing and Integration testing the individual and extract-transform-load jobs in sequence respectively.
- Extensively analyzed the Data Sources in identifying data anomalies, patterns, value ranges. Wrote SQL scripts for accomplishing the same.
- Designed and Developed validation ETL processes using Data Stage, Oracle SQL loader and Unix shell programming for Alignment, Customer, Promotions, and mainframe flat files Mapping Data Items from Source System to the Target System.
- Compiled and debugged the Jobs based on the Errors.
- Designed & Developed the Datastage jobs (using join, lookup, sort, remove duplicates, Transformer, Teradata MultiLoad stages etc.) for handling complex transformations.
- Scheduled jobs using Autosys.
- Written shell scripts for scheduling the ETL process.
- Used Both Pipeline Parallelism and Partition Parallelism for improving performance.
- Extensively used Parallel Extender to load data into data warehouse with different techniques like Pipeline and Partition in MPP environment.
- Developed Datastage job sequences used the User Activity Variables, Job Activity, Wait for File stages
- Used FastTrack to automate creation of ETL Datastage jobs, to leverage published profiling results from Information Analyzer and to create and link Business Glossary terms and their relationships.
- Extensively used Datastage Tools like Infosphere Datastage Designer, Infosphere Datastage Director for developing jobs and to view log files for execution errors.
- Migrated the code required for the project to QA and Model using Version Control.
Environment : ETL Datastage EE 8.5/8.1.2/8.0 , Oracle 10g, Teradata, SQL/PLSQL, Teradata, BTEQ, IBM InfoSphere 8.5 Quality stage 8.5/8.1.2/8.0 , Informix 9/8,Autosys,SQl * loader, Meta Stage, Korn Shell Scripts, UNIX, Windows XP.
