Senior Software Engineer Resume
Mettawa, IL
SUMMARY:
- 10+ years of IT experience with special emphasis on system analysis, design, development and implementation of ETL methodologies in all phases of Data warehousing life cycle and Relational databases using ETL Tools like IBM DataStage 9.1/8.7/8.5/8.1/7. x and Informatica 7.x/8.x/9.x.
- Extensive experience in client / Server architecture and good knowledge of Software Development Life Cycle.
- Expert in Insurance, Finance, Retail domains.
- Strong data warehousing experience using IBM DataStage Components like DataStage Designer, DataStage Director, DataStage Administrator and Parallel Extender, ERwin, SQL Server, Oracle PL/SQL and involved in all the stages of Software Development Life Cycle (SDLC).
- Proven track record in troubleshooting of DataStage jobs and addressing production issues like performance tuning and enhancement.
- Thorough understanding of DW principles (Fact Tables, Dimensional Tables, Dimensional Data Modeling - Star Schema and Snow Flake Schema).
- Worked on various transformations like Expression, Join, Lookup, Sort, Filter, Aggregator and Mapplets and Reusable transformations using Informatica Powercenter Designer.
- Extensively worked on Data Profiling and Quality using Informatica IDQ Tool.
- Experienced in developing UNIX shell scripts for file validations, to run the batch processing and summarized report of data load.
- Experience in implementing full lifecycle management to capture and migrate various DataStage ETL metadata including data mapping and other data integration artifacts (such as schedulers, scripts, etc.,) across environments including the establishment of standards, guidelines and best practices.
- Experienced in Data Warehousing, Application Development and Production Support.
- Experienced in conducting design review session with different stake holders and code review sessions with developers.
- Good experience with Oracle 11g/10g/9i/8i,DB2,Teradata 13/14,,Flatfiles and XML sources.
- Worked on loading of data from several flat files sources to Staging using Teradata Loading Utilities like TPUMP, MLOAD, FLOAD and BTEQ.
- Expertise in creating reusable components such as Shared containers, Local Containers and in creating custom transformations, functions and routines.
- Experienced in Onshore - Off Shore coordination Development and Production Support Team.
- Excellent understanding of the DBA functions including creating tables, table spaces, databases and indices.
- Extensive experience in UNIX Shell Scripting.
- Extensive Knowledge on BI Tools like Congos and Tableau Desk top
- Worked on Scheduling tools like Crontab and Control-M for automating jobs run.
- Possess good knowledge on Onsite-Offshore Model, proven problem solving skills, good conceptual foundation, and ability to handle pressure.
- Excellent track record as a strong team player with effective communication, analytical and multi-tasking skills.
- Result driven and self-motivated.
TECHNICAL SKILLS:
Operating System: Windows NT/2000, 2003, XP Sun Solaris, AIX, Linux.
RDBMS: Oracle 11g/10g/9i/8i, Teradata 13x/14x. IBM DB2 and MS-Access
ETL Tools: Informatica 7.x/8.X, DataStage7.x/8.X/9.X, Informatica IDQ 9.X
Language: SQL, UNIX Shell Programming, C and C++.
Scheduling Tools: Control M, Tivoli Batch Scheduler and Crontab
BI Tools: Cognos, Tableau
PROFESSIONAL EXPERIENCE:
Confidential, Mettawa, IL
Senior Software Engineer
Responsibilities:
- Worked closely with Business analysts and Business users to understand the requirements and to build the technical specifications.
- Involved in all business meetings to understand the existing logic, different member information and agency data to come up with the best IT solution.
- Responsible to create Source to Target (STT) mappings.
- Involved in day to day production support activities.
- Worked on various defects raised by the concerned business teams from various entities.
- Developed and supported the Extraction, Transformation and Load process (ETL) for a data warehouse from various data sources using DataStage Designer and to load the target tables using the DataStage Designer.
- Worked on various stages like Transformer, Join, Lookup, Sort, Filter, Change Capture and Apply stages,Quality Stage.
- Developed parallel jobs using various Development/debug stages (Peek stage, Row generator stage, Column generator stage, Sample Stage) and processing stages (Aggregator, Change Capture, Change Apply, Filter, Sort & Merge, Funnel, Remove Duplicate Stage)
- Designed job sequencer to run multiple jobs with dependency and email notifications.
- Involved in Unit Testing, SIT and UAT Worked with the users in data validations.
- Extensively worked in improving performance of the jobs by avoiding as many transforms as we can.
- Prepared documentation for unit, integration and final end - to - end testing.
- Optimized/Tuned DS jobs for better performance and efficiency
- Responded to customer needs; self-starter and customer service oriented.
- Worked within the team to make appropriate, effective decisions related to project responsibilities and to initiate and follow-up on assigned tasks without supervision.
- Provided support and guidance by creating Release, Deployment & Operation guide documents.
- Involved in Performance tuning of complex queries.
- Developing SQL scripts to facilitate the functionality for various modules.
- Created control M jobs for scheduling.
- Develop Universe model as per the business requirements to use for Webi rich client.
- Develop Web reports to replace the MS access.
Environment: IBM InfoSphere DataStage 8.x (Designer, Director) Oracle 10g, Teradata 13, Sequential files, UNIX Shell Scripting, Tableau 8.3
Confidential
Senior Software Engineer
Responsibilities:
- Assisted in the creation of an enterprise operational data store and analytical data warehouse.
- Built DataStage ETL interfaces to aggregate, cleanse and migrate data across enterprise-wide Confidential ODS and Data Warehousing systems using staged data processing techniques, patterns and best practices.
- Implemented full lifecycle management to capture and migrate various DataStage ETL metadata including data mapping and other data integration artifacts (such as schedulers, scripts, etc.,) across environments including the establishment of standards, guidelines and best practices.
- Conducted design review session with different stakeholders.
- Responded to customer needs; self-starter and customer service oriented.
- Experience with ETL Unit and Integration Test creation and verification.
- Worked within the team to make appropriate, effective decisions related to project responsibilities and to initiate and follow-up on assigned tasks without supervision.
- Provided support and guidance by creating Release, Deployment & Operation guide documents.
- Worked on various defects raised by the concerned business teams from various entities.
- Worked on various stages like Transformer, Join, Lookup, Sort, Filter, Change Capture and Apply stages, Quality Stage.
- Involved in Unit Testing, SIT and UAT Worked with the users in data validations.
- Extensively worked in improving performance of the jobs by avoiding as many transforms as possible.
- Prepared documentation for unit, integration and final end - to - end testing.
- Helped in preparing the mapping document from source to target.
- Designed and developed ETL processes using DataStage designer to load data from Main Frame files, DB2 UDB, Sequential Files (Fixed Width) to staging database and from staging to target Data Warehouse database.
- Used DataStage stages namely Sequential file, Transformer, Aggregate, Sort, Datasets, Join, Funnel, Row Generator, Remove Duplicates, Copy stages in accomplishing the ETL Coding.
- Developed job sequencer with proper job dependencies, job control stages, triggers, and used notification activity to send email alerts.
- Excessively used DS Director for monitoring Job logs to resolve issues.
- Documented ETL test plans, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.
- Used Control-M job scheduler for automating the monthly regular run of DW cycle in both production and UAT environments.
- Wrote Shell Scripts to check for the existence of files and to check for the actual rows as against the expected rows and implemented the script Before-job Subroutines.
- Worked closely with QA Testers for the resolution of the data defects identified by them through the Application Lifecycle Management.
Environment: IBM InfoSphereDataStage8.5/7.5, Oracle 10g, Teradata 13, Sequential files, Control M, UNIX Shell Scripting, COGNOS10.01.
Confidential
Senior Software Engineer
Responsibilities:
- Understanding the Mapping documents, Data Model and there by create System Design Document.
- Create Low Level design document.
- Developed parallel jobs and sequence jobs for different interfaces.
- Developed static load jobs using change capture stage to load the current mapping data.
- Scheduling the interfaces to run daily/weekly/monthly/yearly based on the type of interface.
- Worked on sql queries and UNIX while developing jobs and debugging issues.
- Involved in Implementing Framework which is used for audit and error logging purposes.
- Created re-usable components used in entire project
- Extensively used Crontab to schedule DataStage jobs.
- Created Error Files and Log Tables containing data with discrepancies to analyse and re-process the data.
- Create Unix Shell Scripts that are required to perform necessary validations, transformations and transfer of files.
- Prepare Unit Test Cases and execute them.
- Helped in preparing the mapping document from source to target.
- Designed and developed ETL processes using DataStage designer to load data from Main Frame files, DB2 UDB, Sequential Files (Fixed Width) to staging database and from staging to target Data Warehouse database.
- Fix the defects raised by testing team.
- Migrating jobs from one environment to other.
- Involved in Performance Testing and there by tuning the jobs to yield better results.
- Extensively used SQL tuning techniques to improve the performance in Data Stage Jobs.
Environment: IBM InfoSphereDataStage8.5/7.5, Oracle 10g, Teradata 13, Sequential files, ControlM, UNIX Shell Scripting, Cognos10.01.
Confidential
Informatica Consultant
Responsibilities:
- Interacted with End user community to understand the business requirements and with Functional Analyst to understand the Functional Requirements identifying data sources and its implementations.
- Study and analyzing existing Source data.
- Defining Source and Target definitions.
- Extensively used Informatica to load data from Relational databases, flat files sources to target DB2 database.
- Created Mappings using Mapping Designer to load data from various sources, using different transformations like Source Qualifier, Expression, Lookup Aggregator, Update Strategy, Joiner, Filter and Router transformations.
- Created Mapplets for reusable business rules.
- Created tasks, workflows and Worklet using workflow manager.
- Used Workflow monitor-to-monitor workflows.
- Used Tivoli Job Scheduling to monitor the Jobs.
- Used Workflow monitor-to-monitor workflows.
- Documented ETL test plans, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.
- Used IBM Tivoli job scheduler for automating the monthly regular run of DW cycle in both production and UAT environments.
- Wrote Shell Scripts to check for the existence of files and to check for the actual rows as against the expected rows and implemented the script Before-job Subroutines.
- Worked closely with QA Testers for the resolution of the data defects identified by them through the Application Lifecycle Management.
- Participated in discussion with Project Manager, Business Analysts and Team Members on any technical and/or Business Requirement issues in weekly status meetings.
Environment: Informatica 7.1.3, DB2, Tivoli, UNIX and Oracle, SQL Server, Business Objects.
Confidential
Informatica Consultant
Responsibilities:
- Study and analyzing existing Source data.
- Defining Source and Target definitions.
- Extensively used Informatica to load data from Relational databases, flat files sources to target DB2 database.
- Created Mappings using Mapping Designer to load data from various sources, using different transformations like Source Qualifier, Expression, Lookup Aggregator, Update Strategy, Joiner, Filter and Router transformations.
- Created Mapplets for reusable business rules.
- Created tasks, workflows and work let’s using workflow manager.
- Used Workflow monitor-to-monitor workflows.
- Used Tivoli Job Scheduling to monitor the Jobs.
- Used Workflow monitor-to-monitor workflows.
- Conducted design review session with different stakeholders.
- Responded to customer needs; self-starter and customer service oriented.
- Experience with ETL Unit and Integration Test creation and verification.
- Worked within the team to make appropriate, effective decisions related to project responsibilities and to initiate and follow-up on assigned tasks without supervision.
- Provided support and guidance by creating Release, Deployment & Operation guide documents.
- Worked on various defects raised by the concerned business teams from various entities.
- Documented ETL test plans, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.
- Used IBM Tivoli job scheduler for automating the monthly regular run of DW cycle in both production and UAT environments.
- Wrote Shell Scripts to check for the existence of files and to check for the actual rows as against the expected rows and implemented the script Before-job Subroutines.
- Worked closely with QA Testers for the resolution of the data defects identified by them through the Application Lifecycle Management.
Environment: Informatica 7.1.3, DB2, Tivoli, UNIX and Oracle, SQL Server, Business Objects.
Confidential
Software Engineer
Responsibilities:
- Study and analyzing existing data.
- Defining Source and Target definitions.
- Designing and creating Mappings.
- Designing and creating Jobs
- Extraction, Transformation and Loading of the data warehouse.
- Used Mapping designer and Mapplets to generate different mappings for different loads.
- Used Workflow Manager to schedule and monitor different sessions of loading.
- Wrote procedures for data extraction, transformation and loading.
- Documented ETL test plans, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.
- Used IBM Tivoli job scheduler for automating the monthly regular run of DW cycle in both production and UAT environments.
- Conducted design review session with different stakeholders.
- Responded to customer needs; self-starter and customer service oriented.
- Experience with ETL Unit and Integration Test creation and verification.
- Wrote Shell Scripts to check for the existence of files and to check for the actual rows as against the expected rows and implemented the script Before-job Subroutines.
- Worked closely with QA Testers for the resolution of the data defects identified by them through the Application Lifecycle Management
- Created various transformations like Joiner, Aggregator, Expression, Filter and Update Strategy
- Creating and executing Sessions and Batches.
Environment: Informatica 7.1.3, DB2, Tivoli, UNIX and Oracle, SQL Server, Business Objects.