Tech Lead / Senior Etl Developer Resume
Chicago, IL
SUMMARY:
- Over 12 years of IT experience in analysis, design and development and Testing of data warehouse and oracle related applications and ETL processings.
- 8+ years of solid experience in building data warehouse/Data marts especially with ETL tools like IBM Information Server Datastage 11.3/9.1/8.5/ 8.1 x/8.0.x/7.5
- Extensive knowledge of Software Development Life Cycle (SDLC), having thorough understanding of various phases like Requirements, Analysis/Design, Development and Deployment.
- Expertise as a Data Warehousing Developer using ETL Tool DataStage (Manager, Designer, Administrator, Director) Parallel Extender, QualityStage.
- Installation, configuration, setup and administration of Datastage Server.
- Experience in Database programming Load Data Warehouses (Star Schemas). Developed Strategies for Extraction Transformation Loading (ETL) mechanism
- Report creation using OLAP data source (such as MSAS cubes) and having knowledge in OLAP universe.
- Expertise in OLTP/OLAP System Study, Analysis and Dimensional Modeling, E - R modeling. Involved in Designing Dimensional Model (Star schema and Snowflake schema), database administration.
- Performed Debugging, Troubleshooting and performance tuning of Datastage Jobs.
- Used complex flat file stage in complex logic handling from the mainframe data source.
- Handled huge data in various kinds of formats like EBDIC/Binary, data containing unusual characters using Complex flat file stage.
- Expert in Dimensional Data Modeling, Star Schema modeling, Snowflake Schema modeling, fact and dimension table design, physical and logical Data modeling using ERwin 9.5/4.2/4.1/3. x.
- Worked extensively with Data migration, Data Cleansing, ETL Processes.
- Extensive knowledge in Crystal Reports, SAP Business Objects (6.5 through XI R3, 4.1) reporting technologies.
- Extensive experience in designing and working with Oracle 8i/9i/10g and writing SQL queries and PL/SQL Procedures, Functions, Packages, Database Triggers, Exception Handlers, Ref Cursors, Database Objects using PL/SQL. Proficient in writing Unix Shell scripts.
- Developed reports using SQL server reporting service.
- Expertise in Testing phase planning, preparation and execution.
- Have the knowledge of install and configuration in Datastage.
- Practical experience in Quality Assurance - designing and execution of test cases, test scripts and test procedures
- Hands on experience in tuning mappings, identify and resolve performance bottlenecks in various levels like source, target, mappings
- Expertise in creating schema objects, Performance Tuning of SQL statements
- Excellent Microsoft Office skills used for documenting the analysis and work done.
- Able to work within an aggressive and demanding project schedule and environment.
- Strengths include excellent communication skills and interpersonal skills, good analytical skills and logical approach to problem solving.
TECHNICAL SKILLS:
ETL Tools: IBM InfoSphere Information Server DataStage 11.3/9.1/8.5/8.1/7.5.2/7.5.1/7.1/6.0/ EE/5.1/4.0/EE (Manager, Administrator, Designer, Director) Parallel Extender, Business Objects, Informatica 6.1/5.1.
Dimensional Data Modeling: Star Schema Modeling, Snow-Flake Modeling, FACT and Dimensions tables, physical and logical data modeling, ERwin 4.1.2/3.x and Oracle Designer
Reporting Tools: Data Reports, Crystal Reports 6.x/5.x/4.x, Cognos, Business Objects 6.0/5.0 (Supervisor, Designer, Business Objects) Web Intelligence, Broadcast Agent and Access Reports
Databases: Microsoft SQL Server 2005/2000/7.0/6.5 , Oracle 11g/10g/9i/8i/8.0/7.3, PL/SQL, DB2 UDB, Teradata, Sybase SQL Server 11.0 and Access 2000
UNIX Tools: Shell Scripts, C Shell, K-Shell Scripts, AWK and VI, IBM AIX, Sun Solaris.
GUI: Visual Basic 6.0/5.0/4.0, Excel, Power Point, Visual Interdev 6.5/6.0 and Visual Age 3.5
Servers: Oracle 9iAS, MTS, IIS, Apache and MS Site Server
CRM Product: Salesforce.com
Version Control tools: Clear Case, SVN
PROFESSIONAL EXPERIENCE:
Confidential, Chicago, IL
Tech Lead / Senior ETL Developer
Responsibilities:
- Involved in analysis, requirements gathering, function/technical specifications, development, deploying and testing.
- Created Shared Containers for reusable calculations in various strings.
- Created Data Model using Erwin from data sources and defined the dimensions, levels and measures in the model.
- Extensively used Data Stage Designer stages such as ODBC, Aggregator, Transformer, Join, Pivot, FTP and Merge.
- Extensively used Email Notification, Nested Condition, Sequencer and Terminator activities in Job Sequences.
- Developed Routines for Error handling and also developed before/after job subroutine.
- Used the Data Stage Administrator to assign privileges to users or user groups (to control which Data Stage client application or jobs they see or run), move, rename or delete projects and manage or publish jobs from development to production status.
- Used Salesforce.com connector package stage extensively to extract data from Salesforce.com
- Used browse object feature on sfdc stage to import table definitions of SFDC objects.
- Used Director for executing, analyzing logs and scheduling the jobs.
- Developed Hash files for performance improvement by reducing the reference lookup time.
- Developed, tested Store procedures, Functions and packages in PL/SQL for Data ETL.
- Written SQL scripts to create and drop the indexes those are passes as parameters in the pre & post sessions.
- Involved in investigating & solving the data integrity issues.
- Worked on scheduling tool control M for monitoring and scheduling jobs.
- Wrote UNIX shell Scripts for file validation and scheduling DataStage jobs.
Environment: IBM Information Server 11.3 (DataStage, Quality Stage and Information Analyzer), Erwin 4.1, Windows 7, Unix Shell scripting, Oracle 10G, SFDC.Com, Control-M, TFS
Confidential, Lombard, IL
Senior Application Engineer
Responsibilities:
- Involved in analysis, requirements gathering, function/technical specifications, development, deploying and testing.
- Installation, configuration, setup and Administration of Data Stage Server.
- Created Shared Containers for reusable calculations in various strings.
- Created Data Model using Erwin from data sources and defined the dimensions, levels and measures in the model.
- Involved in the data migration, data lineage and also studying the data impact analysis.
- Extensively used Data Stage Designer stages such as ODBC, Aggregator, Transformer, Join, Pivot, FTP and Merge.
- Extensively used Email Notification, Nested Condition, Sequencer and Terminator activities in Job Sequences.
- Participated in discussions with Project Manager, Group Members and Technical Manager Regarding any Technical and/or Business Requirement issues.
- Developed Routines for Error handling and also developed before/after job subroutine.
- Extensively used Quality Stages like Investigate, Match and Survivorship.
- Used the Data Stage Administrator to assign privileges to users or user groups (to control which Data Stage client application or jobs they see or run), move, rename or delete projects and manage or publish jobs from development to production status.
- Used Director for executing, analyzing logs and scheduling the jobs.
- Developed Hash files for performance improvement by reducing the reference lookup time.
- Created monthly and weekly job reports using Datastage for analysis purpose.
- Converted existing SQL procedures and scripts into Datastage jobs to improve performance of the existing system applications.
- Used Quality Stage plug-in to call Quality Stage jobs from Data stage.
- Used the Folder stage and RTI stage to extract data from .xml type files and load into Oracle database.
- Led teams to map business terms, metrics, related terms, synonyms, data quality rules, constituencies and data stewards/owners in metadata repository with end-to-end data lineage diagrams.
- Developed, tested Store procedures, Functions and packages in PL/SQL for Data ETL.
- Written SQL scripts to create and drop the indexes those are passes as parameters in the pre & post sessions.
- Involved in investigating & solving the data integrity issues.
- Worked on scheduling tool control M for monitoring and scheduling jobs.
- Production support lead and control-M setup
- Wrote UNIX shell Scripts for file validation and scheduling DataStage jobs.
Environment: IBM Information Server 8.5 (DataStage, Quality Stage and Information Analyzer), Erwin 4.1, Windows XP, Unix Shell scripting, TOAD 6.3, MS SQL Server 2012, DB2, PL/SQL, Zena, Serena Dimensions
Confidential, Chicago, IL
Application Developer
Responsibilities:
- Participated in gathering the user requirements and involved in writing technical design documents.
- Involved in the analysis, data modeling, detailed system design, development and technical documentation.
- Extracting data from P4 FRD (Oracle Database) to desired MAP Force XSLT using IBM Infoserver.
- Developed ETL procedures to ensure conformity, compliance with standards and lack of redundancy, translated business rules and functionality requirements into ETL procedures using Data Stage .
- Extensively used DataStage Designer to develop various jobs to extract, cleanse, transform, integrate and load data into data warehouse database.
- Designed DataStage Parallel jobs involving complex business logic, update strategies, transformations, filters, lookups and necessary source-to-target data mappings to load the target.
- Extensively used Quality Stage to convert data from legacy sources into consolidated high quality information throughout a complex enterprise warehouse and DataMart.
- Extensively used the Sequential File stage, Complex Flat File Stage, Hashed File Stage, Modify, DataSet, Filter, Funnel, JOIN, Lookup, Copy, Aggregator, Change Capture during ETL development.
- Used DataStage Director to Run and Monitor the Jobs for Performance Statistics.
- Preparing test cases to the code developed for the migration of data from source to target.
- Executing the test cases in integration and Unit testing phases.
- Involved in Performance Tuning of Parallel Jobs using Performance Statistics.
- Used Business Objects for delivering integrated and reliable information inside and outside of organization.
- Extensively worked with database objects including tables, views, indexes, schemas, PL/SQL packages, stored procedures, functions, and triggers
- Used Crystal reports for reporting and analysis.
- Developed UNIX Shell scripts to automate repetitive database processes and maintained shell scripts.
- Involved in solving Production support issues.
- Used Control M for job scheduling.
Environment: IBM InfoSphere DataStage 11.3/ 9.1.0, (Designer, Director, Manager and Administrator), Business Objects. Oracle 11g, Oracle Data Integrator(ODI),Teradata, SQL, PL/SQL, SQL* Loader, UNIX Shell Script, Oracle SQL Developer, CA ERWIN Data modeler 9.5, Windows 7 and AIX UNIX 4.2,Crystal Reports, Control M, SVN. Clear Case.
Confidential, Princeton, NJ
Sr Datastage Developer
Responsibilities:
- Worked with the Business analysts and the DBA for requirements gathering, business analysis, testing, and project coordination
- Involved in Logical and Physical Database design and Star Schema design. Identified Fact tables, Transaction tables
- Gathered client requirements, validated and analyzed client data to find trends and relationships Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements.
- Added the Environmental variable using DataStage Administrator.
- Involved in configuring the DataStage Jobs and files for the parallel engine.
- Created all the jobs in Datastage Server edition.
- Extensively used Ascential DataStage Manager, Designer, Administrator, Director, Parallel Extender (Orchestrate) for creating and implementing jobs.
- Monitored the performance of Server jobs by turning on various Environment Variables.
- Documented ETL Processes Coding and code review standards around data stage Source to target mapping.
- Extensively used Data Stage Designer stages such as ODBC, Aggregator, Transformer, Join, Pivot, FTP and Merge.
- Used Hashed file stage extensively to remove the duplicates.
- Wrote routines for Transform fuctions and validations.
- Performed system testing and coordinated User Acceptance Testing of archive applications.
- Performed Unit testing, Integration testing and System testing.
- Designed the data stage Integrity check jobs which check that each Dimension ID in a Fact table has a corresponding ID in a Dimension table.
- Used Quality Stage to eliminate the duplicates by analyzing the data and setting the Match and Clerical Cut-offs. Created and verified quality stage jobs for Match and unduplication.
- Worked closely with MDM (Siperian )Specialist.
- Helped Siperian specialist in designing the model and Metadata.
- Created some test data, as well as did basic SQL queries to validate loads and testing.
- Used jware for scheduling and automation.
- Provided the final operation guide to run this code.
Environment: IBM Information Server 8.0.1, Websphere DataStage 8.0 (Designer, Director, Manager and Administrator), Quality Stage, Siperian, Oracle 10g,Oracle Data Integrator(ODI), SQL, PL/SQL, SQL* Loader, UNIX Shell Script, TOAD 9.6, ERWIN 4.2, Win XP and AIX UNIX 4.2, Jware.
Confidential, CA
Datastage Developer
Responsibilities:
- Involved in requirement gathering and analysis to define business and functional specifications. Involved in data modeling. Worked closely with data modeler and database architect during the design and development of ETL technical specification document
- Developed DataStage jobs for extraction transformation and loading of the data from source systems
- Used Complex Flat File Stage(CFF) for fixed and variable-length records and provides an easy way to join data from different record types in a logical transaction into a single data record for processing.
- Extensively used Sequential File stage, Hashed File Stage, DB2 UDB Stage, FTP Plug-in Stage and Aggregator Stage during ETL development
- Used DataStage Designer to develop processes for extracting, cleansing, transforming, integrating and loading data into Data Warehouse database.
- Performed Import and Export of DataStage components and table definitions using DataStage Manager.
- Used DataStage Director to Run and Monitor the Jobs performed, automation of Job Control using Batch logic to execute and schedule various DataStage jobs.
- Designed and created reusable components like Shared Containers and Stored Procedure.
- Created and used views in Oracle to simplify the mappings and make them easier to maintain.
- Wrote / modified stored procedures, stand alone functions and PL/SQL packages to comply with the requirements
- Developed UNIX Shell scripts to automate repetitive database processes and maintained shell scripts.
- Written COBOL programs for validating the data coming from different sources.
- Wrote test cases for unit and integration testing.
- Worked as offshore coordinator.
- Involved in Production Support and Operations teams to resolve production issues in a timely and efficient manner.
Environment: Ascential DataStage 7.5.1, IBM information analyzer, Oracle 9i, SQL, DB2, PL/SQL, SQL*Loader, Toad, DB2/UDB, Windows 2000, IBM AIX 5.2, Autosys and Erwin 4.0, AIX UNIX.
Confidential
Graduate Intern / QA
Responsibilities:
- Determined testing requirements developed and reviewed scripts for positive and negative test scenarios, conducted baseline testing, and generated reports.
- Worked with developers from different teams to understand the requirement better and to stay on same page from both Dev and QA team.
- Escalated issues to developers and verified fixes. Designed test plans and defined cases for functional, integration system, and user acceptance testing.
- Attended weekly defect report meetings and presented progress updates.
- Updating the test cases based on the Change Requests/Enhancements. Updating the Requirement Traceability Matrix document.
- Helped in implementing the Agile methodology within the team. Helped with iteration planning, testing and retrospectives.
- Reviewed use cases and other technical documents with creative, user experience and technical staff to ensure business requirements are adequately reflected in Business Requirement Specifications.
- Successfully validated multiple applications from client.
Environment: Test Director, Java, Java script, Oracle, SQL, PL/SQL, .NET, Web Logic Server, Windows, Manual Testing, Oracle, Tomcat and Windows.
