Lead Engineer Resume
0/5 (Submit Your Rating)
TX
SUMMARY
- 10+ years Technical and Functional experience in Data warehousing using Datastage 7.5/8.5/9.5,Erwin.
- Experience in Data modeling with Erwin.
- Good Knowledge of Ralph Kimball & Bill Inmon Methodologies
- Efficient in integration of various data sources SAP, DB2, SQL Server and Oracle, Teradata.
- Proficient in scripting with UNIX Shell script.
- Comfortable working with tools and hand - coding SQL.
- Expert Confidential troubleshooting and resolving technical Issues.
- Experience in complex jobs Design using Lookup, sort, aggregator, Transformer, XML, Pivot stages.
- Experience in creating sequence jobs integrating individual jobs, scripts, Procedures.
- Experience in optimizing performance, good knowledge in exception handling, Error handling.
- Created reusable jobs programs using shared containers.
- Experience using before and after routines.
- Very good experience in conversion of jobs from server to parallel, Informatica to Datastage and Version to Version.
- Experience in Scheduling and monitoring jobs in Datastage Director.
- Experience in creating new projects in Datastage Administrator.
- Trained in Hadoop.
- Taught Data warehousing principals and Datastage to team members.
- Good experience of working with Informatica Powercenter 8.x.
- Experience with complex mappings using source Qualifier, Joiner, Filter, sort, Update strategy, Sequence generator, Lookup, aggregator.
- Created workflows and Worklets by using Workflow manager tools.
- Experience in Unit Testing and UAT.
- Excellent communication, interpersonal skills and a team-worker with excellent customer interaction.
- Knowledge on MSBI (SSIS ETL).
TECHNICAL SKILLS:
ETL Tools: Datastage 7.5/8.1/8.5/9.1 (Designer, Director, Administrator)Informatica PowerCenter 8.x(Repository Manager, Designer, Workflow Manager)
Data modeling Tools: Erwin 7.1
Database and related tools: Oracle, Toad, SQL Developer, SQL Server, Teradata
Operating Systems: Unix, Linux, Windows 8/XP
Other: MS Word,Ms Excel, MS Office, Outlook, Winscp, FTP, Putty
Scripting: Unix Shell Scripting
PROFESSIONAL EXPERIENCE:
Confidential, TX
Lead Engineer
Responsibilities:
- Developed, deployed and monitored daily and monthly ETL jobs.
- Created OLAP data models in ERwin.
- Was able to maintain the production system 100% uptime.
- Managed offshore team with 2 people for Teradata.
- Involved in daily and weekly team discussions, Town halls.
- Processed Weekly and Monthly loads.
- Resolved Issues while processing WH Loads.
- Developed ETL Mappings using Datastage.
- Developed Datastage mappings and tuned them for better performance.
- Extensively worked on Datastage Transformations.
- Wrote maps for daily data loads.
- Worked with flat files, Oracle, Teradata and DB2 as sources.
- Designed and developed Oracle PL/SQL Scripts.
- Worked on various operating systems like UNIX AIX, Sun Solaris and Windows and Developed Strategies for Extraction Transformation Loading (ETL) mechanism.
- Developed UNIX Shell scripts.
- Optimized database objects and streamlining applications.
- Developed Datastage jobs extensively using Aggregator, Sort, Merge, and Data Set in Parallel Extender to achieve better job performance.
- Identified source systems, their connectivity, related tables and fields and ensure data suitably for mapping.
- Scripts dat can be run from Datastage sequence jobs, which can run and report on the status of Datastage jobs from an CRONTAB-scheduling tool.
Confidential
Senior Engineer
Responsibilities:
- Assist in defining requirements and designing applications to meet business process and application requirements.
- Involved in Extracting CISPlus data and transformed legacy data using Datastage. In SAP acceptable format.
- Created Projects in Administration.
- Responsible for creating and testing ETL processes composed of multiple Datastage jobs using Datastage Job Sequencer and shell scripts.
- Created shell scripts which will invoke the Datastage jobs passing all the variables for the job to execute like Source and Target databases connection information
- Using Datastage designed the procedures for getting the data from all systems to Data Warehouse system.
- Tuned Datastage jobs for better performance by creating Datastage Hash files for staging the data and lookups.
- Used Datastage Director for running the Jobs and scheduling them.
- Used the Manager to import, export jobs/routines from various environments.
- Developed processes for extracting, cleansing, transforming, integrating and loading data into DataMart’s using Datastage Designer.
- Generated Surrogate ID’s for the dimensions in the fact table for indexed and faster access of data.
- Worked with Datastage components for Data cleansing and conversion and loaded data into target database.
- Created database procedures, functions and triggers using PL/SQL.
- Used shared containers for multiple jobs, which have the same business logic.
- Trouble-shooting problems in Datastage.
- Worked with SAP, Oracle as a source system
- Provided production support after project went live.
- Managed 3 members work, which helped project in reducing the team size.
- Visited Client Location Australia, Melbourne to support in Go live Period.
- Designed Complex jobs using Look ups and Sort Stages.
- Resolved not subject related bugs Confidential the time of UAT.
- Experienced with Datastage (Parallel Jobs & Server Jobs). worked 3 projects with the same clients
Confidential, Ohio
Lead Engineer
Responsibilities:
- Lead and guided the Team around 10 size.
- Prepared Unit Test cases, Created and maintain standards in various stages for SDLC.
- Authored Technical Design Documents.
- Created coding standards.
- Performed review and Testing of daily Deliverables.
- Assigning tasks to team members.
- Developed complex jobs using Lookups and Aggregator.
- Used built-in as well as complex custom transformations
- Trouble-shooted the designed jobs using the Debugger.
- Identified source systems, their connectivity, related tables and fields and ensure data suitably for mapping.
- Designed the mappings between sources external files and databases like Oracle, SQL Server, DB2 and XML files to Operational staging targets.
- Worked with Teradata as a Target system
- Involved in creating more TEMPthan 80+ jobs using Datastage Designer.
Confidential
ETL Developer
Responsibilities:
- Using Datastage designed the procedures for getting the data from all systems to Data Warehouse system.
- Worked with stages like ODBC, OCI, Hash-File, Sequential File, Sort, and Aggregator.
- Tuned Datastage jobs for better performance by creating Datastage Hash files for staging the data and lookups.
- Worked with XML stages in DS 7.5
- Developed processes for extracting, cleansing, transforming, integrating and loading data into Data mart using Datastage Designer.
- Worked with Parallel Jobs 7.0
- Created multiple Config file for different jobs
- Debugged jobs using Row Generator and Column Generator stages to create test data
- Worked with environment variables like APT CONFIG FILE, APT DUMP SCORE
- Created database procedures, functions and triggers using PL/SQL
- Created and used Oracle Stored Procedures in the Datastage jobs to increase the performance of the jobs
- Worked with TOAD to interact with Oracle and Used SQL Trace and Explain Plan to improve the performance of the PL/SQL programs
- Trouble-shooting problems in Datastage.
- Used Datastage Director for running the Jobs and scheduling them.
- Used Datastage Manager to import, export jobs/routines from various environments.
- Created shell scripts which will invoke the Datastage jobs passing all the variables for the job to execute like Source and Target databases connection information
- Worked closely with company executives and reporting team for solving problems with data quality and timely publication of daily reports.
- Responsible for creating and testing ETL processes composed of multiple Datastage jobs using Datastage Job Sequencer and shell scripts.
- Lead the Team of size 3.
- Prepared Technical Design Documents.
- Prepared Unit Test cases, Created and maintain standards in various stages for SDLC.
- Changed the job design to increase performance.
- Trained 10 interns in Datastage. worked 4 projects with the same clients