Etl Tech Lead Resume
San, FranciscO
SUMMARY:
- Over 11 Years of overall IT experience in Analyzing, Designing, Developing, Testing, Implementing and Maintaining client/server business systems.
- 9 years of experience with Extraction Transformation and Loading Datstage (ETL) tool - Knowledge in Data warehousing involving data warehouse analysis and design using IBM INFORMATION SERVER 8.5/8.1/8.0 (Designer, Director and Administrator) and Ascential Websphere DataStage 7.5/7.1/6.0.
- Extensively worked on Datastage Parallel Extender and Server Edition.
- Expertise in performing Data Migration from various legacy systems to target database.
- Developed Parallel jobs using various stages like Join, Merge, Lookup, Surrogate key, Scd, Funnel, Sort, Transformer, Copy, Remove Duplicate, Filter, Pivot and Aggregator stages for grouping and summarizing on key performance indicators used in decision support systems.
- Experience in UNIX environment, shell scripts,, Knowledge in understanding the PL/SQL scripts including stored procedures, functions at Database level.
- Expertise in Software Development Life Cycle (SDLC) of Projects - System study, Analysis, Physical and Logical design, Resource Planning, Coding and implementing business applications
- Good experience in writing UNIX shell scripts for Data validations, Data cleansing etc.
- Expertise in working with various heterogeneous and operational sources like Oracle, Teradata, DB2, SQL Server, Mainframes and MS-Access into ODS & DW in the staging area
- Extensive experience in development, debugging, troubleshooting, monitoring and performance tuning using Data Stage Designer, Data Stage Director, Data stage Manager.
- Strong understanding of the principles of Data Warehousing using Fact Tables, Dimension Tables, star schema and snowflake schema modeling
- Worked on different Scheduling tools like CA7, AutoSys and good experience in writing JIL scripts and designing Autosys jobs using Web GUI and proven track record in troubleshooting of DataStage jobs and addressing production issues.
- Skilled in writing technical specification documents, translating user requirements to technical specifications and creating and reviewing mapping documents.
- Experienced in troubleshooting DataStage jobs and addressing production issues such as performance tuning, enhancements and data issues.
TECHNICAL SKILLS:
Development/Productivity Tools: IBM Information Server 8.0.1., Data stage 7.5x (Server and PX), Informatica (Beginner), Apache Hive (Beginner)
Data Warehousing Scheduling Tools: CA-7 Scheduler, Control-M, Autosys.
RDBMS: Oracle 8.1, SQL Server 6.5, DB2, basics of Teradata
Programming Languages: Unix shell scripting, SQL, Basics of PL/SQL
Domains: Retail Industry, Sales, Finance, Securities and Electronics
Tools: Putty, TOAD, Teradata SQL Assistant, HPQC, HPALM, Team forge, POWER, Basics of mainframe CA7 commands to check JCL status.
PROFESSIONAL EXPERIENCE:
Confidential,San Francisco
ETL Tech Lead
Responsibilities:- Acquire new online Big Ticket Customer Data into IDM.
- Assign Appropriate affiliate Source and priority for new online Big Ticket customer with email.
- Process online Big Ticket Customer through Match Merge.
- Export new online Big Ticket customer to Epiphany for marketing Welcome and Segmentation.
- Export online Big Ticket transaction to Epiphany for Marketing Analytic.
- Work closely with the Business, Solution Architect, Data Modeler, Data Mapper, Business Analysts to understand business requirements, providing expert knowledge and solutions on Data Warehousing, ensuring delivery of business needs in a timely cost-effective manner
- Evaluate and design data collection, data staging, data movement, analytics delivery, data quality and archiving strategies
- Developed the jobs for Bigticket ETL applications using datastage tool, which loads data into DB2 and Vertica Databases. These jobs loads data into Dimensions and Facts which has SCD type-2 dimensional loads. The source data is extracted from the MST/DB2 and then sent to the vertica Database for future reporting purposes.
- Identify opportunities to optimize the ETL environment, implement monitoring, quality and validation processes to ensure data accuracy and integrity.
- Extensive ETL tool experience using IBM Infosphere/Websphere DataStage, Ascential DataStage.
- Worked on DataStage tools like DataStage Designer, DataStage Director.
- Strong understanding of the principles of Data Warehousing using fact tables, dimension tables and star/snowflake schema modeling.
- Worked extensively with Dimensional modeling, Data migration, Data cleansing, ETL Processes for data warehouses.
- Developed parallel jobs using different processing stages like Transformer, Aggregator, Lookup, Join, Sort, Copy, Merge, Funnel, CDC, Change Apply and Filter.
Environment: IBM Information Server 11.0.1, vertica, DB2.
Confidential,Fremont
ETL Tech Lead
Responsibilities:- Serve as technical lead and work with business partners to define product roadmap and requirements for SAP data migration program.
- Interact closely with key business stakeholders to understand user demands; product architects, development team to understand technical application dependencies and help build finer and detailed product specifications packaging features/functionality into phased product releases.
- Communicate functional and non-functional requirements via user stories to dev teams.
- Specify data mapping & data provisioning methodologies along with application interface detailing.
- Build project plans/delivery timeline with PM.
- Handled migration of legacy applications from SQL server to HANA models, enabling faster performance, better memory utilization and easier access to simpler interface modeling for future.
- Evaluate and design data collection, data staging, data movement, analytics delivery, data quality and archiving strategies
- Review the jobs for OPT ETL applications created using datastage/BODS tool, which loads data into CSV’s, and TAB’s. These files are created by extracting the data from Oracle DB using PL/SQL and Datastage Technologies and the files are sent to down Stream applications.
- Identify opportunities to optimize the ETL environment, implement monitoring, quality and validation processes to ensure data accuracy and integrity.
- Extensive ETL tool experience using IBM Infosphere /Websphere DataStage, Ascential DataStage .
- Worked extensively with Dimensional modeling, Data migration, Data cleansing, ETL Processes for data warehouses.
Environment: IBM Information Server 8.0.1, BODS, SAP HANA, SQL Server.
Confidential,San Francisco
ETL Datastage Developer / Tech Lead
Responsibilities:- Work closely with the Business, Solution Architect, Data Modeler, Data Mapper, Business Analysts to understand business requirements, providing expert knowledge and solutions on Data Warehousing, ensuring delivery of business needs in a timely cost-effective manner
- Evaluate and design data collection, data staging, data movement, analytics delivery, data quality and archiving strategies
- Developed the jobs for Stella ETL applications using datastage tool, which loads data into CSV’s, and TAB’s. Extracting the data from Oracle DB using PL/SQL creates these files and Datastage Technologies and the files are sent to down Stream applications.
- Involved in unit testing of ETL Datastage jobs.
- Identify opportunities to optimize the ETL environment, implement monitoring, quality and validation processes to ensure data accuracy and integrity.
- Extensive ETL tool experience using IBM Infosphere/Websphere DataStage, Ascential DataStage.
- Worked on DataStage tools like DataStage Designer, DataStage Director.
- Strong understanding of the principles of Data Warehousing using fact tables, dimension tables and star/snowflake schema modeling.
- Worked extensively with Dimensional modeling, Data migration, Data cleansing, ETL Processes for data warehouses.
- Developed parallel jobs using different processing stages like Transformer, Aggregator, Lookup, Join, Sort, Copy, Merge, Funnel, CDC, Change Apply and Filter.
Environment: IBM Information Server 8.0.1, Oracle, DB2.
Confidential
Tech Lead/Datastage Developer
Responsibilities:- Actively worked in all phases of the SDLC starting from requirements, design (LLD), development and unit testing, integration testing of all Datastage applications.
- Interaction with client for analysis of Organization data, ETL requirement gathering & data Consolidation.
- Work extensively in designing and developing datastage jobs and sequencers in Datastage V8.5 parallel edition.
- Worked in onsite-offshore environment, assigned technical tasks, monitored the process flow, conducted status meetings and making sure to meet the business needs.
- Used different Partitioning methods in parallel job (Auto, Round-Robin, Hash, and Entire) to improve the performance and to get the accurate results according to the business requirements
- Take higher responsibilities to lead the team and deliver the good quality of code.
- Worked in Data stage 8.0 PX job enhancements based on the new Requirements from Business.
- Extensively worked in Performance tuning of Datastage jobs that runs long while monitoring the flow.
- Used Datastage Designer for developing various jobs to extract, cleansing, transforming, integrating and loading data into Data Warehouse
- Scheduled the server jobs using Datastage Director, which controlled by Data Stage engine and also for monitoring and performance statistics of each stage
- Creation of jobs sequences and job schedules to automate the ETL process by extracting the data from flat files, Oracle and Teradata into Data Warehouse
- Preparation of UTP, UTC & also responsible for testing the jobs.
- Reviewing peer objects and submit the project status report to manger on daily basis
- Testing and Debugging Data stage job related issues
- Support various phases of Testing like SIT, UAT and PROD
- Provide RCA for specific requirements and provide estimation of SLA of UI availability based on the status of the batch run.
- Created and Managed the Defects that occurred in GRS project in HPQC tool.
- Analysis of functional and Technical defects and provided the relevant data stage code fix or appropriate solution within the given ETA.
- Currently took role in production monitoring, support and transition of interface for production support team
- Involve in understanding change requests and work on enhancements by providing right estimation.
- Maintained the different versions of code in POWER while deploying the code fixes to different phases like SIT, UAT.
- Raised CRQ in Remedy7 tool for deploying the code in Production environment.
Environment: IBM Information Server 8.0.1, Oracle, DB2, Teradata, SQL server and CA7.
Confidential
Datastage Developer
Responsibilities:- Extensively worked in all phases of the SDLC starting from requirements, design (LLD), development and unit testing, integration testing of all Datastage applications.
- Worked in onsite-offshore environment, assigned technical tasks, monitored the process flow, conducted status meetings and making sure to meet the business needs.
- Active role in Designing, Testing and supporting different types of complex DataStage jobs.
- Interact with client for analysis of Organization data, ETL requirement gathering & data Consolidation.
- Take higher responsibilities to lead the team and deliver the good quality of code.
- Worked on creating mapping documents from the business requirements and designed the ETL
- Created multiple jobs and sequences in Data stage 8.0 PX Job design and responsible for creating Design documents.
- Design and development of Data stage jobs for different subject areas & preparation of UTP, UTC & also responsible testing the jobs.
- Reviewing peer objects.
- Support various phases of Testing like SIT, UAT and PROD
- Ensure deliverables of high quality that meet requirement within budget, schedule and time.
- Preparation of Low-level Design and High-level Design docs) with reference of source to target mapping.
- Development of datastage design concepts, execution, testing and deployment on client server.
- Modifying the existing Job if required using Datastage Designer for developing various jobs to extract, cleansing, transforming, integrating and loading data into Data Warehouse.
- Used Datastage Director to schedule running the jobs, monitoring scheduling and validating its components.
- Responsible for understanding change requests and work on enhancements by providing right estimation.
Environnent: IBM Information Server 8.0.1, Oracle, DB2, SQL Server, AIX Server(UNIX)
Confidential
Senior ETL Specialist
Responsibilities:- Analysis and Understanding the process of the Requirement.
- Providing technical suggestion to implement the complex logic in ETL /SQL/Procedure.
- Troubleshooting and rectifying for issue if any team is facing and providing right contact if team not able to do.
- Designed various kind of Jobs in Datastage 8.0.
- Co-ordination between offshore team and onsite team meeting with client whenever needed.
- Sending the status and task allocation for ETL offshore team and prioritizing activities.
- Clarify the business rule if needed from BA and source system technical /business user.
- Prepare the high-level design document (For ETL) with reference of SOW.
- Worked effectively in Performance tuning of Datastage jobs.
- Created sequences, which include the workflow of jobs in the Datastage project.
- Created UTC (Unit Test Cases).
Environment: IBM Information Server 8.0.1, Oracle
Confidential,Boston
Senior ETL Datastage Developer
Responsibilities:- Analysis and Understanding the process of the Requirement.
- Involved in Creation of Design documents like TAD (Technical Analysis document) etc.
- Designed the Jobs in Data stage 7.5.2 PX.
- Developed mappings using the stages like Sequential file, Lookup Stage, Aggregator Stage, Transformer stage and etc.
- Created sequences which include the jobs in data stage project.
- Running and monitoring of Jobs using Datastage Director and checking logs.
- Involved in creating UNIX Shell scripts for Header and Trailer validation and other functional validation of source files/Flat files.
- Created UTC (Unit Test Cases) and DIT(Development Integration Test Castes)
- Involved in creation of Job Information Language (JIL) files in Autosys for scheduling ETL jobs.
Environment: Data stage 7.5, Oracle
Confidential
Senior ETL Datastage Developer
Responsibilities:- Analysis and Understanding the process of the Requirement.
- Designed the Jobs in Data stage 7.5.2 PX.
- Developed mappings using the stages like Sequential file, Lookup Stage, Aggregator Stage, Transformer stage and prepared the UTC (Unit Test Cases)
- Involved in migration of Server jobs to Parallel jobs using ETL-Data stage tool.
Environment: Datastage PX, Oracle
Confidential
Senior ETL Datastage Developer
Responsibilities:- Analysis and Understanding the process of the WIBI.
- Interaction with the Source data owner for the data (SAP Team).
- Writing Specification & Writing Unit Test conditions.
- Design the Job In Datastage 7.5.2 PX. Developed mappings using the Datastage built-in stages like Sequential file, Lookup Stage, Aggregator Stage, Transformer stage and etc. jobs using DataStage tool to load data warehouse and Data Mart.
- Created sequences which include the jobs in data stage project.
- Design and Develop ETL Performance tuning of Datastage jobs.
Environment: Datastage 7.5.2, DB2 and AIX
Confidential
ETL Developer
Responsibilities:- Analysis and design of ETL - processes.
- Created Data Stage server jobs to load data from oracle and ODBC, sequential files, flat files etc.
- Used the Data Stage Designer to design and develop jobs for extracting, cleansing, transforming, integrating, and loading data into the target
- Created job sequences and schedules for automation.
- Used DataStage tool to transform the data to multiple stages, and prepared documentation.
- Used Data Stage Manager for importing metadata from repository, new job categories.
- Customized Datastage applications, Managed Data Stage Jobs and Job Sequences
- Analysis and Creation of Control-M specifications from Test Director.
- Creation and Execution of Drafts in Control - M.
Environment: Data Stage7.5, Oracle 9i, Control