Ab Initio Technical Architect Resume
SUMMARY:
- 16.5 years of expertise in building design, development and testing of Ab Initio applications.
- Worked on Ab Initio GDE version 3.3.3 and CO>OP version 3.3.3.5
- Worked on Health Care Insurance, Banking & Finance and Telecom domain projects.
- Always involved in coding, unit testing, debugging and documenting processes.
- Actively provided highly effective Ab Initio design solutions to team and across other projects.
- Developed Continuous flow graphs in order to subscribe member and eligibility From Web Sphere MQ and publish to Ab Initio queues.
- Worked XML processing of the source Facets data.
- Sound knowledge on Conduct - IT Plan and use of PSETs for parallel processing in generic framework.
- Use of resource management in Conduct-lT Plan for parallel processing.
- Generation of various excel reports using Ab Initio tool.
- Provided Ab Initio best practices, Performance improvements to several projects.
- Strong Relational database development skills using SQL, PL/SQL, Oracle 9.x/10g/11g, Teradata 13.0.1.
- Expertise in writing UNIX Shell scripting.
- Good experience on Enterprise Metadata environment, Autosys Scheduling.
- Sound experience on STAR schema and Snow Flake Schema dimensional data base models.
- Excellent in doing Business Data Analysis and helped business for forming the business rules.
- Worked extensively in implementing Data Warehouse Applications and Business Intelligent applications.
- Involved in Specification and Requirement Analysis, Design, Development, and Testing of applications under UNIX/Windows NT platforms.
- Extensive Knowledge in Telecom, Banking and Financial domain projects.
- Excellent communication, people, team management and interpersonal skills.
TECHNICAL SKILLS:
Data warehousing Tools: Ab Initio(GDE 3.3.3, C0>Operating System 3.3.3.5), Conduct>lT Plan, Continuous Flows, XML file processing EME Talend 4.5, Talend Open Studio.
RDBMS: Oracle 9i/10g/11g, Teradata 13.0.1, MS SQL Server 2000/2005
Programming: UNIX Shell Scripting, C/C++, SQL*Plus, PL/SQL
Operating Systems: UNIX, LINUX, Windows NT/XP/2000
Scheduling Tools: Autosys, Control: M schedulers
Methodologies: Agile and Waterfall models
No SQL: MongoDB
Big Data: Sqoop 1.4.6, Hive 1.2.1, Pig 0.16.0, HBase 1.1.2, Map Reduce2 2.7.1
Open Source Language: Python 3.6, 3.2
PROFESSIONAL EXPERIENCE:
Confidential
Ab Initio Technical Architect
Responsibilities:
- Works with business team to gather requirements and understanding.
- Data analysis and validate the requirement using the test data.
- Design the application, coding, unit testing the requirements.
- Write the design specification documents and review with business and technical team.
- > Remote team co-ordination and management.
- Work and co-ordinate with offshore teams to meet delivery time line.
- Implement and Support the application after the completion.
- Building the complex Ab Initio batch processes using conduct-IT plan and resource management.
- Used Ab Initio components like filter by expression, partition by key, partition by round robin, join, sort, roll-up, gather and reformat components extensively.
- Used 4 way data parallelism mechanism to better improve CPU utilization.
- Developed UNIX wrapper scripts to call the plan.
- Documented processes and prepared IA, UAT MO and PROD release plans.
Environment: Ab Initio (CO>Operating system 3.3.3.5, GDE 3.3.3), UNIX shell scripting, SQL Server 2012, Autosys scheduling tool, remedy, SVN tortoise.
Confidential
Ab Initio Technical Architect
Responsibilities:
- Performed coding in Hive and Pig and consultation with exports for PySpark POC and review with business team.
- Sqooped about 1.4TB data for 70 regions data for POC and testing purpose.
- Worked with COE team for consultation, review of POC in Hive and Pig.
- Worked in Tez and Map reduce 63 nodes cluster for RAL conversion into Big Data POC.
- Worked in servers and Ambari to trace and capture the server metrics for report purpose.
- Built 10 jobs and executing in parallel for maximum throughout for combined and regional view of risk losses.
Environment: Edge node, Sqoop 1.4.6, Hive 1.2.1, Pig 0.16.0, Tez 0.7.0, Map Reduce2 2.7.1, Spark 1.6x, 63 cluster nodes.
Confidential
Senior Dev Lead
Responsibilities:
- Lead 2 teams size 14 members for this offshore onsite model project.
- Involved in coding and unit testing of Continuous graphs, Member subject that generate XML messages and publish in MQ.
- Worked on Continuous graphs, Product subject that subscribes XML messages from Ab Initio queues and load in IDS tables.
- Worked on development and unit testing of Product subject batch graphs that read from IDS and load into EDW tables.
- Actively provided design solutions for volatile requirement changes the project being Agile model.
- Use tools like Ab Initio ETL tool, Control-M Scheduler, Teradata, Oracle for development and testing.
- Take part 2 weeks sprint planning and demo sessions at end of sprint.
- Work and co-ordinate with offshore teams to meet delivery time line.
- Implement and Support the application after the completion.
- Used parallel unloads/loads to improve performance of Ab Initio graphs.
- Used Ab Initio components like filter by expression, partition by key, partition by round robin, join, sort, roll-up, gather and reformat components extensively.
- Used 6 way data parallelism mechanism to better improve CPU utilization.
- Developed UNIX wrapper scripts to call the plan.
- Documented processes and prepared QAT, IJAT and PROD release plans.
Environment: Ab Initio (CO>Operating system 3.1.6, GDE 3.1.7), UNIX, Oracle log, Teradata 13.0.5, Control M Scheduling, Continuous Flow, XML messages processing.
Confidential
Senior Dev Lead
Responsibilities:
- Working on MaxMC to Care Radius update project coding, unit testing.
- Actively provided highly effective application design solutions which later was very much appreciated by the client management.
- This product runs on agile methodologies. As a Matador member, owe Design, Develop and Test user stories assigned to Matador in a 2 weeks sprint cycle.
- Use tools like Ab Initio ETL tool, Control-M Scheduler, Teradata, Oracle for development and testing.
- Take part 2 weeks sprint planning and demo sessions for the Matadors (Onsite Team) at end of sprint.
- Arrange sprint planning and demo session for Transformers (Offshore Team).
- Work and co-ordinate with Transformers to meet delivery time line.
- Implement and Support the application after the completion.
- Developed Ab Initio generic graphs for common unloading and loading processes.
- Created unload and load psets and execute 10 psets in parallel execution.
- Developed Conduct>IT Plans and configure resource managements to execute 10 psets in parallel.
- Used Teradata Multiload, PT Api Load, API and Teradata Parallel Transporter loading mechanism.
- Used parallel unloads/loads to improve performance of Ab Initio graphs.
- Used Ab Initio components like filter by expression, partition by key, partition by round robin, join, sort, roll-up, gather and reformat components extensively.
- Used 6 way data parallelism mechanism to better improve CPU utilization.
- Developed lookup and lookup local functions to improve performance of Ab Initio graphs.
- Used metaprogramming functions like string split no empty, record info, add fields, remove fields to dynamically add action cd column and create staging table DML.
- Used metaprogramming functions like string split, vector difference, vector append to partial load and adhoc pset list files in case of plan failure.
- Developed UNIX wrapper scripts to call the plan.
- Documented processes and prepared QAT, UAT and PROD release plans.
Environment: Ab Initio (CO>Operating system 3.1.6, GDE 3.1.7), UNIX, Oracle log, Teradata 13.0.5, Control M Scheduling.
Confidential
Dev Lead
Responsibilities:
- To work with Manager in providing Analysis, Application Design, and Application development activities for CMSR project. It includes tasks like
- This product runs on agile methodologies. As a Matador member, owe Design, Develop and Test user stories assigned to Matador in a 2 weeks sprint cycle.
- Use tools like Ab Initio ETL tool, Control-M Scheduler, Teradata, Oracle for development and testing.
- Take part 2 weeks sprint planning and demo sessions for the Matadors (Onsite Team) at end of sprint.
- Arrange sprint planning and demo session for Transformers (Offshore Team).
- Work and co-ordinate with Transformers to meet delivery time line.
- Implement and Support the application after the completion.
- Used Ab Initio components like filter by expression, partition by key, partition by round robin, join, sort, roll-up, gather and reformat components extensively.
- Used 6 way data parallelism mechanism to better improve CPU utilization.
- Developed lookup and lookup local functions to improve performance of Ab Initio graphs.
- Developed UNIX wrapper scripts to call the plan.
- Documented processes and prepared QAT, UAT and PROD release plans.
Environment: Ab Initio (CO>Operating system 3.1.6, GDE 3.1.7), UNIX, Oracle log, Teradata 13.0.5, Control-M Scheduling.
Confidential, Irving, Texas
Ab Initio Tech Lead
Responsibilities:
- Work with the Citi Team Lead in providing Requirement Gathering, Analysis, Application Design, and Application development activities for the DMG applications. It includes tasks like
- As a lead, I take care of 3 individual projects.
- Attend requirement gathering and understanding meeting.
- Provide estimates agreed with Citi Team Lead.
- Attend daily status call to update development work progress and any show stoppers etc.
- Development and testing work assignment with offshore team and timely deliverables.
- Arrange daily IOPM EST call with offshore team to understand bandwidth and distribute development work across team of 3 members.
- Involve in Ab Initio develop, testing for self-work assignment.
- Developed Ab Initio graphs to generate various excel reports.
- Extensively used Ab Initio components like filter by expression, join, reformat, partition by key, partition by expression, roll-up, sort, merge components.
- Used 4 way MFS system for better CPU utilization.
- Developed different ways of Ab Initio graphs development and performance bench marking.
- Developed complex Ab Initio graphs and used component parallelism, pipe line parallelism and data parallelism.
- Developed Ab Initio Continuous flow to read from Citilink message queue and write onto a queue.
- Developed Ab Initio batch programs to read files from message queue.
- Developed UNIX scripts to invoke Ab Initio graphs and execute the batch processes.
- Implement and Support Go-Live application for 3 months warranty period.
Environment: Ab Initio (CO>Operating system 3.1.1, GDE 3.0.5), Talend 4.5, UNIX, Oracle log, MS SQL SERVER 2008, EME, Autosys Scheduler
Confidential, Warren, NJ
Ab Initio Tech Lead
Responsibilities:
- As a lead, I take care of 2 individual projects.
- Attend requirement gathering and understanding meeting with business team, BA, Citi Manager.
- Work with BA and business people to understand requirements and do analysis.
- Prioritize the requirements based on criticality and arrange team meeting to let offshore understand.
- Distributed work assignments among team members based on bandwidth.
- Development and testing work assignment with offshore team and timely deliverables.
- Interact with offshore team to understand bandwidth and distribute development work across team of 6 members.
- Involve in Ab Initio graph develop, testing for self-work assignment.
- Developed many Ab Initio batch programs for new feeds across NAM, EMEA, APAC and LATAM regions.
- Involved in high level design document and prepared low level document.
- Prepared source —target mapping sheet for Ab Initio graph development.
- Developed UNIX generic script to delete files old than 7 days in Dev, QAT and UAT environments and scheduled from Autosys.
- Implemented several Ab Initio graphs using Data parallelism and Multi File System (MFS) system.
- Implement and Support for the Go-Live application.
Environment: Ab Initio (GDE 1.15, C0>Operating System 2.15), Talend Open Studio, Talend 4.5, UNIX, Oracle log, Autosys Scheduler.
Confidential
Ab Initio Tech Lead
Responsibilities:
- Produced high level design and technical design.
- Ab Initio coding and unit testing.
- Offshore — Onsite team co-ordination.
- Developed complex Ab Initio graphs converting DTS SQL server scripts in Ab Initio.
- Used Ab Initio components like filter by expression, partition by key, partition by expression, partition by round robin, join, roll-up, normalize, de-normalized sorted, reformat, scan, RUN SQL, input file, output file, input table and output table components.
- Developed UNI)( Shell scripts to invoke Ab Initio generated scripts.
Environment: Ab Initio (GDE 1.15, Co-op 2.15), UNIX, Oracle log, SQL Server 2000/2005.
Confidential
Ab Initio Tech Lead
Responsibilities:
- Produced high level design and technical design.
- Ab Initio coding and unit testing.
- Offshore — Onsite team co-ordination.
- Developed complex Ab Initio graphs converting DTS SQL server scripts in Ab Initio.
- Used Ab Initio components like filter by expression, partition by key, partition by expression, partition by round robin, join, roll-up, normalize, de-normalized sorted, reformat, scan, RUN SQL, input file, output file, input table and output table components.
- Developed UNIX Shell scripts to invoke Ab Initio generated scripts.
Environment: Ab Initio (GDE 1.15, co-op 2.15), UNIX, Oracle log, SQL Server 2000/2005
Confidential
Senior Ab Initio Developer
Responsibilities:
- Prepared technical design.
- Ab Initio coding and unit testing.
- Prepared unit test cases and test plan.
- Developed UNIX scripts to move files among vendor servers.
- Used Ab Initio components like filter by expression, partition by key, partition by expression, partition by round robin, join, roll-up, normalize, de-normalized sorted, reformat, scan, RUN SQL, input file, output file, input table and output table components.
- Developed UNIX Shell scripts to invoke Ab Initio generated scripts.
Environment: Ab Initio, EME, GDE, UNIX shell scripting, Oracle log, Teradata, SQL Server 2000/2005
Confidential
Designer/ Senior Ab Initio Developer
Responsibilities:
- Prepared technical design.
- Ab Initio coding and unit testing.
- Prepared unit test cases and test plan.
- Used Ab Initio components like filter by expression, partition by key, partition by expression, partition by round robin, join, roll-up, normalize, de-normalized sorted, reformat, scan, RUN SQL, input file, output file, input table and output table components.
- Developed UNIX Shell scripts to invoke Ab Initio generated scripts.
Environment: Ab Initio, EME, GDE, UNIX shell scripting, Teradata.
Confidential
Designer
Responsibilities:
- Prepared technical design.
- Ab Initio coding and unit testing.
- Prepared unit test cases and test plan.
- Used Ab Initio components like filter by expression, partition by key, partition by expression, partition by round robin, join, roll-up, normalize, de-normalized sorted, reformat, scan, RUN SQL, input file, output file, input table and output table components.
- Developed UNIX Shell scripts to invoke Ab Initio generated scripts.
- Prepared code review checklist and build review report.
- Support PROD post implementation.
Environment: Ab Initio, EME, GDE, UNIX shell scripting, Oracle log, SQL Developer.
Confidential
Senior Ab Initio Developer
Responsibilities:
- Shadowing design lead for building technical design document.
- Involved in developing complex Ab Initio graphs and unit testing.
- Co-ordinated among team for technical resolution and guidance to the team members.
- Used Ab Initio components like filter by expression, partition by key, partition by expression, partition by round robin, join, roll-up, normalize, de-normalized sorted, reformat, scan, RUN SQL, replicate, input file, output file, input table and output table components.
- Developed UNIX Shell scripts to invoke Ab Initio generated scripts.
- Developed automated PL/SQL purging script to delete historical older than 2 years.
- Support PROD post implementation.
Environment: Ab Initio, EME, GDE, UNIX shell scripting, Oracle log, SQL Developer.
Confidential
Senior Ab Initio Developer
Responsibilities:
- Involved in developing complex Ab Initio graphs and unit testing.
- Co-ordinated among team for technical resolution and guidance to the team members.
- Used Ab Initio components like filter by expression, partition by key, partition by expression, partition by round robin, join, roll-up, normalize, de-normalized sorted, reformat, scan, RUN SQL, replicate, input file, output file, input table and output table components.
- Developed UNIX Shell scripts to invoke Ab Initio generated scripts.
- Developed UNIX automated script to purge files older than 30 days.
- Support PROD post implementation.
Environment: Ab Initio, EME, GDE, UNIX shell scripting, Oracle log, SQL Developer.