Ab Initio Developer Resume
SUMMARY:
- Developing graphs using generic graph development practice, leveraged extensive Data parallelism techniques, handled up to 64 Multi file systems. Good working experience with Join, Sort, Roll up, Scan, Partitioning, Re - partitioning, Normalize, XML, Index, Lookup (Block compressed lookup) and Webservices components.
- Extensive use of Ab Initio Vector functions, loops, writing PDL expressions using meta programming function for complex data manipulation requirements. Experienced in design and development of Ab Initio Conduct>It plans to run graphs and scripts.
- Trained and have good understanding on Ab Initio Express>It Components ACE & BRE.
- Proficient in analyzing and translating business requirements to technical requirements and architecture.
- Hands-on experience in improving performance and troubleshooting of Ab-Initio graphs and Ab Initio Products like Control Center, Resource Pooling.
- Familiar with Banking industry on positional data, trade data, Securities etc.
- Good understanding on Hadoop distributed file system and Hadoop components.
- Good experience in EAP (Enterprise Analytics Platform) using Big Data Hadoop cluster data distributions and processing through Ab Initio and loading to HDFS and Hive
- Strong database skills, Object Oriented Programming and development knowledge
- Experience in handling multiple tasks included supporting COB tests and deployment
- Good communication skills, interpersonal skills, self-motivated, quick learner and proactive team player.
TECHNICAL SKILLS:
Data Processing Tool: Ab Initio: Co>Op Sys 3.1.5, 3-2-5, 3.3.4, 2-14/3.0.3.9, GDE: 1.15, 3.0.4.1, 3.1.5, 3.3.4, ACE, BRE, Unix Shell Scripting, Oracle PL/SQL, Ab Initio Data Profiler
Database: Oracle, DB2, Sybase, Teradata, Hive
Reporting Tool: Cognos
Programming: Unix Shell Scripting, Ab Initio PDL, PL/SQL, UNIX Shell Scripting, Visual C#, C, C++
Scheduler: Autosys, Control Center, Auto watch Portal
Other Tools: MS PowerPoint, Visio, Word, Excel, SQL developer, Putty, Service Now
PROFESSIONAL EXPERIENCE:
Confidential
Ab Initio developer
Responsibilities:
- Developed Complex ETL Transformation Ab Initio graphs as per business logic.
- Converts the business requirements to detailed technical detailed and low-level design document for Genesis Data mart loading.
- Developed complex batch processing graphs to read the data from multiple Genesis Source systems (product processors), cleanse, transform and load the data into the Staging tables.
- Designed and Developed continuous flow graphs to post messages to the queue after processing the data from different source systems, so that downstream processes can consume the data in real time.
- Developed graphs using complex PDL metaprogramming and vector functions to apply the transformation logics in the graph level parameters.
- Using the backend EME commands extensively for code check-in and tag creation.
- Developed Unix shell scripts to trigger file transfer from Genesis to other downstream systems using NDM.
- Preparation of Production support application information document for each application.
- End to end testing of all subsystems with the dummy data.
- Tracked the defects through HPQC and resolved the defects that is evolved during SIT, UAT testing and in production.
- Design & Develop ETL Ab Initio jobs to transform and load data from multiple source systems into Teradata Datamart.
Confidential
Technical Ab Initio lead
Responsibilities:
- Responsible for gathering and translating detailed Business and Technical Requirements from the Business teams.
- Develop ETL graphs for batch processing requirements, involves interacting with enterprise wide multiple sourcing teams and identify the data source and elements with the help of FRD.
- Prepare High Level Document, Low Level Document, develop and test graphs, promote graphs to production.
- Develop Ab Initio webservice graphs for different data request and redesign work.
- Applied parallelism concepts to fine tune the long running graphs with better performance.
- Developed background running Unix script to clean up temp files, OC logs.
- Worked on designing and developing complex generic graphs to create the summary Data Quality output files to load into DQP Datamart.
- Developed graphs including complex record format transformation operations using PDL and vector functions to transform the data from EAP platform into flat summary file.
- Worked with SMEs to collect the additional and output attributes to be loaded in the detailed Oracle tables from the EAP Hadoop Hive tables and Avro files.
- Setting up Auto watch portal through EAP platform and write logics to derive the variables defined in Auto watch portal configurations, calendar and schedule in EBX.
- Develop Ab Initio graphs in Hadoop distributed environment as part of extracting and transforming the summary and detailed data from EAP platform.
- Worked on Profiling the datafiles in EAP and converting the output of the profile into JSON file to view them from Auto watch Portal.
- Good experience in Off-Shore/On-Shore Co-ordination and working as a team towards delivery.
Confidential maintenance of ETL
Responsibilities:
- Designed graphs with various transformations to data using GDE.
- Developed block compressed lookups, graphs as per requirements. controlled code versions using EME.
- Tested and debugged Ab Initio code in SIT and UAT.
- Created test cases and maintained with version control.
- Attending and leading business meetings to understand functional requirements.
- Scheduling Ab Initio jobs, graphs, parameter sets and Unix scripts in Autosys.
Confidential maintenance of ETL
Responsibilities:
- Enhanced and Supported 6 major applications in Ab Initio and Unix environment
- Attending and leading business meetings to understand functional requirements.
- Developed background running Unix script to clean up temp files, OC logs.
- Completing the cycle of DMS applications every day i.e. processing more than 60 feeds and sending to downstream.
- Ensuring batch completions within defined SLA's for all applications.
- Scheduling and monitoring Ab Initio jobs, graphs, parameter sets and Unix scripts in OC & Autosys.
- Investigated performance and functional issues in Production environment.
- Providing Support for Application Deployment at production and other activities like environment upgrades, COB Testing, Migrations and Disaster Recovery, Continuity of Business etc.
- Provided technical and investigative support for functional users on defects, change requests, debugging issues, testing and Ad-hoc report requirements
- Establishing Quality Procedure for the team and continuously monitor and audit to ensure team meets quality goals.