SUMMARY

• Having 8+ Years of IT experience in the roles of Application Design and Building using Hadoop, Java, XML Parsing, XSLT, Message Queue & Shell scripting languages.
• Strong experience and knowledge of processing Big Data using Hadoop ecosystem components HDFS, YARN, MapReduce, Hive, Pig, Sqoop, Oozie, Flume, Storm, Kafka, HBase, Titan graphdb, Solr search, Atlas& Cassandra.
• Strong experience in Kafka & Storm implementation and tuning.
• Experience working with Batch type ETL/ELT payloads using Flume, Sqoop and Oozie for data ingestions, data transformation using Pig and data analysis using Hive.
• Experience with implementing Titan GraphDB using Hbase as backend.
• Very good experience in installation, allocation of resources and Administration in HDP cluster.
• Experienced in Cassandra & HBase using Storm.
• Used Oozie to schedule the jobs in Hadoop.
• Experienced with HIVE and MR.
• Getting involved in all the steps of development life cycle of the project
• Providing support to System Analysts to prepare CSD
• Good Experience on MB development Version 7.0.
• Good experience on UNIX, Linux, QSHELL scripting.
• Quick learner with the ability to grasp new technologies.
• Worked extensively with the Onsite - Offshore model possessing good user communication skills and debugging skills.
• Ability to convert client requirements to technical specifications.
• Good documentation skills implemented Wiki library documentation in our project successfully.
• Design the process plan and provide status reports to upper management daily/weekly.
• Developed business in service improvements and system enhancements using the latest technologies.
• Ensure deliverables are made within the agreed time lines with high quality standards.

TECHNICAL SKILLS

BigData Technologies: Hadoop, YARN, Hive,Hbase, Sqoop,Flume, Pig, Kafka, Storm, TitanDB.

Databases: Oracle, DB2, MS Sql Server 2005, MS-Access

Designing Tools: Ms- Visio

Version Management Tools: SVN, Aldon, GitHub

Application Development: Java, PL/SQL, Cobol

Database Development Tools: SQL Developer, Toad for Db2

Scheduling Tools: Control-M, Autosys, OOZIE

Operating Systems: Windows, Unix, OS400 and Linux

Quality/ Defect Tracking: HP Quality Center

Tools: & Utilities MQ, Aldon LMi, XML Spy

PROFESSIONAL EXPERIENCE

Confidential, Houston, TX

Solution Designer

ENVIRONMENT: & TOOLS: HDP 2.3, Cassandra, Storm, Kafka.

Responsibilities:

• Implemented storm topology to process the incoming documents from different agents.
• Modified the topology to use Acking functionality and implemented “Atleast once semantics”
• Did analysis to identify the bottlenecks in the system& did the code changes in the bolts accordingly.
• Around 25 HW tickets was closed. Related to configurations, misbehavior, improper utilization of resources etc.
• Developed parsing, persistence and notification bolts in STORM to process the JSON documents.
• Make effective use of cluster in respect to CPU utilization.
• Created Cassandra Key space (Schema).
• Trained the team to use the right parameters in Storm for improving the performance in the system.
• In depth analysis of the system and understand the behavior of topology.
• Designed &executed the test cases for improving the performance.

Confidential, Menlo park, CA.

Snr.Bigdata developer

ENVIRONMENT: & TOOLS:HDP 2.2, Hive, Pig, Solr 4.10, Sorj client.

Responsibilities:

• Indexing of multiple data using pig.
• Large scale data was preprocessed, joined data and then output the resulting datasets to LucidWorks Search
• Implemented Rest API Services to consume solr collection search through SolrJ client.

Confidential, Menlo park, CA

Snr.Bigdata developer

ENVIRONMENT: & TOOLS: HDP 2.2, HBase, Storm, Kafka, Titan Graph, Java & REST services

Responsibilities:

• CreatedREST servicesto insert the JSON documents into the HBase and Titan DB.
• Implemented storm topologies to process the incoming documents.
• Implemented HBase schema.
• Install and configure all the services required for the project.
• Used Docker for installation of HDP & TitanDB.
• Implemented Transformation and notification bolts in STORM to process the JSON documents.
• Implemented the modules to create relationships(Edges) between different vertices on Titan graph database using Java.
• Tested and deployed the code on cluster.

Confidential

Hadoop developer

ENVIRONMENT: Hadoop PIG, OOZIE, MapReduce, HBase, Flume, HDFS.

Responsibilities:

• Moved all crawl data flat files generated from various retailers to HDFS for further processing.
• Written the Apache PIG scripts to process the HDFS data.
• Created Hive tables to store the processed results in a tabular format.
• Developed the Sqoop scripts in order to make the interaction between Pig and MySQL Database.
• Completely involved in the requirement analysis phase.
• Worked on pulling the data from MySQL database into HDFS using Sqoop.
• Load the data into HIVE External tables.
• Provided ad-hoc queries and data metrics to the Business Users using Hive, HBase &Pig.
• Developed the UNIX shell scripts for creating the reports from Hive data.

Confidential

Hadoop Developer

ENVIRONMENT: & TOOLS: Hadoop PIG, OOZIE, MR, HBase, HDFS.

Responsibilities:

• Coding of the programs against the Program specifications.
• Working with Subject Matter Experts and understanding the system requirements, and creating project processes and documenting
• Implement the system to be developed on BIGDATAHadoopframework HDFS, MAPREDUCE, HIVE and manage the development of the product using an existing framework built using J2EE, Oracle databases 10G/11i.
• Worked on HBase for storing data and analysis.
• Strong expertise on MapReduce programming model.
• Design and implementation of migrating customer.
• Expertise in SQOOP to bring the smaller set of dimension tables from Oracle EDW required for Analytics processing.
• Design and develop PIG code for ETL/ELT to process the Customer and Transaction data according to Business rules
• Sqoop ingest data in hive stage environment.
• Strong expertise in internal and external tables of HIVE
• Worked with business teams and created Hive queries for ad hoc accessimplemented MR programs for getting the required results.
• Created Hive tables to store the processed results in a tabular format.
• Developed the sqoop scripts in order to make the interaction between Pig and MySQL Database.
• Completely involved in the requirement analysis phase.

Confidential

Java Architect

Responsibilities:

• Implemented new tool using applets.
• Designing the screens and options.
• Created the programs for fetching the data from tables from DB2 system and insert the data to DB2 in Mainframes tables in SMS system.
• Verification of the code against the Program specifications given to co-developers and preparing the review record for each program.

Confidential

Responsibilities:

• Prepare the design and documented Technical specification document.
• Prepare the quality documents and deliver them.
• Interact with the SA’s while design phase and check the design meets all the business requirements by preparing CO-Matrix.
• Designed and developed aRESTful API service.
• Providing changes to the system as per the client specification.
• Involved in unit testing
• Resolving the Bugs raised by the testing team.

Confidential, NY City, NY

Team lead

Responsibilities:

• Provide the design and documenting the Technical specification document.
• Interact with system analysts in understanding the requirements.
• Worked with Admins and gather the requirements.
• Specified new environments for change management cycle.
• Created 1 script which can be useful for all the environments. Earlier we use 6 scripts for different environments.
• Helped the Admins to run one pilot project for implementing the tool.
• Prepare the quality documents and deliver them.
• Providing changes to the system as per the client specification
• Involved in unit testing
• Resolving the Bugs raised by the testing team.
• Gave the KT sessions to team members in using the new tool.

Confidential

Team Lead

Responsibilities:

• Fundserv sends xml file every month to the Franklin Templeton which consists the dealer ps of receiving the feed files.
• This file is processed using XSLT, JAVA and COBOL to update the dealer ps.
• Created a utility in Java to receive the files from Fundserv and process the data according to the business requirements.
• Prepare the Technical specification document.
• Prepare the quality documents and deliver them.
• Providing changes to the system as per the client specification
• Involved in unit testing
• Resolving the Bugs raised by the testing team.

Confidential

Java Developer

Responsibilities:

• Provided the design for the application for picking up and creating the extracts.
• Implemented new java programs for generating extracts using Java &MQ.
• Created the programs in AS400 for fetching the data from tables in DB2 system and create XMLs out of that data and transmitted that to Queues.
• Extract the data from queues and create the extract files out of it.
• Verification of the code against the Program specifications given to co-developers and preparing the review record for each program.

Confidential

Java, MQ Developer

Responsibilities:

• Analyze the Requirements and fixing the issues
• Delivery of the Work Packs with Test result documents
• Providing changes to the system as per the client specification
• Involved in unit testing
• Conducting Sessions to the New Comers
• Knowledge sharing with the Team in new technologies
• Resolving the Bugs raised by the client.
• Created screens using SDA.
• Work with sub files.
• Developed Test Cases for Unit Testing and Integration testing
• Analyzing the objective and preparing documentation for particular fields
• Generating reports preparing system maintenance documentation.
• Involved in report generation