SUMMARY

• 6+ years of work experience in real time software development.
• Background knowledge in HADOOP, BIGDATA, PIG, HIVE, MAPREDUCE, SQOOP, HBASE, OOZIE.
• Experience in importing & exporting the data using Sqoop from HDFS to RDBMS and vice versa.
• Good understanding of Hadoop architecture and its components like HDFS, Job Tracker, Task Tracker, Name Node, Data Node and MR programming paradigm.
• Experience in developing Map Reduce programs using Apache Hadoop for analyzing the Big Data as per the requirement.
• Knowledge in using NoSQL databases like HBase.
• Knowledge in usage of combiners, mappers, reducers to optimize Map Reduce algorithms
• Experience with Oozie workflow engine in running Hadoop jobs.
• Experience in software development life cycle: creating design specifications, code management, preparing test plans and independent unit testing.
• Involved in development & maintenance of Insurance, Mortgage, Health Care Domain Projects.
• Lead onshore & offshore service delivery functions to ensure end to end ownership of incidents and service requests.
• Possess knowledge in Web/Mobile Application development technologies like iOS - Swift, Android Java, XHTML/HTML 5, CSS3, JavaScript, JQuery, AJAX, PERL, PHP, MySQL, JSON and also Mainframe Technologies including COBOL, JCL, DB2, & VSAM.
• Background in developing web/mobile applications using iOS-Swift, Android-Java.
• Certified Mobile (Android and iOS) and Web Application developer.

TECHNICAL SKILLS

Big Data: Hadoop, Map R, Pig, Hive, HBase, Sqoop, Oozie.

Programming Skill: Swift, Core Java.

Web Application Development: XHTML/HTML 5, CSS3, JavaScript, JQuery, PHP, AJAX, PERL, JSON, Servlets & JSP.

Database Technologies: MySQL, DB2.

Mobile Application Development: iOS-Swift, Android - Java.

Mainframe: COBOL, JCL, VSAM, DB2, Xpeditor, File Aid, File Manager, Spufi, ISPF.

Platforms: Windows, Mac, Linux.

PROFESSIONAL EXPERIENCE

Confidential, CA

Hadoop Developer

Environment: Hadoop 2.2.0, Map Reduce, Hive, Pig, Oozie, UNIX, Sqoop, Java (JDK 1.6), SQLLinux Red Hat, Yarn.

Responsibilities:

• Designed and developed Hadoop system to analyze the dump data using Map Reduce, Hive, Pig, and Sqoop.
• Designed Map Reduce jobs using Java API.
• Handled importing of data from various data sources to Hadoop, performed transformations using Hive, Map Reduce.
• Created and worked Sqoop (version 1.4.4) jobs with incremental load to populate Hive tables.
• Created Pig (version 0.12.0) scripts to transform raw data from several data sources to baseline data.
• Developed Hive (version 0.13.1) queries to perform adhoc data analysis to meet the requirements.
• Analyzed the data by performing Hive queries and running Pig scripts to know user behavior.
• Designed and created both Managed and External tables in Hive with dynamic partitioning and buckets to optimize performance.
• Handled 512 GB of data volume with 4 Node cluster in Test environment.
• Developed UDFs in Java as and when necessary to use in HIVE and PIG queries.
• Designed and coded application components in an agile environment utilizing test driven development approach.
• Developed Unit Test Cases for Mapper, Reducer and Driver classes using MRUnit.
• Used Sqoop to move the analyzed data to MYSQL for report generation.
• Analysis of the application usage in a day-day basis on a sample of machines log data using Hive, Pig.
• Log data stored in HDFS is processed, analysed and then imported into Hive warehouse, which enabled end business analysts to write HiveQL queries.
• Developed various workflows using custom Map Reduce, Pig, Hive and scheduled them using Oozie.

Confidential, MO

Hadoop Developer

Environment: Hadoop 1.0.1, MR, Hive, Oozie, UNIX, Sqoop, SQL.

Responsibilities:

• Designed and developed Hadoop system to analyze the 5 countries last 2 years’ transaction activities data using Map Reduce, Hive, Pig, and Sqoop.
• Effectively used Sqoop to transfer data between databases and HDFS.
• Designed Map Reduce jobs using Java API.
• Handled importing of data from various data sources to Hadoop, performed transformations using Hive, Map Reduce.
• Wrote Hive queries for data analysis and reporting purposes of different streams in the company to meet the requirements.
• Analyzed the data by performing Hive queries and running Pig scripts to know data behavior.
• Log data stored in HDFS is processed, analysed and then imported into Hive warehouse, which enabled end business analysts to write HiveQL queries.
• Developed various workflows using custom Map Reduce, Pig, Hive and scheduled them using Oozie.
• Handled 512 GB of data volume with 4 Node cluster in Test environment.
• Built re-usable Hive UDF libraries which enabled various business analysts to use these UDF’s in Hive querying.
• Developed UDFs in Java as and when necessary to use in HIVE and PIG queries.
• Developed Unit Test Cases for Mapper, Reducer and Driver classes using MRUnit.
• Used Sqoop to move the analyzed data to MYSQL for report generation.
• Designed and coded application components in an agile environment utilizing test driven development approach.
• Analysis of the application usage in a day-day basis on a sample of machines log data using Hive, Pig.

Confidential

Senior Software Engineer

Environment: COBOL, JCL, DB2, CICS, VSAM, File Manager, Endeavor, Spufi, File Aid, EasytrieveISPF, IBM Utilities.

Responsibilities:

• Involved in complete SDLC including requirement analysis, coding, unit testing and implementation.
• Modified and tested several COBOL programs, IMS programs and CICS programs according to the business requirements.
• Monitored the nightly batch process and ensure the online regions for the applications are up on time as per the SLAs.
• Resolve batch failures to ensure the batch cycle is not delayed.
• Identified and implemented permanent fixes for the issues identified in the batch.
• Interacted with testing team for deployment of code in testing environment.
• Generated reports as per the requirements using easytrieve and provided the reports to the customers.
• Automated several manual processes, which reduced the team effort in performing the daily activities.
• Performed adhoc data fixes by writing SQL and IMS queries to correct the data.
• Created new JCLs and easytrieve programs, which would split very large files to process them in parallel so that the batch performance is improved.
• Load the DB2 tables for the billing system whenever an adhoc bill was requested to be generated.
• Developed test cases for Unit Testing and functional testing for various modules and prepared Code Documentation for future reference and upgrades.

Confidential

Software Engineer

Environment: COBOL, JCL, DB2, CICS, VSAM, File Manager, Endeavor, Spufi, File Aid, EasytrieveISPF, IBM Utilities.

Responsibilities:

• Involved in complete SDLC including requirement analysis, coding, unit testing and implementation.
• Provided the level-3 support by recreating and debugging the production issues.
• Ensured high availability of trading service and minimizing downtime and customer impact.
• Creating automations on various areas to increase the productivity.
• Resolve batch failures to ensure the batch cycle is not delayed.
• Identified and implemented permanent fixes for the issues identified in the batch.
• Created several new JCLs to run the reports for the users and send to them automatically as per the period requested by the users there by reducing manual efforts.
• Created and modified existing programs to generate tokens that would mask the banking details of the client.
• Extracting and comparing data for data analysis and monitoring the performance of the applications.
• Provided quick resolutions for the high severity incidents so that the service is restored and business is not impacted.
• Successful delivery of various development, maintenance and production support projects in Confidential .
• Annuity, CC communication, Unisure implementations.