SUMMARY

• 8 years of experience in application programming - analysis, design, development, testing and maintenance
• Over 2.7 years of experience in Big Data (Apache Hadoop, HDFS, Pig, Hive, Impala, Oozie, Sqoop, SPARK).
• Having good experience in Hadoop framework and related technologies like HDFS, MapReduce, Pig, Hive,, Sqoop, Oozie, Apache Spark, Scala
• Having good experience in Spark using Java and Scala API, HDFS, Pig, Hive, Oozie scheduler and Sqoop.
• Having good experience in Core JAVA programming.
• Having good experience in Unix Shell scripting. Experience in writing wrapper script for End to End automation
• Experience in writing Shell scripts and HQL files to perform Data Quality checks .
• Expertise in Hive Query Language, Oozie Scheduler, Sqoop, HDFS and Impala.
• Hands of experience on data extraction, transformation and load in Hive.
• Experience in the successful implementation of ETL solution between an OLTP and OLAP database in support of Decision Support Systems with expertise in all phases of SDLC.
• Excellent knowledge and experience on Hadoop Architecture and ecosystems such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node, YARN and Map Reduce programming paradigm.
• Expertise in loading the data from the different Data sources like (Teradata and DB2) into HDFS using Sqoop and load into partitioned Hive tables.
• Experience in code migration from Netezza to Hadoop using hive and Spark.
• Experience in code migration from Talend to Hadoop using Sqoop, hive, oozie and pig.
• Around 5 years of experience as Netezza, Oracle PL/SQL Developer.
• Good Experience in implementing the Business DQ Rules to Netezza Queries and Report generation through shell script for CCAR.
• Extensively designed and executed SQL queries in order to ensure data integrity and consistency at the backend
• Experience in writing UDFs for Hive in Java.
• Extensive experienced in working with structured data using Hive QL, join operations, writing custom UDF's and experienced in optimizing Hive Queries.
• Experienced in importing and exporting data using Sqoop from HDFS to Relational Database and Strong experience in analyzing large amounts of data sets writing Pig scripts and Hive queries.
• Worked on custom Pig Loaders and Storage classes to work with a variety of data formats such as JSON, Compressed CSV, etc
• Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems (RDBMS), Oracle, Teradata, MySQL and vice versa.
• Experienced in working with UNIX shell scripts scripting technologies.
• Experience in importing and exporting data using NZLOAD and SQL LOADER
• Ability to develop Oozie workflows, scheduling by using different coordinating applications like Autosys.
• Experience in Agile and Waterfall model, writing Technical Design document, Development and Testing
• Good exposure to software configuration management and continuous integration tools in the process of code review, build automation and deployment. SVN, Jira, Version 1
• Strong Knowledge in PLSQL procedure, packages and functions
• Strong knowledge in Netezza procedure and functions.

TECHNICAL SKILLS

Operating Systems: Windows, Unix/Linux

Hadoop/Big Data: Hive, HDFS, Oozie, Pig, Sqoop, Spark SQL

Java Technologies: Core JAVA

DBMS/Databases: Oracle, Netezza, Teradata, MySQL, SQL Server

Programming: UNIX Shell Scripting, Scala, Python

Methodologies: Agile (Scrum) and Waterfall

ETL TOOL: Talend, Netezza Performance Tool

Version Control Tools: SVN, Version 1, Clear Case, Share point and JIRA

PROFESSIONAL EXPERIENCE

Confidential - Jacksonville, Florida

Hadoop and Core Java Developer

Responsibilities:

• Data architecture - Data classification, formats, transformations, sources, targets and persistence mechanism
• Hands on Experience in Core Java.
• Application architecture - Data flow between various components, functional dependencies and middle ware layers.
• Data sourcing through Hadoop - developed code for the same which includes (Capturing the metadata, DQ checks and Main Sourcing). This involves PIG scripting and we use HIVE database to store the data in staging layer for processing before loading into final target table.
• Data Transformations through Hadoop- Migrated the Netezza code into Hadoop using Spark. This involves Hql, Shell Scripting, OOZIE workflows and Hive database to store the data into the final target table
• Data reporting using Hadoop - Have created HIVE managed and external tables and views as part of reporting by sqooping the data from Netezza to hdfs cluster in the form of AVRO file format
• Developed a wrapper script as part of sourcing through Hadoop which takes care of the entire flow.
• Have created xml files to integrate with OOZIE workflows and execute Java, pig and hive actions based on decision nodes.
• Develop shell scripts to perform value added processing.
• Migrated the code from Talend code to Hadoop ETL sourcing.
• Migrated the code from Netezza to Hadoop using Spark, hive, oozie and Sqoop
• Implemented the DQ Rules to Netezza Queries and Report generation through shell script for CCAR
• Written Oozie workflows and Autosys job scheduling.

Confidential - Charlotte, NC

Hadoop and Core Java Developer

Responsibilities:

• Data architecture - Data classification, formats, transformations, sources, targets and persistence mechanism
• Hands on Experience in Core Java.
• Application architecture - Data flow between various components, functional dependencies and middle ware layers.
• Data sourcing through Hadoop - developed code for the same which includes (Capturing the metadata, DQ checks and Main Sourcing). This involves PIG scripting and we use HIVE database to store the data in staging layer for processing before loading into final target table.
• Data Transformations through Hadoop- Migrated the Netezza code into Hadoop using Spark. This involves Hql, Shell Scripting, OOZIE workflows and Hive database to store the data into the final target table
• Data reporting using Hadoop - Have created HIVE managed and external tables and views as part of reporting by sqooping the data from Netezza to hdfs cluster in the form of AVRO file format
• Developed a wrapper script as part of sourcing through Hadoop which takes care of the entire flow.
• Have created xml files to integrate with OOZIE workflows and execute Java, pig and hive actions based on decision nodes.
• Develop shell scripts to perform value added processing.
• Migrated the code from Talend code to Hadoop ETL sourcing.
• Migrated the code from Netezza to Hadoop using Spark, hive, oozie and Sqoop
• Implemented the DQ Rules to Netezza Queries and Report generation through shell script for CCAR
• Written Oozie workflows and Autosys job scheduling.

Confidential

Oracle PLSQL Developer

Environment: ORALCE PLSQL - Procedure, Functions, Packages, SVN, Autosys.

Responsibilities:

• Developed Packages, Procedure and functions for access control system applications.
• Involved in loading and transforming from relational databases into Oracle using SQL LOADER.
• Created constraints and giving access to any new user added to application through backend tables.
• Coded the business requirements and technical requirements with PLSQL, SQL.
• Involved in query Performance tuning.
• Developed stored procedures, Packages and Views, dynamic Sql and Debugging the code for any issues
• Involved in Code deployment to Test lanes.
• Prepared Test case as per business requirement and Supported Testing team during development phases.
• Supported testing team during development phase.

Confidential

Netezza and Oracle Developer

Environment: Oracle PLSQL, Netezza, Autosys, JIRA, Share Point

Responsibilities:

• Developed Packages, Procedure and functions for access control system applications.
• Involved in loading and transforming from relational databases into Oracle using SQL Loader.
• Involved in loading and transforming from relational databases into Netezza using NZLOAD.
• Created constraints and giving access to any new user added to application through backend tables.
• Coded the business requirements and technical requirements with PLSQL, SQL.
• Involved in query Performance tuning.
• Developed stored procedures, Packages and Views, dynamic Sql and Debugging the code for any issues
• Involved in Code deployment to Test lanes.
• Prepared Test case as per business requirement and Supported Testing team during development phases.
• Supported testing team during development phase.
• Developed Procedure for Adhoc Request