Hadoop Developer Resume

OBJECTIVE

To achieve excellence in working as dynamic professional offering solutions to business using the best available where my analytical ability and analyzing quest are used maximum for growth of the organization and to grow with the organization. Seeing a challenging position in well - established company that offers professional growth and ample opportunity to learn and enrich my competencies in my profession.

SUMMARY

Deep expertise in Hadoop Development i.e. Map Reduce (MR1, YARN), HDFS, PIG, Hive, Sqoop, Oozie, SQL
Successfully delivered couple of initiatives (Implementation & development) on Big Data Analytics and large data processing using Hadoop ecosystem.
Created deployment plan script for moving application from Development environment to production in Hadoop using TeamCity and TCM.
Created Test plans for validating output of applications in Hadoop.
Created Sqoop Jobs to import data from SQL Server Database to hive tables.
Published the guidelines for various Compression Techniques and File Formats used in Hadoop Ecosystem.
Setup role based access on Hive table using Apache Sentry.
Setup kerberosed cluster and given ACL permission to proids of respective applications.
Proficient in development methodologies such as Waterfall.
Good Knowledge of Retail Domain.
Experience working on high availability and high traffic applications.
Expertise to deep dive into technical holes and coming out with solutions.
Proven ability to learn quickly and apply new technologies. Innovative and enthusiastic.
Worked with end users to formulate and document business requirements.

TECHNICAL SKILLS

Big Data Technologies: Apache Hadoop (MRv1, MRv2), HDFS, Hive, Pig, Sqoop, Spark and Oozie .

Hadoop Distribution: Apache Hadoop (Open source), Hortonworks (HDP-2), Cloudera Hadoop Developer (CDH-5).

Programming Languages: Hive, Pig, Oozie, Sqoop, Shell Scripting and Core Java

Web Technologies: SQL, HTML and CSS.

Operating System: Windows, Linux & Unix.

Server-Side Frameworks: Bounce (client specific framework).

IDEs: Eclipse and IBM Web Sphere.

Build Tools: Maven and Ant

Database: Oracle 10g, Mongo DB (No SQL Database).

Static Code Analysis: PMD

Configuration Tool: SVN, GitHub and CVS.

Web Servers /App Servers: Apache Tomcat 6.0/7.0

PROFESSIONAL EXPERIENCE

Confidential

Hadoop Developer

Responsibilities:

Worked on a live 63 nodes Hadoop cluster running Hortonworks Distribution.
Converted Abnitio s ETL jobs to a sequence of Pig scripts .
Created Design Documents for the requirements.
Developed Hive (version 0.13) scripts for end user / analyst requirements to perform ad hoc analysis
Created External/ Managed Hive tables with optimized partitioning and bucketing.
Solved performance issues in Hive with understanding of Joins, Group and aggregation and how does it translate to Map Reduce jobs.
Experience in using best and optimized techniques for Data Definition of hive tables.
Developed Shell Scripts for scheduling and orchestrating the pig and hive scripts
Created Spark - SQL (Hive on Spark) Jobs to process tables in Hive and Tuned up the query performance
Written and executed test plans for validating the results of Hadoop jobs.
Written deployment plans for moving code from development cluster to production cluster.

Technologies Used: Hive, Pig, Sqoop and Unix Shell Script.

Confidential

Support Executive

Responsibilities:

Resolving Assigned application related issues (tickets) within SLA, occurring with pharmacy users while providing services to their customers
Working on requirement gathering and putting down into the project plan
Analysis of defects, found in application code in deployed production release.
Preparing SQL queries, cursors to update/fetch the production data per user request.
Smooth application and DB deployment of new releases on client servers time to time.
Application logs monitoring to confirm whether application is running smoothly. In case abnormal logs/issue found, inform the higher management and find the root cause.
Attending Client meetings regarding inspection of system health check, ticket analysis on daily basis, DB/Server maintenance etc.

Technologies: Core Java, SQL, PL-SQL Developer, Oracle 10g and 11g, MS Office 2003 and 2007, CVS, WinScp, FileZilla, Share point and Putty