We provide IT Staff Augmentation Services!

 big Data/hadoop Developer Resume

Cincinnati, OH

SUMMARY:

  • Over 7 years of experience in handling large development projects, Analysis, Design, Development.
  • Highly experienced and skilled Agile Developer with strong record of excellent teamwork and have exposure to all phases of Software Development Life Cycle including feasibility study, requirement Analysis, Design, Development and Implementation of Java, Python Projects.
  • Good Experience in installing, configuring Hadoop and its related components.
  • Have hands on experience in writing MapReduce jobs in Java, Pig and Data Processing using Spark Scala (used RDD and Dataframe)
  • Experience in Apache NiFi tool to automate data flow between systems.
  • Proven strength in Web Based Application using Node JS, spring, Play Framework.
  • Extensive experience in Sql and NoSql Database like Oracle, Mysql and MongoDB, CouchBase, Redis, Elastic Search, HDFS, Hive
  • Strong initiative, teamwork, responsible, communication, analytical and problem solving skills.

TECHNICAL SKILLS:

Programming Languages: Java, C++, Pig Latin

Scripting Languages: Python, Shell

Framework: Hadoop, Spark, Node JS, Play, Spring (Spring Boot, Spring MVC, Spring JPA)

Workflow Scheduler: Oozie

Web Server: Nginx, Apache Tomcat

Operating Systems: Linux and Windows Family.

SQL Database: Oracle 10g, MySQL

NoSQL Database: MongoDB, CouchBase, Redis, Elastic Search, HDFS, Hive

Graph DB: Neo4J

Message Broker: RabbitMQ

Markup Language: HTML, XML.

Deployment Tools: Hudson, Jenkins, Team city

Version Control System: CVS, Mercurial, GIT

Build Tool: Maven, SBT

Data Transfer Tool: Sqoop, Flume, Apache Nifi

Product Management Tool: Jira, Rally

PROFESSIONAL EXPERIENCE:

Confidential, Cincinnati, OH

Big Data/Hadoop Developer

Technology: Hadoop, Apache NiFi, Oozie, Spark, Scala, Hive,Python, Java, Spring Framework, Shell Scripting, RabbitMQ,Rally

Responsibilities:

  • Involved in the designing phase of Confidential and Data Transformation Service, and contributed solutions for automation.
  • Developed and Automated Confidential using Apache NiFi to ingest data between systems and notify other Services about the ingestion and
  • Used RabbitMQ for messaging service to get down streams notified about the data ingested.
  • Pre - Processed the data ingested using Apache Pig to eliminate the bad records as per business requirements with the help of filter functions, User Defined Functions.
  • Developed and Automated Data Transformation Service using Spring Boot which triggers workflow Scheduler Oozie to transform data using Spark Scala.
  • Worked on Apache Spark component in Scala to do transformations.
  • Worked on Oozie workflows for automation of Pig, Spark jobs and developed an Oozie Java Wrapper called from Pivotal Cloud Foundry (PCF).
  • Configured Team city for Continuous Integration/Continuous Deployment (CI/CD).
  • Responsible for writing validation script using Shell scripting and Python.
  • Used GitHub for version control repository.

Confidential

Senior Lead Developer

Technology: Java, maven, AWS SDK, Couchbase, Mysql, Amazon RDS, Life Ray, Play Framework, Spring Framework (Spring Boot, Spring MVC, Spring JPA), Hadoop, Hive, Sqoop

Responsibilities:
  • Developed MapReduce program in Hadoop which perform data pruning and data deduplication of the external data and bank data.
  • Developed Global bank portal and individual portal for each bank Using Liferay.
  • Created Rest API using Play framework. These Rest API connects the portal and different process running in the Server (eg: Server set up process, map reduce process).
  • Migrated Play Framework RestAPI into Spring framework for scalability, Using Spring Boot for standalone, Spring MVC, Spring Jpa for database communication.
  • Responsible for writing ElasticSearch query for geo hash, fuzzy logic and auto complete. And Couchbase query for index search.
  • Responsible for performing unit test and Load test using Apache Jmeter
  • Experience in using Version control tool Git for code check-ins and code merge.
  • Responsible for Setting up production environment and installing all necessary software.

Confidential

Software engineer

Technology: Python, C++, Oracle and Linux

Responsibilities:

  • Involved analysis of requirements & development, testing
  • Involved in the creation of decision sets based on the different banker’s requirement
  • Creating new attributes using Python as different rules.
  • Unit testing the programs

Hire Now