We provide IT Staff Augmentation Services!

Hadoop/java Developer Resume

5.00/5 (Submit Your Rating)

SUMMARY

  • 2+ years of professional experience in software development industry.
  • 2+ years of hands on experience in Hadoop Framework and its ecosystem like Map Reduce Programming, Spark, Hive, Impala, Pig, Sqoop, HBase, Oozie, Scala, and Python.
  • Experience with Cloudera and Horton works distribution of Hadoop.
  • Experience in strong and analyzing data using HiveQL, Pig Latin and custom Map Reduce programs in Java.
  • Experience in design, development, and maintenance and support of Big Data Analytics usingHadoopEcosystem components like HDFS, Hive, Pig, HBase, Sqoop, Flume, MapReduce, Kafka.
  • Extending Hive and Pig core functionality by writing custom UDFs.
  • Good knowledge in using job scheduling and monitoring tools like Oozie and ZooKeeper.
  • Good Knowledge in creating event processing data pipelines using Kafka and Spark Streaming.
  • Hands on NoSQL database experience with HBase.
  • Good knowledge in Linux Shell scripting or Shell commands.
  • Experienced in installation, configuration, supporting and monitoring Hadoop clusters using Apache andCloudera, Hortonworks and MapR distributions.
  • Good work experience on JAVA, JDBC, Servlets and JSP.
  • Proficient in Java, J2ee, JDBC, Collections, Servlets, JSP, Struts, Spring, Hibernate, JSON, XML, REST, SOAP Web services, Groovy, Grails and Eclipse.
  • Participated in an Agile SDLC to deliver new cloud platform services and components.

TECHNICAL SKILLS

Big Data Technologies: Hadoop, MapReduce, HDFS, Hive, Pig, Sqoop, Apache Spark,Scala, Yarn, and Apache Kafka.

Languages: C, C++, Java, SQL, PL/SQL, and UML.

Java Tools & Web Technologies: J2EE, Servlets, JSP, JSTL, CSS, HTML, XHTML, CSS, XML.

Frameworks: Struts, Spring, MVC.

Web Servers: Web Logic, Web Sphere, Apache Tomcat.

Scripting Languages: Shell Scripting, Java script.

Database: Oracle 8i/9i/10g/11g, SQL Server 7.0 /2000, DB2.

Methodologies: Agile, UML, Waterfall, and SDLC.

Version Control System: SVN.

PROFESSIONAL EXPERIENCE

Confidential

Hadoop/Java Developer

Responsibilities:

  • Gathered and analyzed the requirements and categorized them into user requirement specifications and functional requirement specifications leading to design and development of use cases.
  • Involved in full SDLC for developing of entire applications using Agile methodology.
  • Designed and implemented the user interface using HTML, CSS, JavaScript and SQL Server.
  • Involved in the UI development, including layout and front - end coding per the requirements of the client by using JavaScript and Ext JS.
  • Involved in initiating and successfully completing Proof of Concept on SQOOP for Pre-Processing, Increased Reliability and Ease of Scalability over traditional Oracle database.
  • Worked with systems engineering team to plan and deploy newHadoopenvironments and expand existingHadoopclusters.
  • End-to-end performance tuning of Hadoop clusters and Hadoop MapReduce routines against very large data sets.
  • Developed the Pig UDF'S to pre-process the data for analysis.
  • Involved in loading data from LINUX/UNIX file system to HDFS.
  • Proficient in using Cloudera Manager, an end to end tool to manage Hadoop operations.
  • Developed MapReduce jobs for Log Analysis, Recommendation and Analytics.
  • Wrote MapReduce jobs to generate reports for the number of activities created on a day, during a dumped from the multiple sources and the output was written back to HDFS.
  • Involved in a live production of Cloudera distribution for Hadoop cluster consisting of 20 nodes
  • Developed MapReduce jobs using java for cleansing, modelling, and analyzing the data.
  • Created Hive tables and loaded data from relational databases like MySQL and Sql Server using Sqoop.
  • Used MapReduce and Sqoop to load, aggregate, store and analyze web log data from different web servers.
  • Upgraded the Cloudera Hadoop ecosystems in the cluster usingClouderadistribution packages.
  • Cluster co-ordination services through Zookeeper. Debug and solve the major issues withClouderamanager by interacting with theClouderateam fromCloudera.
  • Installed Ecosystem Products throughClouderamanager along with other supporting operating systems and hardware in CentOS/RHEL.
  • Developed HadoopShell commands, MapReduce Programs, verifying managing and reviewingHadoopLog files.
  • Helping the developers in code deployments from DEV to UAT and then PRODUCTION throughout the process.
  • Experience in optimization of MapReduce algorithm using combiners and partitions to deliver the best results and worked on Application performance optimization.

Environment: Hadoop, Cloudera Manager, MapReduce, HDFS, Hive, Hbase, Java, eclipse, Sqoop, Pig.

We'd love your feedback!