Hadoop/java Developer Resume
5.00/5 (Submit Your Rating)
SUMMARY
- 2+ years of professional experience in software development industry.
- 2+ years of hands on experience in Hadoop Framework and its ecosystem like Map Reduce Programming, Spark, Hive, Impala, Pig, Sqoop, HBase, Oozie, Scala, and Python.
- Experience with Cloudera and Horton works distribution of Hadoop.
- Experience in strong and analyzing data using HiveQL, Pig Latin and custom Map Reduce programs in Java.
- Experience in design, development, and maintenance and support of Big Data Analytics usingHadoopEcosystem components like HDFS, Hive, Pig, HBase, Sqoop, Flume, MapReduce, Kafka.
- Extending Hive and Pig core functionality by writing custom UDFs.
- Good knowledge in using job scheduling and monitoring tools like Oozie and ZooKeeper.
- Good Knowledge in creating event processing data pipelines using Kafka and Spark Streaming.
- Hands on NoSQL database experience with HBase.
- Good knowledge in Linux Shell scripting or Shell commands.
- Experienced in installation, configuration, supporting and monitoring Hadoop clusters using Apache andCloudera, Hortonworks and MapR distributions.
- Good work experience on JAVA, JDBC, Servlets and JSP.
- Proficient in Java, J2ee, JDBC, Collections, Servlets, JSP, Struts, Spring, Hibernate, JSON, XML, REST, SOAP Web services, Groovy, Grails and Eclipse.
- Participated in an Agile SDLC to deliver new cloud platform services and components.
TECHNICAL SKILLS
Big Data Technologies: Hadoop, MapReduce, HDFS, Hive, Pig, Sqoop, Apache Spark,Scala, Yarn, and Apache Kafka.
Languages: C, C++, Java, SQL, PL/SQL, and UML.
Java Tools & Web Technologies: J2EE, Servlets, JSP, JSTL, CSS, HTML, XHTML, CSS, XML.
Frameworks: Struts, Spring, MVC.
Web Servers: Web Logic, Web Sphere, Apache Tomcat.
Scripting Languages: Shell Scripting, Java script.
Database: Oracle 8i/9i/10g/11g, SQL Server 7.0 /2000, DB2.
Methodologies: Agile, UML, Waterfall, and SDLC.
Version Control System: SVN.
PROFESSIONAL EXPERIENCE
Confidential
Hadoop/Java Developer
Responsibilities:
- Gathered and analyzed the requirements and categorized them into user requirement specifications and functional requirement specifications leading to design and development of use cases.
- Involved in full SDLC for developing of entire applications using Agile methodology.
- Designed and implemented the user interface using HTML, CSS, JavaScript and SQL Server.
- Involved in the UI development, including layout and front - end coding per the requirements of the client by using JavaScript and Ext JS.
- Involved in initiating and successfully completing Proof of Concept on SQOOP for Pre-Processing, Increased Reliability and Ease of Scalability over traditional Oracle database.
- Worked with systems engineering team to plan and deploy newHadoopenvironments and expand existingHadoopclusters.
- End-to-end performance tuning of Hadoop clusters and Hadoop MapReduce routines against very large data sets.
- Developed the Pig UDF'S to pre-process the data for analysis.
- Involved in loading data from LINUX/UNIX file system to HDFS.
- Proficient in using Cloudera Manager, an end to end tool to manage Hadoop operations.
- Developed MapReduce jobs for Log Analysis, Recommendation and Analytics.
- Wrote MapReduce jobs to generate reports for the number of activities created on a day, during a dumped from the multiple sources and the output was written back to HDFS.
- Involved in a live production of Cloudera distribution for Hadoop cluster consisting of 20 nodes
- Developed MapReduce jobs using java for cleansing, modelling, and analyzing the data.
- Created Hive tables and loaded data from relational databases like MySQL and Sql Server using Sqoop.
- Used MapReduce and Sqoop to load, aggregate, store and analyze web log data from different web servers.
- Upgraded the Cloudera Hadoop ecosystems in the cluster usingClouderadistribution packages.
- Cluster co-ordination services through Zookeeper. Debug and solve the major issues withClouderamanager by interacting with theClouderateam fromCloudera.
- Installed Ecosystem Products throughClouderamanager along with other supporting operating systems and hardware in CentOS/RHEL.
- Developed HadoopShell commands, MapReduce Programs, verifying managing and reviewingHadoopLog files.
- Helping the developers in code deployments from DEV to UAT and then PRODUCTION throughout the process.
- Experience in optimization of MapReduce algorithm using combiners and partitions to deliver the best results and worked on Application performance optimization.
Environment: Hadoop, Cloudera Manager, MapReduce, HDFS, Hive, Hbase, Java, eclipse, Sqoop, Pig.
