Hadoop Developer Resume
Atlanta, GA
SUMMARY:
- 8+ Years of extensive experience which includes Big Data and Big Data analytics, Health Insurance, Energy and Trading, Content Management and Telecom domains.
- Experienced in installing, configuring, and administrating Hadoop cluster of major Hadoop distributions.
- Have hands on experience in writing MapReduce jobs in Java, Pig and Python.
- Hands on experience in installing, configuring and using ecosystem components like Hadoop MapReduce, HDFS, Hbase, ZooKeeper, Oozie, Hive, Cassandra, Sqoop, Pig and Flume.
- Hands - on experience with Hadoop applications (such as administration, configuration management, debugging, and performance tuning).
- Worked on NoSQL databases including HBase, Cassandra and MongoDB .
- Experience in creating web-based applications using ActiveX Controls, JSP and Servlets.
- Excellent analytical, problem solving, communication and interpersonal skills with ability to interact with individuals and can work as part of a team as well as independently.
- In-depth understanding of Data Structure and Algorithms.
- Experience in implementation of Open-Source frameworks like Struts, spring, Hibernate, Web Services etc.
- Experience in deploying applications in heterogeneous Application Servers TOMCAT, Web Logic and Oracle application Server.
- First point of contact for any R&D activities and critical problems.
- Implemented Unit Testing using Junit testing during the projects.
- Ability to perform at a high level, meet deadlines, adaptable to ever changing priorities.
- Excellent communication skills, interpersonal skills, problem solving skills a very good team player along with a can do attitude and ability to effectively communicate with all levels of the organization such as technical, management and customers.
- Extensive experience in designing analytical / OLAP and transactional / OLTP databases.
TECHNICAL SKILLS:
Big Data Ecosystem: Hadoop, MapReduce, HDFS, HBase, Zookeeper, Hive, Pig, Sqoop, Cassandra, Oozie, Flume, Chukwa, Storm, Solr/Lucene, Mahout.
Java Technologies: Java 5/6, JAXP, AJAX, I18N, JFC Swing
Web Technologies: JSP 2.1 Servlets 2.3, JDBC 2.0,JNDI, XML, JAXP, Java Beans
Methodologies: Agile, UML, Design Patterns
Frame works: Ajax, Struts 2.0, JUnit, log4j 1.2, MOCK OBJECTS, Hibernate
Data bases: Oracle 10g, DB2,MySQL
Application servers: Apache Tomcat 5.x 6.0, Jboss 4.0, weblogic 8/10gr3
Tools: and Libraries: HTML, Java Script, XML, DTD, Schemas, XSL, XSLT, XPath, DOM, XQuery and Junit
Operating Systems: Windows XP/ 2000/2003/7/8, Linux and Unix
PROFESSIONAL EXPERIENCE:
Confidential, Atlanta, GA
Hadoop Developer
Responsibilities:
- Responsible for building scalable distributed data solutions using Hadoop.
- Importing and exporting data into HDFS using Sqoop.
- Handled importing of data from various data sources, performed transformations using Hive, MapReduce, loaded data into HDFS and extracted data from MongoDB into HDFS using Sqoop.
- Worked extensively with Sqoop for importing metadata from Oracle.
- Configured Sqoop and developed scripts to extract data from MySQL into HDFS.
- Developed multiple MapReduce jobs in java for data cleaning and accessing.
- Extensive experience in writingPig (version 0.11.1)scripts to transform raw datafrom several data sources into forming baseline data.
- Installed and configured Hive (version 0.10) and also written Hive UDFs.
- CreatedHive tables, loading with data and writing hive queries which will run internally in map reduce way.
- Very good understanding ofPartitions, Bucketingconcepts in Hive and designed both Managed and Externaltables in Hive to optimize performance.
- Solved performance issuesin Hive and Pig scripts with understanding of Joins, Group and aggregation and how does it translate to MapReduce jobs.
- Created HBase tables to store various data formats of PII data coming from different portfolios.
- Installed Oozie workflow engine to run multiple Hive and Pig jobs.
- Jobs management using Fair scheduler.
- Worked with the admin team in designing and upgrading CDH 4 to CDH 5.
- Responsible for cluster maintenance, adding and removing cluster nodes, cluster monitoring and troubleshooting, managing and reviewing data backups and Hadoop log files.
- Continuous monitoring and managing the Hadoop cluster through Cloudera Manager
- Trained and mentored analyst and test team on Hadoop framework, HDFS, Map Reduce concepts, Hadoop Ecosystem
Environment: Apache Hadoop, MapReduce, HDFS, Hive, Oozie, Java (jdk1.6), Cloudera Manager, Pig, Sqoop, HBase, PL/SQL, MySQL, LINUX-UBUNTU.
Confidential, Atlanta, GA
Hadoop Developer
Responsibilities:
- Importing and exporting data into HDFS and Hive using Sqoop.
- Load and transform large sets of structured, semi structured and unstructured data.
- Developed multiple MapReduce jobs in java for data cleaning and accessing.
- Log management applications were developed on Hadoop Cluster.
- Log collector, namely Flume was used to ingest log data to HDFS.
- PIG scripts and MapReduce jobs were developed to compute descriptive analytics in Logs.
- Experienced in running Hadoop streaming jobs to process terabytes of xml format data
- Responsible to manage data coming from different sources.
- Supported Map Reduce Programs those are running on the cluster
- Jobs management using Fair scheduler.
- Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map way.
- Cluster coordination services through Zoo Keeper.
- Involved in loading data from UNIX file system to HDFS.
- Installed and configured Hive and also written Hive UDFs.
Environment: Hadoop, MapReduce, HDFS, Hive, Java, data Flat files, Oracle 10g, PL/SQL, SQL*PLUS, Windows NT, UNIX Shell Scripting.
Confidential, Mountain View, CA
Java/J2EE Developer
Responsibilities:
- Responsible for understanding the scope of the project and requirement gathering.
- Developed the web tier using JSP, Struts MVC to show account details and summary.
- Mapped business objects to database using Hibernate.
- Involved in writing Spring Configuration XML files that contains declarations and other dependent objects declaration.
- Used Tomcat web server for development purpose. Involved in creation of Test Cases for JUnit Testing.
- Used Oracle as Database and used Toad for queries execution and also involved in writing SQL scripts, PL/SQL code for procedures and functions.
- Used CVS, Perforce as configuration management tool for code versioning and release.
- Developed application using Eclipse and used build and deploy tool as Maven.
- Used Log4J to print the logging, debugging, warning, info on the server console.
Environment: Java1.5, J2EE Servlet, JSP, XML, Spring 3.0, Struts 1.1, Hibernate 3.0, Design Patterns, Log4j,CVS, Maven, Eclipse, Oracle 10g.
Confidential, NY
Java/J2EE Consultant
Responsibilities:
- Involved in various phases of Software Development Life Cycle.
- Created UML Diagrams (Class and Sequence) during Design Phase using Visio.
- Validated all forms using Struts validation framework and implemented Tiles framework in the presentation layer. Configured Struts framework to implement MVC design patterns. Designed and developed GUI using JSP, HTML, DHTML and CSS.
- Deployed the entire project on Web Logic application server.
- Developed ANT script for compiling and deployment.
- Extensively used log4j for logging the log files.
- Used Subversion as the version control system.
Environment: Java/J2EE, Oracle 10g, SQL, PL/SQL, JSP, EJB, Struts, Hibernate, Web Logic 8.0, HTML, AJAX, Java, log4j, MyEclipse.
Confidential
Java Developer
Responsibilities:
- Developed Admission & Census module, which monitors a wide range of detailed information for each resident.
- Upon pre-admission or admission to your facility.
- Involved in comprehensive library of problems, goals and approaches.
- Involved in development of General Ledger module, which streamlines analysis, reporting and recording of accounting information.
- General Ledger automatically integrates with a powerful spreadsheet solution for budgeting, comparative analysis and tracking facility information for flexible reporting.
- Designed user-interface and checking validations using JavaScript.
Environment: J2EE, Java/JDK, JDBC, JSP, Servlets, JavaScript, EJB, JNDI, JavaBeans, XML, XSLT, Oracle 9i, Eclipse, HTML, SVN.
