Hadoop Developer Resume
Atlanta, GA
SUMMARY
- 7+ years of experience in IT industry this includes 2+ years of hands on experience in Big Data Technologies and 5 years of experience in Java.
- Worked with Cloudera and Hortonworks distributions on Hadoop Framework.
- Excellent knowledge on Hadoop Ecosystem Architecture and core components of Hadoop cluster like Masters and Slaves of HDFS and Map Reduce.
- Experience in analyzing data using HiveQL, Pig Latin, HBase and MapReduce programs.
- Experience in extending Hive and Pig core functionality by writing UDF's.
- Experience in migrating the data using Sqoop from HDFS to Relational Database System and vice - versa.
- Knowledge of administrative tasks such as installing Hadoop and its ecosystem components such as Hive and Pig.
- Excellent knowledge of NoSQL databases like HBase, Cassandra and MongoDB.
- Knowledge of installing, configuring, debugging and troubleshooting Hadoop clusters.
- Strong expertise in Java, object-oriented design and analysis, programming styles and design patterns.
- Experience in deploying applications in Web/Application Servers like Tomcat, WebLogic and Oracle Application Servers.
- Development and maintenance of web applications and enterprise applications using Java, J2EE, JSP, Servlets, Hibernate, JDBC, HTML, PHP, XML and Java Script.
- Experience in Mobile App Development in iOS using XCODE5 Tool.
- Strong knowledge of Software Development Life Cycle and expertise in detailed design documentation.
- Extensive experience with Waterfall and Agile Scrum Methodologies.
- Excellent Analytical, Logical, Debugging, Programming, Communication, Organizational and Time management skills.
- Quick learner and excellent team player having ability to meet tight deadlines and work under pressure.
- ORACLE Certified Java Programmer (OCJP).
TECHNICAL SKILLS
Hadoop Ecosystem: Apache Hadoop (HDFS/MapReduce), Pig, Hive, HBase, Sqoop, Flume, Oozie, Hue, HiveQL, Pig Latin, Impala, Scala, Spark, Amazon EC2.
Technologies: Core Java, J2EE, SQL, Unix Shell, Pig, HiveQL, C++, C, Scala, JavaScript, Hibernate, JDBC, JSP, XML, PHP, HTML, JavaScript, SOAP, Servlets, JSF, Maven, SQL/PLSQL, ANT Build Script, Sybase 12.5.4, AJAX, JSF.
Frameworks: Struts MVC, Spring MVC 2.5.6 and log4j.
IDE's: Eclipse, Xcode5, Net Beans, IBM-RAD 7.5, PythonAnyWhere, Codio
Application Servers: Apache Tomcat and Oracle Web based Server
Operating Systems: Windows 95/98/2000/XP/Vista/7, Unix
Databases: Oracle 9i/10g/11g, MySQL, DB2, MS-SQL Server, MS-Access.
NoSQL Databases: MongoDB, HBase, Cassandra
PROFESSIONAL EXPERIENCE
Confidential, Atlanta, GA
Hadoop Developer
Responsibilities:
- Responsible for building scalable distributed data solutions using Hadoop.
- Installed and configured Hive, Pig, Sqoop, Flume and Oozie on the Hadoop cluster.
- Setup and benchmarked Hadoop/HBase clusters for internal use.
- Developed Simple to complex MapReduce Jobs using Java, Hive and Pig scripts.
- Optimized Map/Reduce Jobs to use HDFS efficiently by using various compression mechanisms.
- Handled importing of data from various data sources, performed transformations using Hive, MapReduce, loaded data into HDFS and Extracted the data from MySQL into HDFS using Sqoop.
- Analyzed the data by performing Hive queries and running Pig scripts to study customer behavior.
- Used UDF’s to implement time conversion functions, encryptions logics in Pig and Hive.
- Implemented business logic by writing UDF's in Java and used various UDFs from Piggybanks and other sources.
- Continuous monitoring and managing the Hadoop cluster using Cloudera Manager.
- Worked with application teams to install operating system, Hadoop updates, patches, version upgrades as required.
- Installed Oozie workflow engine to run multiple Hive and Pig jobs.
- Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team.
Environment: CDH 5.x Distribution, MapReduce, HDFS, Hive, Pig, Java, SQL, Cloudera Manager, Sqoop, Flume, Oozie, Java, Eclipse.
Confidential, NY
Hadoop Developer
Responsibilities:
- Involved in moving all log files generated from various sources to HDFS for further processing. Responsible to manage data coming from different sources.
- Handled 2 TB of data volume and implemented the same in Production.
- Developed and Supported Map Reduce Programs those are running on the cluster.
- Installed and configured Pig and also written PigLatin scripts.
- Developed UDFs for Pig Data Analysis.
- Involved in installing Hadoop developer machine and Ecosystem components.
- Performance Optimization of Hadoop cluster based on job requirements.
- Installed and configured Hive and also written Hive UDF's. Created Hive tables and working on them using Hive QL.
- Wrote Hive queries for data analysis to meet the business requirements.
- Developed Scripts and Batch Job to schedule various Hadoop Program.
- Utilized fully Agile Scrum Methodology, Involved in distributed Scrum and also participate as Scrum master.
- Used MRUnit & JUnit for Hadoop/Java unit testing.
- Analyzed the data by performing Hive queries and running Pig scripts to know user behavior.
- Used GIT for version control and created automated build scripts. Use Maven for continuous Integration.
- Installed Oozie workflow engine to run multiple Hive and Pig jobs.
Environment: Hadoop 2.0, MapReduce, HDFS, Hive 0.9, Pig 0.10,Sqoop 1.4, Oozie 3.2.0, Cloudera CDH3/4 Distribution, MRUnit, JUnit, Eclipse, Maven, GIT, Jenkins
Confidential, Lynchburg, VA
Java Developer
Responsibilities:
- Developed web components using JSP, Servlets and JDBC
- Designed tables and indexes
- Designed, Implemented, Tested and Deployed Enterprise Java Beans both Session and Entity using WebLogic as Application Server
- Developed stored procedures, packages and database triggers to enforce data integrity. Performed data analysis and created crystal reports for user requirements
- Provided quick turn around and resolving issues within the SLA.
- Implemented the presentation layer with HTML, XHTML and JavaScript
- Used EJB's to develop business logic and coded reusable components in Java Beans
- Development of database interaction code to JDBC API making extensive use of SQL
- Query Statements and advanced Prepared Statements.
- Used connection pooling for best optimization using JDBC interface
- Used EJB entity and session beans to implement business logic and session handling and transactions.
- Developed user-interface using JSP, Servlets, and JavaScript
- Wrote complex SQL queries and stored procedures
- Actively involved in the system testing
Environment: J2EE, JSP, SOAP, Java Script, Servlet, JDBC, SQL, UNIX and JUnit.
Confidential
Java Developer
Responsibilities:
- Involved in Requirements analysis, design, and development and testing.
- Involved in setting up the different roles & maintained authentication to the application.
- Designed, deployed and tested Multi-tier application using the Java technologies.
- Involved in front end development using JSP, HTML & CSS.
- Implemented the Application using Servlets
- Deployed the application on Oracle Web logic server
- Implemented Multithreading concepts in java classes to avoid deadlocking.
- Used MySQL database to store data and execute SQL queries on the backend.
- Prepared and Maintained test environment.
- Tested the application before going live to production.
- Documented and communicated test result to the team lead on daily basis.
- Involved in weekly meeting with team leads and manager to discuss the issues and status of the projects.
Environment: Java, JSP, JDBC, Multi-Threading, HTML, Oracle Web logic server, Eclipse, MySQL, Junit
Confidential
Java Developer
Responsibilities:
- Involved in requirements gathering for the application development.
- Designed document specifications for J2EE application.
- Involved in the design and development phase of the application.
- Implemented the business logic using Session Beans in EJB.
- Developed User Interface and end user screens using Java Swing, JSP and Servlet.
- Implemented web services using SOAP.
- Responsible for periodic generation of reports.
- Performed Unit testing of the application using JUnit.
- Carried out necessary validations of each developed screen by writing Triggers, Procedures and Functions available along with the objects, events and methods.
- Designed and developed menus in order to navigate from once screen to another screen.
- Used Hibernate framework with JDBC drivers to connect to the database and manipulate the data.
- Use of Joins, Triggers, Stored Procedures and Functions in order to interact with backend database using SQL.
- Review the changes on the weekly basis and ensure the deliverables to be quality.
- Actively documented the common problems during testing and developing phase and also in production phase.
- Coordinated with other Development teams, System managers and web master and developed good working environment
Environment: J2EE, EJB, JSP, SOAP, Java Script, Servlet, JDBC, SQL, UNIX and JUnit.