Hadoop Developer Resume
Austin, TX
SUMMARY
- Around 7 years of extensive experience in IT including two years of Big Data Ecosystem related technologies.
- Good understanding/knowledge of installation, configuration, management and deployment of Big Data solutions and the underlying infrastructure of Hadoop Cluster.
- In depth understanding knowledge of Hadoop Architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and MapReduce concepts
- Hands - on experience on MapReduce Programming/HDFS Frame work including Hive, HBase, HBase-Hive Integration, PIG and knowledge of Sqoop.
- Set up standards and processes for Hadoop based application design and implementation.
- Experience in analyzing data using HIVEQL, PIG Latin and custom MapReduce programs in JAVA. Extending HIVE and PIG core functionality by using custom UDF’s.
- Experience in Designing, developing and implementing connectivity products that allow efficient exchange of data between our core database engine and Hadoop ecosystem.
- Knowledge of HBase.
- Experience in importing and exporting the data using Sqoop from HDFS to Relational Database systems/mainframe and vice-versa.
- Responsible for building scalable distributed data solutions using Hadoop.
- Hands on experience in application development using Java, RDBMS, and Linux shell scripting.
- Diverse experience utilizing Java tools in business, Web, and client-server environments including Java Platform, J2EE, EJB, JSP, Java Servlets, Struts, and Java database Connectivity (JDBC) technologies.
- Solid background in Object-Oriented analysis (OOAD) and design. Very good at various Design Patterns, UML and Enterprise Application Integration EAI.
TECHNICAL SKILLS
Big data/Hadoop: HDFS, Map Reduce, HIVE, PIG, HBase, Sqoop.
Java Technologies: Core Java, I8N, JFC, Swing, Beans, Log4j, Reflection.
J2EE Technologies: Servlets, JSP, JDBC
Methodologies: Agile, UML, Design Patterns (Core Java and J2EE).
Web Design Tools: HTML, DHTML, AJAX, JavaScript.
Frameworks: Struts 1.1/2.0, Spring 2.5, Hibernate 3.0.
Database: Oracle 11g/10g/9i, MySQL, DB2, MS-SQL Server.
Programming Languages: C,C++, Java, Linux shell scripts.
Web Servers: WebLogic, WebSphere, Apache Tomcat.
Network Protocols: TCP/IP, UDP, HTTP, DNS, DHCP.
PROFESSIONAL EXPERIENCE
Confidential - Austin, TX
Hadoop Developer
Responsibilities:
- Responsible for building scalable distributed data solutions using Hadoop.
- Wrote the shell scripts to monitor the health check of Hadoop daemon services and respond accordingly to any warning or failure conditions.
- Managing and scheduling Jobs on a Hadoop cluster.
- Deployed Hadoop Cluster in the following modes.
- Developed Pig Latin scripts to extract the data from the web server output files to load into HDFS.
- Wrote MapReduce jobs using Java API.
- Developed Scripts and Batch Job to schedule various Hadoop Program.
- Installed and maintained Apache Hadoop clusters for application development and Hadoop tools like Hive, Pig, HBase and Sqoop.
- Installed and configured Pig and also written PigLatin scripts.
- Developed the Pig UDF’S to pre-process the data for analysis.
- Develop Hive queries for the analysts.
- Wrote Hive queries for data analysis to meet the business requirements.
- Developed workflow in Oozie to automate the tasks of loading the data into HDFS and pre-processing with Pig.
- Implemented Fair schedulers on the Job tracker to share the resources of the Cluster for the Map Reduce jobs given by the users.
- Took part in monitoring, troubleshooting and managing Hadoop log files.
Environment: Apache Hadoop, Java (jdk1.6), DataStax, Flat files, Oracle 11g/10g, MySQL, Toad 9.6, Windows NT, UNIX, Sqoop, Hive, Oozie.
Confidential, Moline, IL
Sr. Java Developer
Responsibilities:
- Involved in the enhancements, re-designing the existing application. Actively participated in interacting and gathering the requirements from the client for the new enhancements.
- Developed the application using Struts Framework that leverages the classical Model-View-Controller (MVC) architecture.
- Actively involved in implementing Data Access Object, Session Facade and Data Transfer Object design patterns.
- Developed and implemented an Asynchronous, AJAX based rich client for improved customer experience.
- Developed few session Beans for the business logic at the middle tier level.
- Experience in using Hibernate as an ORM tool to maintain object relational persistence across front-end and Oracle Database, writing HQL queries and creating hibernate mapping (.hbm) files.
- Implemented DAO classes using Hibernate framework for the data connectivity and extraction of the data according to the business logic with Oracle database.
- Designed and developed re-usable web services and Java Utility classes to support XML, DOM, XML Schemas, XSL.
- Designed and developed modules using SAX for XML parsing and XML transformations using XSLT.
- Deployed, monitored and troubleshoot applications in JBOSS Dev environment.
- Developed JUnit test cases for all developed modules and performed Unit and Integration Testing.
- Used Log4J for message logging.
Environment: Java 1.4, JSP, JSF2.0, Struts 2.0, JBoss, Hibernate 2.0, Oracle 9i, JavaScript, AJAX, CSS, Web-services, XML, XSL/XSLT, Windows NT, JUnit, Log4J, UNIX, Rational Rose and Clear Case, clear Quest.
Confidential, Nashville, TN
Java Developer
Responsibilities:
- Responsible for the development & unit testing of Staffing Request module using Struts.
- Prepared architectural prototype to validate the architecture and baseline for the development.
- Involved in system design and development in Core Java using Collections, multithreading.
- Developed JUnit test cases and validated users input using regular expressions in JavaScript as well as in the server side.
- Used Hibernate Query Language for to store and retrieve data from the database.
- Configured the Queues and topics on the JMS of the JBOSS server.
- Used Struts tag libraries and custom tag libraries extensively while coding JSP pages.
- Interact with clients to understand their needs and propose design to the team to implement the requirement.
- Train team members to understand the system and how to use it.
- Developed PL/SQL objects like packages, procedures and functions.
- Always adhered on Quality processes during delivery on tasks to client.
- Provided Test Scripts and Templates with test results of each task delivered to the client team.
- Always used the best practices of Java/J2EE and minimize the unnecessary object creation, encourage proper garbage collections of un-used objects, always keep try to minimize the database call, always encourage to get all data in bulk from database to get best performance of application.
Environment: J2EE (JSP’s, Servlets, EJB), HTML, Struts, DB2, hibernate 3.0, Log4j, JUnit 3.8.1.,Eclipse 3.1.1, JBoss Plugins, JMS in JBoss, CVS, CSS and JS, SQL Server .
Confidential
Java Developer
Responsibilities:
- Coded end to end (i.e. from GUI on Client side to Middleware to database and Connecting the back end Systems) on a subset of sub modules belonging to the above modules.
- Worked extensively on Swing.
- Most of the business logic is provided in Session Beans and the database transactions are performed using Container Managed Entity Beans.
- Worked on Parsing of XML Using DOM and SAX.
- Implemented EJB Transactions.
- Used JMS for messaging with IBM MQ-Series.
- Written stored procedures.
- Developed the Presentation layer, which was built using Servlets and JSP and MVC architecture on Web sphere Studio Application Developer (WSAD).
- Mentoring other programmers.
- Studied the implementation of Struts
- Implemented the Security Access Control both on client and Server side. Applet signing including Jar signing.
Environment: Java, Java Swing JSP, Servlets, JDBC, Applets, Struts, JCE 1.2, RMI, EJB, XML/XSL, Visual Age java (VAJ).
Confidential
Java developer
Responsibilities:
- Involved in the analysis, design, implementation, and testing of the project.
- Implemented the presentation layer with HTML, XHTML and JavaScript.
- Developed web components using JSP, Servlets and JDBC.
- Implemented database using SQL Server.
- Designed tables and indexes.
- Wrote complex SQL and stored procedures.
- Involved in fixing bugs and unit testing with test cases using JUnit.
- Developed user and technical documentation.
Environment: JAVA, Java Script, HTML, XML, JDBC Drivers, Unix, Shell scripting, SQL Server.