Hadoop Developer Resume
Boston, MA
SUMMARY
- 8+ years of professional experience in IT, including 2 years of work experience in Hadoop Eco system.
- In depth understanding/knowledge of Hadoop Architecture and various components such as HDFS, JobTracker, TaskTracker, NameNode, Data Node and Map Reduce concepts.
- Well versed in installation, configuration, supporting and managing of Big Data and underlying infrastructure of HadoopCluster.
- Hands on experience on major components in Hadoop Ecosystem like HadoopMap Reduce, Marklogic HDFS, HIVE, PIG, Pentaho, HBase, Sqoop, Oozie and Flume.
- Experience with Oozie Workflow Engine in running workflow jobs with actions that run Hadoop Map/Reduce and Pig jobs.
- Experience in managing and reviewing Hadoop Log files.
- Extending Hive and Pig core functionality by writing custom UDFs.
- Experience inHadoopadministration activities such as installation and configuration of clusters using Apache and Cloudera.
- Good Knowledge in Amazon AWS concepts like EMR and EC2 web services which provides fast and efficient processing of Big Data.
- Hands on experience in designing and coding web applications using Core Java and J2EE technologies.
- Experienced the integration of various data sources like Java, RDBMS, Shell Scripting, Spreadsheets, and Text files.
- Experience in Web Services using XML, HTML and SOAP.
- Excellent Java development skills using J2EE, J2SE, Servlets, JUnit, JSP, JDBC.
- Familiarity working with popular frameworks likes Struts, Hibernate, spring, MVC and AJAX.
- Extensive experience in developing components using JDBC, Java, Oracle, XML and UNIX Shell Scripting.
- Ability to blend technical expertise with strong Conceptual, Business and Analytical skills to provide quality solutions and result - oriented problem solving technique and leadership skills.
TECHNICAL SKILLS
Hadoop: Ecosystem HDFS, Map Reduce Hive, Marklogic, Pig, HBase, Zookeeper, Sqoop, Oozie, Flume Pentaho and Avro.
Web Technologies: Java, J2EE, Servlets, JSP, JDBC, XML, AJAX, SOAP, WSDL
Methodologies: Agile, UML, Design Patterns (Core Java and J2EE)
Frameworks: Hibernate 2.x/3.x, spring 2.x/3.x, Struts 1.x/2.x
Programming Languages: Java, XML, Unix Shell scripting, HTML.
Database Systems: Oracle 11g/10g, DB2, MS-SQL Server, MySQL, MS-Access
Web Services: Web Logic, Web Sphere, Apache Tomcat
Monitoring & Reporting tools: Ganglia, Custom Shell scripts
Operating Systems: Windows-XP/2000/NT, UNIX, Linux, and DOS
IDE: Eclipse3.x, NetBeans
PROFESSIONAL EXPERIENCE
Confidential, Boston, MA
Hadoop Developer
Responsibilities:
- Installed and configured Hadoop MapReduce, HDFS, Developed multiple MapReduce jobs in java for data cleaning and preprocessing.
- Importing and exporting data into HDFS and Hive using Sqoop, Marklogic.
- Experienced in defining job flows.
- Experienced in managing and reviewing Hadooplog files.
- Extracted files from CouchDB through Sqoop and placed in HDFS and processed.
- Experienced in runningHadoopstreaming jobs to process terabytes of xml format data.
- Load and transform large sets of structured, semi structured and unstructured data.
- Responsible to manage data coming from different sources.
- Got good experience with NoSQL database.
- Supported Map Reduce Programs those are running on the cluster.
- Involved in loading data from UNIX file system to HDFS.
- Installed and configured Hive and also written Hive UDFs.
- Involved in creating Hive tables, loading with data and writing Hive queries which will run internally in map reduce way.
Environment: Java 6, Eclipse, Linux,Hadoop, HBase, marklogic Sqoop, Pig, Hive, Flume.
Confidential, Los Angeles, CA
Hadoop Developer
Responsibilities:
- Worked extensively in creating MapReduce jobs to power data for search and aggregation
- Designed a data warehouse using Hive
- Worked extensively with Sqoop for importing metadata from Oracle extensively used Pig for data cleansing
- Created partitioned tables in Hive
- Worked with business teams and created Hive queries for ad hoc access.
- Evaluated usage of Oozie for Workflow Orchestration
- Mentored analyst and test team for writing Hive Queries
- Gained very good business knowledge on health insurance, claim processing, fraud suspect identification, appeals process etc.
Environment: Hadoop, MapReduce, HDFS, Hive, Marklogic, Java (jdk1.6),Hadoopdistribution of Hortonworks, Oozie, Oracle 11g/10g
Confidential, Waukegan, IL
Java/J2EE Developer
Responsibilities:
- Utilized Agile Methodologies to manage full life - cycle development of the project.
- Implemented MVC design pattern using Struts Framework.
- Form classes of Struts Framework to write the routing logic and to call different services.
- Created tile definitions, Struts-config files, validation files and resource bundles for all modules using Struts framework.
- Developed web application using JSP custom tag libraries, Struts Action classes and Action. Designed Java Servlets and Objects using J2EE standards.
- Used JSP for presentation layer, developed high performance object/relational persistence and query service for entire application utilizing Hibernate.
- Developed the XML Schema and Web services for the data maintenance and structures.
- Developed the application using Java Beans, Servlets and EJB's.
- Created Stateless Session EJB's for retrieving data and Entity Beans for maintaining User Profile.
- Used WebSphere Application Server and RAD to develop and deploy the application.
- Worked with various Style Sheets like Cascading Style Sheets (CSS).
- Designed database and created tables, written the complex SQL Queries and stored procedures as per the requirements.
- Involved in coding for JUnit Test cases, ANT for building the application.
Environment: Java/J2EE, Oracle 10g, SQL, PL/SQL, JSP, EJB, Struts, Hibernate, WebLogic 8.0, HTML, AJAX, Java Script, JDBC, XML, JMS, XSLT, UML, JUnit, log4j, MyEclipse 6.0
Confidential, Seattle, WA
Java/J2EE Developer
Responsibilities:
- Involved in various phases of Software Development Life Cycle (SDLC) as design development and unit testing.
- Developed and deployed UI layer logics of sites using JSP, XML, JavaScript, HTML/DHTML, and Ajax.
- CSS and JavaScript were used to build rich internet pages.
- Agile Scrum Methodology been followed for the development process.
- Designed different design specifications for application development that includes front - end, back-end using design patterns.
- Developed proto-type test screens in HTML and JavaScript.
- Involved in developing JSP for client data presentation and, data validation on the client side with in the forms.
- Developed the application by using the Spring MVC framework.
- Collection framework used to transfer objects between the different layers of the application.
- Developed data mapping to create a communication bridge between various application interfaces using XML and XSL.
- Spring IOC being used to inject the parameter values for the Dynamic parameters.
- Developed JUnit testing framework for Unit level testing.
- Actively involved in code review and bug fixing for improving the performance.
- Documented application for its functionality and its enhanced features.
- Created connection through JDBC and used JDBC statements to call stored procedures.
Environment: Spring MVC, Oracle 11g J2EE, Java, JDBC, Servlets, JSP, XML, Design Patterns, CSS, HTML, JavaScript 1.2, JUnit, Apache Tomcat, My SQL.
Confidential, Memphis, TN
Java/J2EE Developer
Responsibilities:
- Played an active role in the team by interacting with welfare business analyst/program specialists and converted business requirements into system requirements.
- Developed analysis level documentation such as Use Case, Business Domain Model, Activity & Sequence and Class Diagrams.
- Conducted Design reviews and Technical reviews with other project stakeholders.
- Implemented Services using Core Java.
- Developed and deployed UI layer logics of sites using JSP.
- Struts (MVC) is used for implementation of business model logic.
- Worked with Struts MVC objects like Action Servlet, Controllers, and validators, Web Application Context, Handler Mapping, Message Resource Bundles and JNDI for look - up for J2EE components.
- Developed dynamic JSP pages with Struts.
- Used built-in/custom Interceptors and Validators of Struts.
- Developed the XML data object to generate the PDF documents and other reports.
- Used Hibernate, DAO, and JDBC for data retrieval and medications from database.
- Messaging and interaction of Web Services is done using SOAP.
- Developed JUnit Test cases for Unit Test cases and as well as System and User test scenarios
- Involved in Unit Testing, User Acceptance Testing and Bug Fixing.
- Implemented mid-tier business services to integrate UI requests to DAO layer commands.
Environment: J2EE, JDBC, Java 1.4, Servlets, JSP, Struts, Hibernate, Web services, SOAP, WSDL, Design Patterns, MVC, HTML, JavaScript 1.2, WebLogic 8.0, XML, JUnit, Oracle 10g, My Eclipse