Hadoop Developer Resume
Dearborn, MI
SUMMARY
- Over 7 Years of professional experience in all the phases of software development life cycle including Design, Development, Integration of Client/Server environment, Maintenance, Implementation and Testing of various software applications.
- Experience in Software Development Life Cycle (SDLC), OOA, OOD and OOP through implementation and testing.
- Experience in reviewing client requirement, prioritize requirements, creating project proposal (scope, estimation) and baseline project plan.
- Over 2 years of experience as Hadoop Developer wif good knowledge in Hadoop ecosystem technologies.
- Experience in developing Map Reduce Programs using Apache Hadoop for analyzing the big data as per the requirement.
- Worked on major Hadoop ecosystems PIG, HIVE, HBASE and Cloudera Manager.
- Experience in developing PIG Latin Scripts and using Hive Query Language.
- Experience working on NoSQL databases including Hbase, Cassandra.
- Experience using Sqoop to import data into HDFS from RDBMS and vice - versa.
- Good knowledge in using job scheduling and monitoring tools like Oozie and ZooKeeper.
- Experience in Hadoop administration activities such as installation and configuration of clusters using Apache, Cloudera and AWS.
- Good knowledge of Design Patterns like Singleton, DAO, Factory, MVC, Service Locator Pattern, Builder Pattern, Proxy Pattern etc.
- Experience in GUI development using HTML, CSS, JavaScript, JSON,XSLT, AJAX, JSP, JSP Tag libraries, Servlets, JNDI, XML, and XSLT.
- Designed and developed the application using Struts 1.3, Spring 2.5/3.0 and Hibernate 2.0 & 3.0 Frameworks.
- Excellent grasp in Core Java, spring 3.0, Hibernate 3.0, JPA, AJAX, Struts 1.3, JSP, Servlet, and JMS (MQ Series).
- Experienced in using SAX, DOM and STAX Parsers.
- Good experience in implementing Service Oriented Architecture (SOA) using XML based Web Services SOAP.
- Good exposure of Web Services and REST web Services using CFX/XFIRE and Apache Axis, Jersey Framework for the exposure and consumption of SOAP Messages and REST web services Messages.
- Expertise in RDBMS, JDBC, Hibernate, Oracle 8i/9i/10g and SQL Server including SQL or PL/SQL, Stored Procedures.
- Experience wif Application Servers and Web Servers such as BEA Web Logic Server, JBoss Server, IBM Web Sphere and Apache Tomcat.
- Experience in Building, Deploying and Integrating wif Ant, Maven.
- Experience in development of logging standards and mechanism based on Log4J.
- Extensive experience in different IDE’s like Net Beans, Eclipse - Indigo/Galileo & Helios.
- Test Driven Programmer wif thorough knowledge in unit testing wif J Unit 3.8/4.0.
- Ability to learn and master new technologies and to deliver outputs in short deadlines wif excellent communication and inter personnel skills.
TECHNICAL SKILLS
Hadoop/Big Data Technologies: HDFS, MapReduce, Hbase, Pig, Hive, Sqoop, Flume, Cassandra, Oozie, Zookeeper, YARN
Programming Languages: C, C++, Matlab, R, Java, Visual Basic, SQL, PL/SQL, Shell Scripting
J2EE Technologies: Servlets, JSP, Custom Tag Libraries, JDBC, JNDI, Collections, Multi-threading, JMS, Java Mail, JAXB, JAXP.EJB
Web Technologies: HTML, DHTML, JavaScript, Ajax, CSS, XML, DTD, XSD, XSLT, SAX, DOM, JSON
Databases: Oracle 8.x/9.x/10g/11i, DB2, MySQL, SQL Server.
Database Tools: TOAD.
Application/Web Servers: Apache Tomcat, JBoss, WebSphere, WebLogic
Web Services: Apache CXF/XFire, Apache Axis, SOAP, Jersey
IDE: Eclipse, NetBeans, JDeveloper, WSAD
Tools: Ant, Maven, TOAD, XML SPY, Selenium
Frameworks: Struts, Spring, Hibernate
Version Control Systems: CVS, SVN, JIRA, Clear Case
Testing/Logging tools: JUnit, EasyMock, JMock, log4J
Operating Systems: Windows XP/Vista/7, Unix, Linux
PROFESSIONAL EXPERIENCE
Confidential, Dearborn, MI
Hadoop Developer
Responsibilities:
- Installed and configured Apache Hadoop to test the maintenance of log files in Hadoop cluster.
- Installed and configured Hive, Pig, Sqoop, Flume and Oozie on the Hadoop cluster.
- Installed Oozie workflow engine to run multiple Hive and Pig Jobs.
- Setup and benchmarked Hadoop/HBase clusters for internal use.
- Developed Java MapReduce programs for the analysis of sample log file stored in cluster.
- Developed Simple to complex Map/reduce Jobs using Hive and Pig
- Developed Map Reduce Programs for data analysis and data cleaning.
- Developed PIG Latin scripts for the analysis of semi structured data.
- Developed and involved in the industry specific UDF (user defined functions)
- Used Hive and created Hive tables and involved in data loading and writing Hive UDFs.
- Used Sqoop to import data into HDFS and Hive from other data systems.
- Continuous monitoring and managing the Hadoop cluster using Cloudera Manager.
- Migration of ETL processes from Oracle to Hive to test the easy data manipulation.
- Developed Hive queries to process the data for visualizing.
Environment: Apache Hadoop, HDFS, Cloudera Manager, CentOS, Java, MapReduce, Eclipse Indigo, Hive, PIG, Sqoop, Oozie and SQL.
Confidential, Houston, TX
Hadoop developer
Responsibilities:
- Installed and configured Hadoop and responsible for maintaining cluster and managing and reviewing Hadoop log files.
- Installed and configured Hadoop MapReduce, HDFS and developed multiple MapReduce.
- Developed simple and complex MapReduce programs in Java for Data Analysis.
- Load data from various data sources into HDFS using Flume.
- Worked on Cloudera to analyze data present on top of HDFS.
- Worked extensively on Hive and PIG.
- Worked on large sets of structured, semi-structured and unstructured data.
- Use of Sqoop to import and export data from HDFS to RDBMS and vice-versa.
- Developed PIG Latin scripts to play wif the data.
- Involved in creating Hive tables, loading wif data and writing hive queries which will run internally in map reduce way.
- Responsible to manage data coming from different sources.
Environment: Apache Hadoop, Cloudera Manager, HDFS, Java MapReduce, Eclipse, Hive, PIG, Sqoop, Oozie and SQL
Confidential, Charlotte, NC
Java/J2EE Application Developer
Responsibilities:
- Responsible for design, document, implement, and unit test robust webservices framework to support templated payments and group payments in Java.
- Worked in an onsite-offshore model. Lead offshore developers, assisted them in understanding requirements and provided code reviews.
- Extensively used Spring Framework for Business Layer - accessing enterprise services like JNDI, JMS, and Job Scheduling. Also used Spring for transaction management and dependency injection.
- Created Database model, domain objects and DAO’s that interact wif the database and store the template related data and events.
- Used JAX-WS and Spring webservices to create and consume SOAP based webservices.
- Used Hibernate as an ORM tool for database operations.
- Created MDB’s to consume messages on various user events.
- Worked in Agile software methodology wif Scrum type development.
Environment: Java 1.6, Spring, Hibernate, Maven, Apache MQ, JUnit, JAXB, Oracle 10g, Oracle Coherence, Log4j, Shell Script, Soap UI, TOAD, SQL Developer, Quality Center, Linux, Windows
Confidential, Columbus, OH
Java/J2EE Application Developer
Responsibilities:
- The basic framework is based on MVC architecture.
- Develop the bowser based J2EE applications.
- Using Hibernate as a part of application development
- Designing the application using springs framework
- Deployed Servlets, JSP’s on Web Sphere server and configured it for optimal behavior in managing the client sessions.
- Developed user interfaces using JavaScript, JQuery, HTML, XHTML, CSS custom tags.
- Involved in design and development of the application using SOA (Service Oriented Architecture) wif Java Web Services / J2EE technologies
- Involved in in development of Servlets/JSP and documenting all the components clearly.
- Thorough knowledge in SD Methodologies Waterfall, Scrum and Agile
- Extensive use of IBM Rational tools for organizing development of software and systems
- Designed and developed reusable Java utility classes for the business logic functionality using services like JDBC and JNDI.
- Used WebSphere application server for deploying the web content and all code was written using the Eclipse IDE.
- Involved working wif DB2 database
- Written queries, stored procedures and functions using SQL, PL/SQL in Oracle.
- Worked wif sessions for database interaction wif Oracle implementing Persistence for data storing and maintenance procedures.
- Extensively used JUnit for unit testing, integration testing and production testing.
- Expertise in deploying on Tomcat, JBoss, WebSphere
- Used Maven Builder extensively for the code building.
- Created Daily Rolling Log using Log4j
- Used SVN as Version Control System
Environment: DB2, IBM Websphere, Java, Hibernate, J2EE, Spring MVC, JSP, Rational Rose, JDBC, JNDI, SQL, JavaScript, XML, DTD, Eclipse, SVN, ANT, JUnit, Log4j, Oracle, PL.SQL, JQuery, Windows.
Confidential, Madison,NJ
Java/J2EE Application Developer
Responsibilities:
- Participated in Requirements Analysis, and Design and Development phases of the project wif major emphasis on Development of the modules.
- Designed the application using the core J2EE design patterns Singleton, Session Façade, Business Delegate, and Service Locator.
- Documented the design documents using Class Diagrams and Sequence Diagrams using the Rational Application Developer.
- Used Object oriented JavaScript for developing rich client page.
- Developed the interactive web page using Struts, Hibernate, Ajax, XML, Object Oriented JavaScript.
- Used JIRA issue tracker to file the bugs.
- Developed controllers, updated the struts configuration files and implemented validation using Struts Validator framework.
- Mapped (one-to-many, one-to-one, many-to-one relations) DTOs to Oracle Database tables and Java data types to SQL data types by creating Hibernate mapping XML files
- Oracle database was used, wrote stored procedures for common SQL queries
- Developed various Database interaction objects by implementing the DAO Patterns and used JDBC as Model Component.
- Used SAX Parser for parsing the xml document.
- JBoss Server was used as the application server for deploying the application.
- Implemented Log4j by enabling logging at runtime wifout modifying the application binary.
- Involved in Unit Testing and Bug-Fixing and achieved the maximum code coverage using JUNIT test cases.
- Used MAVEN for building and deploying the application.
Environment: Java 1.5, J2EE, XML, JavaScript, JIRA, HTML, Selenium, SQL, Servlet, Jsp, Struts, Hibernate, Log4j, JUnit, Ant, Oracle 10g, and Eclipse, JBoss.
Confidential
Java/J2EE Application Developer
Responsibilities:
- Responsible for understanding the business requirement.
- Worked wif Business Analyst and helped representing the business domain details in technical specifications.
- Was also actively involved in setting coding standards and writing related documentation.
- Developed the Java Code using Eclipse as IDE.
- Developed JSPs and Servlets to dynamically generate HTML and display the data to the client side.
- Developed application on Struts MVC architecture utilizing Action Classes, Action Forms and validations.
- Tiles were used as an implementation of Composite View pattern
- Was responsible in implementing various J2EE Design Patterns like Service Locator, Business Delegate, Session Facade and Factory Pattern.
- Code Review & Debugging using Eclipse Debugger.
- Was responsible for developing and deploying the EJB (Session & MDB).
- Configured Queues in WebLogic server where the messages, using JMS API, were published.
- Consumed Web Services (WSDL, SOAP, UDDI) from third party for authorizing payments to/from customers.
- Writing/Manipulating the database queries.
- Build web application using MAVEN as build tool.
- Used CVS for Version control,
- Performed unit testing using JUnit Testing Framework and Log4J to monitor the error log.
Environment: Java,/J2EE, Eclipse, Web Logic Application Server, Oracle, JSP, HTML, JavaScript, JMS, Servlets, UML, XML, Eclipse, Struts,Web Services, WSDL, SOAP, UDDI, ANT, JUnit, Log4j.