Hadoop Developer Resume
Medford, MA
SUMMARY
- 8+ years of professional experience in IT, including 3+ years of work experience in Big Data, Hadoop Development and Ecosystem Analytics in Banking, Food & Beverage, Healthcare, Insurance and State Project sectors.
- Well versed in installation, configuration, supporting and managing of Big Data and underlying infrastructure of Hadoop Cluster.
- Hands on experience on major components in Hadoop Ecosystem like Hadoop Map Reduce, HDFS, HIVE, PIG, Pentaho, HBase, Sqoop, Oozie, Flume and Avro.
- Experienced teh Hadoop using Puppet labs.
- Experience in managing and reviewing Hadoop Log files.
- Experience wif Oozie Workflow Engine in running workflow jobs wif actions that run Hadoop Map/Reduce and Pig jobs.
- Experience in importing and exporting teh data using Sqoop from HDFS to Relational Database systems/mainframe and vice - versa.
- Experience in setting up automated monitoring and escalation infrastructure for Hadoop Cluster using Ganglia and Nagios.
- Work experience wif cloud infrastructure like Amazon Web Services (AWS).
- Experienced teh integration of various data sources like Java, RDBMS, Shell Scripting, Spreadsheets, and Text files.
- Experience in Web Services using XML, HTML and SOAP.
- Excellent Java development skills using J2EE, J2SE, Servlets, JUnit, JSP, JDBC.
- Experience using middleware architecture using Sun Java technologies like J2EE, JSP, Servlets, and application servers like Web Sphere and Web logic.
- Familiarity working wif popular frameworks likes Struts, Hibernate, Spring MVC and AJAX.
- Ability to blend technical expertise wif strong Conceptual, Business and Analytical skills to provide quality solutions and result-oriented problem solving technique and leadership skills.
TECHNICAL SKILLS
Hadoop Ecosystem: HDFS, Map Reduce Hive, Pig, Jaspersoft, HBase, Zookeeper, Sqoop, Oozie, Flume and Avro.
Web Technologies: Core Java, J2EE,Servlets,JSP,JDBC,XML,AJAX,SOAP, WSDL
Methodologies: Agile, UML, Design Patterns (Core Java and J2EE)
Frameworks: MVC, Struts 2/1, Hibernate 3, Spring 3/2.5/2
Programming Languages: Java, XML, Unix Shell scripting, HTML.
Data Bases: Oracle 11g/10g, DB2, MS-SQL Server, MySQL, MS-Access
Web Services: Web Logic, Web Sphere, Apache Tomcat
Monitoring & Reportingtools: Ganglia, Nagios, Custom Shell scripts
PROFESSIONAL EXPERIENCE
Confidential, Medford, MA
Hadoop Developer
Environment: Hadoop 1x, HDFS, Map Reduce, Hive 10.0, Pig, Sqoop, Ganglia, HBase, Shell Scripting
Responsibilities:
- Proactively monitored systems and services, architecture design and implementation of Hadoop deployment, configuration management, backup, and disaster recovery systems and procedures.
- Involved in Analyzing system failures, identifying root causes, and recommended course of actions.
- Documented teh systems processes and procedures for future references.
- Worked wif systems engineering team to plan and deploy new Hadoop environments and expand existing Hadoop clusters.
- Monitored multiple Hadoop clusters environments using Ganglia.
- Monitored workload, job performance and capacity planning using Cloud era Manager.
- Worked wif application teams to install operating system, Hadoop updates, patches, version upgrades as required.
- Installed and configured Flume, Hive, Pig, Sqoop and Oozie on teh Hadoop cluster.
- Used Flume to collect, aggregate, and store teh web log data from different sources like web servers, mobile and network devices and pushed to HDFS.
- Performed Map Reduce programs on log data to transform into structured way to find user location, age group, spending time.
- Analyzed teh web log data using teh HiveQL to extract number of unique visitors per day, page views, visit duration, most purchased product on website.
- Exported teh analyzed data to teh relational databases using Sqoop for visualization and to generate reports by our BI team.
- Responsible to manage data coming from different sources.
- Integrated Oozie wif teh rest of teh Hadoop stack supporting several types of Hadoop jobs out of teh box (such as Map-Reduce, Pig, Hive, and Sqoop) as well as system specific jobs (such as Java programs and shell scripts).
- Involved in Installing and configuring Kerberos for teh authentication of users and Hadoop daemons.
Confidential, Reno, NV
Hadoop Developer
Environment: Hadoop Cluster, HDFS, Hive, Pig, Sqoop, Linux, Hadoop Map Reduce, HBase, Shell Scripting.
Responsibilities:
- Responsible for building scalable distributed data solutions using Hadoop.
- Responsible for Cluster maintenance, adding and removing cluster nodes, Cluster Monitoring and Troubleshooting, Manage and review data backups and log files.
- Analyzed data using Hadoop components Hive and Pig.
- Worked hands on wif ETL process.
- Responsible for running Hadoop streaming jobs to process terabytes of xml's data.
- Load and transform large sets of structured, semi structured and unstructured data using Hadoop/Big Data concepts.
- Involved in loading data from UNIX file system to HDFS.
- Responsible for creating Hive tables, loading data and writing hive queries.
- Handled importing data from various data sources, performed transformations using Hive, Map Reduce, and loaded data into HDFS.
- Extracted teh data from Teradata into HDFS using teh Sqoop.
- Exported teh patterns analyzed back to Teradata using Sqoop.
- Installed Oozie workflow engine to run multiple Hive and Pig jobs which run independently wif time and data availability.
Confidential - Carson City, NV
J2EE Developer
Environment: Java/J2EE, Oracle 11g, SQL, JSP, Struts 1.2, Hibernate 3, Web Logic 10.0, HTML, AJAX, Java Script, JDBC, XML, JMS, UML, JUnit, log4j, Web Sphere, My Eclipse
Responsibilities:
- Utilized Agile Methodologies to manage full life-cycle development of teh project.
- Implemented MVC design pattern using Struts Framework.
- Form classes of Struts Framework to write teh routing logic and to call different services.
- Created tile definitions, Struts-config files, validation files and resource bundles for all modules using Struts framework.
- Developed web application using JSP custom tag libraries, Struts Action classes and Action.
- Designed Java Servlets and Objects using J2EE standards.
- Used JSP for presentation layer, developed high performance object/relational persistence and query service forentire applicationutilizingHibernate.
- Developed teh XML Schema and Web services for teh data maintenance and structures.
- Used Web Sphere Application Server to develop and deploy teh application.
- Worked wif various Style Sheets like Cascading Style Sheets (CSS). In coding for JUnit Test cases.
Confidential, Seattle, WA
Java/J2EE Developer
Environment: Spring MVC, Oracle 11g J2EE, Java, JDBC, Servlets, JSP, XML, Design Patterns, CSS, HTML,JavaScript 1.2, JUnit, Apache Tomcat, My SQL Server 2008.
Responsibilities:
- Involved in various phases of Software Development Life Cycle (SDLC) as design development and unit testing.
- Developed and deployed UI layer logics of sites using JSP, XML, JavaScript, HTML/DHTML, and Ajax.
- CSS and JavaScript were used to build rich internet pages.
- Agile Scrum Methodology been followed for teh development process.
- Designed different design specifications for application development that includes front-end, back-end using design patterns.
- Developed proto-type test screens in HTML and JavaScript.
- Involved in developing JSP for client data presentation and, data validation on teh client side wif in teh forms.
- Developed teh application by using teh Spring MVC framework.
- Collection framework used to transfer objects between teh different layers of teh application.
- Developed data mapping to create a communication bridge between various application interfaces using XML, and XSL.
- Spring IOC being used to inject teh parameter values for teh Dynamic parameters.
- Developed JUnit testing framework for Unit level testing.
- Actively involved in code review and bug fixing for improving teh performance.
- Documented application for its functionality and its enhanced features.
- Created connection through JDBC and used JDBC statements to call stored procedures.
Confidential -Memphis, TN
Java Developer
Environment: J2EE, JDBC, Java 1.4, Servlets, JSP, Struts, Hibernate, Web services, SOAP, WSDL, Design Patterns, MVC, HTML, JavaScript 1.2,WebLogic 8.0, XML, Junit, Oracle 10g, My Eclipse.
Responsibilities:
- Played an active role in teh team by interacting wif welfare business analyst/programspecialists and converted business requirements into system requirements.
- Developed analysis level documentation such as Use Case, Business Domain Model, Activity & Sequence and Class Diagrams.
- Conducted Design reviews and Technical reviews wif other project stakeholders.
- Implemented Services using Core Java.
- Developed and deployed UI layer logics of sites using JSP.
- Struts (MVC) is used for implementation of business model logic.
- Worked wif Struts MVC objects like Action Servlet, Controllers, and validators, Web Application Context, Handler Mapping, Message Resource Bundles and JNDI for look-up for J2EE components.
- Developed dynamic JSP pages wif Struts.
- Used built-in/custom Interceptors and Validators of Struts.
- Developed teh XML data object to generate teh PDF documents and other reports.
- Used Hibernate, DAO, and JDBC for data retrieval and medications from database.
- Messaging and interaction of Web Services is done using SOAP.
- Developed JUnit Test cases for Unit Test cases and as well as System and User test scenarios
- Involved in Unit Testing, User Acceptance Testing and Bug Fixing.
- Implemented mid-tier business services to integrate UI requests to DAO layer commands.