Hadoop Developer Resume
Atlanta, GA
SUMMARY
- 7 + years of total experience in Designing and Developing client/server and web based applications using J2EE technologies, which includes 1.5 years of experience in Big Data with good knowledge on HDFS and Ecosystem.
- Excellent understanding / knowledge ofHadooparchitecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and Map Reduce programming paradigm.
- Hands on experience in installing, configuring, and usingHadoopecosystem components likeMap Reduce, HDFS, HBase, Oozie, Hive, Sqoop, Pig, and Flume.
- Experience in working with large scaleHadoop environments build and support including design, configuration, installation, performance tuning and monitoring.
- Experience in importing and exporting terabytes of data using Sqoop from HDFS to Relational Database Systems and vice - versa.
- Experience in architecting Hadoop clusters using major Hadoop Distributions - CDH3&CDH4.
- Experience in managing and troubleshooting Hadoop related issues
- Experience in installation, configuration, management and deployment of Big Data solutions and the underlying infrastructure of Hadoop Cluster.
- Knowledge in job/workflow scheduling and monitoring tools like Oozie & Zookeeper.
- Experience in analyzing data using HIVEQL, PIG Latin and custom Map Reduce programs in JAVA. Extending Hive and PIG core Functionality by using custom User Defined Functions.
- Worked with application teams to install operating system, Hadoop updates, patches and version upgrades as required.
- Hands on experience in virtualization and worked on VMware Virtual Center
- Experience in designing, developing and implementing connectivity products that allow efficient exchange of data between our core database engine and theecosystem in Hadoop.
- Designed and modeled projects using techniques in UML - Use Cases, Class Diagrams, Sequence Diagrams, etc.
- Extensive experience inRequirements gathering, Analysis, Design, Reviews, Codingand Code Reviews,Unit and Integration Testing.
- Experience in using different applications development frameworks like Hibernate, Struts, and spring for developing integrated applications and different light weight business components.
- Experience in developing service components using JDBC.
- Experienceindeveloping and designing Web Services (SOAP and Restful Web services).
- Experience in developing Web Interface using Servlets, JSP and Custom Tag Libraries.
- Good knowledge and working experience in XML related technologies.
- Experience in using Java, JEE, J2EE design Patterns like Singleton, Factory, MVC, Front Controller, for reusing most effective and efficient strategies.
- Expertise in using IDE like WebSphere (WSAD), Eclipse, NetBeans, My Eclipse, WebLogic Workshop.
- Extensive experience in writing SQL quires for Oracle, Hadoop and DB2 databases using SQLPLUS. Hands on experience in working with oracle (9i/10g/11g), DB2, NoSQL, MySQL and knowledge on SQL Server.
- Extensive experience in using SQL and PL/SQL to write Stored Procedures, Functions and Triggers.
- Excellent technical, logical, code debugging and problem solving capabilities and ability to watch the future environment, the competitor and customers probable activities carefully.
- Proven ability to work effectively in both independent and team situations with positive results. Inclined towards building a strong team/work environment, and have the ability to accustom to the latest technologies and situations with ease.
TECHNICAL SKILLS
Hadoop: HDFS, Map-Reduce, Pig, Hive, HBase, Flume, Zoo Keeper and Oozie
Hadoop Cluster: Cloudera CDH3/4
IDE’s: Eclipse and Net beans
NoSQL Databases: HBase, MongoDB, Cassandra and Microsoft Document DB
Frameworks: MVC, Struts, Hibernate and Springs
JEE Technologies: JSP, Servlets and JDBC
Programming languages: C, Java, Python and Linux shell scripts
SQL Databases: Oracle 9i,10g,11g, MySQL, DB2 and MS-SQL Server
Web Servers: Web Sphere and Apache Tomcat
Web Technologies: HTML, CSS3, JavaScript and JQuery
PROFESSIONAL EXPERIENCE
Confidential, Atlanta, GA
Hadoop Developer
Responsibilities:
- Evaluated suitability of Hadoop and its ecosystem to the above project and implemented various proof of concept (POC) applications to eventually adopt them to benefit from the Big Data Hadoop initiative.
- Estimated Software & Hardware requirements for the Name Node and Data Node & planning the cluster.
- Extracted the needed data from the server into HDFS and Bulk Loaded the cleaned data into HBase.
- Written the Map Reduce programs, Hive UDFs in Java where the functionality is too complex.
- Involved in loading data from LINUX file system to HDFS
- Develop HIVE queries for the analysis, to categorize different items.
- Designing and creating Hive external tables using shared meta-store instead of derby with partitioning, dynamic partitioning and buckets.
- Given POC of FLUME to handle the real time log processing for attribution reports.
- Sentiment Analysis on reviews of the products on the client’s website.
- Exported the resulted sentiment analysis data to Tableau for creating dashboards
- Used Map Reduce JUnit for unit testing.
- Maintained System integrity of all sub-components (primarily HDFS, MR, HBase, and Hive).
- Reviewing peer table creation in Hive, data loading and queries.
- Monitored System health and logs and respond accordingly to any warning or failure conditions.
- Responsible to manage the test data coming from different sources.
- Involved in scheduling Oozie workflow engine to run multiple Hive and pig jobs
- Weekly meetings with technical collaborators and active participation in code review sessions with senior and junior developers.
- Created and maintained Technical documentation for launching Hadoop Clusters and for executing Hive queries and Pig Scripts
- Involved unit testing, interface testing, system testing and user acceptance testing of the workflow tool.
Environment: Apache Hadoop, HDFS, Hive, Map Reduce, Java, Flume, Cloudera, Oozie, MySQL, UNIX, Core Java.
Confidential, Richmond, VA
Hadoop Developer
Responsibilities:
- Worked on the Hadoop File System Java API to develop or Compute the Disk Usage Statistics.
- Experience in Developing the Hive queries for the transformations, aggregations and Mappings on the Customer Data.
- Worked on importing and exporting data into HDFS and Hive using Sqoop.
- Worked on analyzing/transforming the data with Hive and Pig.
- Developed map reduce programs for applying business rules on the data
- Developed and executed Hive Queries for DE-normalizing the data.
- Automated workflow using Shell Scripts.
- Performance Tuning on Hive Queries.
- Involved in migration of data from one Hadoop Cluster to the Hadoop Cluster.
- Worked on configuring multiple Map Reduce Pipelines, for the new Hadoop Cluster.
- Performance tuned and optimized Hadoop clusters to achieve high performance.
- Implemented schedulers on the Job tracker to share the resources of the cluster for the map reduces jobs given by the users.
- Extensive hands on experience in Hadoop file system commands for file handling operations.
- Worked on Integration of Hiveserver2 with Tableau.
Environment: Hadoop, Map Reduce, HDFS, Hive, Java, Hadoop distribution of Cloud era, Pig, Hbase, Linux, XML, Java 6, Eclipse, Oracle 10g, PL/SQL.
Confidential, New York
Java Developer
Responsibilities:
- Participated in requirement discussions with all the stake holders.
- Responsible for distributing, tracking, communicating issues to developers and reporting status to manager on daily basis.
- Involved in High Level Design and Low Level Design document preparation.
- Development according to the specified design.
- Published SOAP based web services using JAX-WS, JAXB, XSD, XML Bean and XML.
- Front end is developed based on struts MVC architecture
- SOAPUI has been used to test the web services.
- Struts and spring frameworks has been used for the newly designed UI Infrastructure services to interact with the legacy application systems.
- Developed Action classes, Action forms, Validate methods, struts-config.xml file using struts and also used various struts tag libraries.
- Used Enterprise Java Beans (EJB session beans) in developing business layer APIs.
- Hibernate is used as ORM
- HQL and Criteria API have been used extensively.
- Developed complex SQL queries, stored procedures, functions, triggers and created indexes wherever applicable in Oracle database.
- Co-ordination with Onshore development team
- Involved in debugging and testing the application for the change requests
- Preparing weekly status reports /Monthly status reports
- Coordinating with complete offshore team on filling weekly time sheets on Clarity and Field glass.
- Given the code walk through to the newly joined team members on the deliverables
- Planning the forecast for the individuals on their task sheets.
- Prepared the test case documents for enhancements
- JUNIT is used for unit testing and prepared JUNIT Test cases document.
- Participated in code review and involved in integration, unit, functional testing, peer testing and integration testing.
Environment: JDK 1.5/1.4, J2EE, Servlets, Strut, Spring, Hibernate 3/3.5/4.0, HQL, Maven 3.0, JAX-WX, JAXB, XML, XSD, SOAPUI, JQuery, CSS, JUNIT, Oracle 9i/10g, SQL, PL/SQL, Quality Center, SSH shell, SSH Client, Putty, VSS, WAS, Web Sphere, Visual Studio, Microsoft Visio, Microsoft Project, UML, Share point, Windows XP and UNIX.
Confidential
Java/J2EE Developer
Responsibilities:
- Utilized Agile Methodologies to manage full life-cycle development of the project.
- Implemented MVC design pattern using Struts Framework.
- Form classes of Struts Framework to write the routing logic and to call different services.
- Created tile definitions, Struts-config files, validation files and resource bundles for all modules using Struts framework.
- Developed web application using JSP custom tag libraries, Struts Action classes and Action. Designed Java Servlets and Objects using J2EE standards.
- Used JSP for presentation layer, developed high performance object/relational persistence and query service forentire applicationutilizingHibernate.
- Developed the XML Schema and Web services for the data maintenance and structures.
- Developed the application using Java Beans, Servlets and EJB’s.
- Created Stateless Session EJB’s for retrieving data and Entity Beans for maintaining User Profile.
- Used WebSphere Application Server and RAD to develop and deploy the application.
- Worked with various Style Sheets like Cascading Style Sheets (CSS).
- Designed database and created tables, written the complex SQL Queries and stored procedures as per the requirements.
- Involved in coding for JUnit Test cases, ANT for building the application.
Environment: Java/J2EE, Oracle 10g, SQL, PL/SQL, JSP, EJB, Struts, Hibernate, WebLogic 8.0, HTML, AJAX, Java Script, JDBC, XML, JMS, XSLT, UML, JUnit, log4j, My Eclipse 6.0
Confidential
Java Developer
Responsibilities:
- Involved in design and implementation of server side programming.
- Involved in gathering requirements, analyzed them and prepared high level documents.
- Participated in all client meetings to understand the requirements.
- Actively involved in designing and data modelling using Rational Rose Tool (UML).
- Involved in the design of the SPACE database.
- Designed and development of User Interfaces, Menus using HTML, JSP, JSP Custom Tag, Java Script.
- Implemented User Interface Using Spring Tiles framework.
- Tuxedo server, which provides case details, is fetched by the help of web services technology (i.e. binding, finding a service and use of xml message format etc).
- Involved in integrating system with BT’s systems like GTC, CSS, OR through e Link Hub, and IBM MQ series.
- Developed, Deployed and tested JSPs, Servlets in WebLogic.
- Used Eclipse as IDE tool and integrated Web Logic with Eclipse to develop & deploy the applications.
- Used JDBC to connect the database.
- Tested the application using JUnit.
Environment: Struts Framework, Java1.3, XML, Data Modelling, JDBC, SQL,PL/SQL,JMS, Web services, SOAP, XML, XSLT, ANT tool, BEA Web Logic 7.2, Oracle8i, Toad, Eclipse
