We provide IT Staff Augmentation Services!

Sr. Hadoop Developer Resume

0/5 (Submit Your Rating)

Baltimore, MD

SUMMARY

  • 7+ years of proactive IT experience in Analysis, Design, Development, Implementation and Testing of software applications which includes an accomplished 3+ Years of experience in Big Data using Hadoop, Hive, PIG, Sqoop and MapReduce Programing.
  • Extensively worked upon MapReduce programming model and Hadoop Distributed File Systems (HDFS).
  • Work experience in major components of Hadoop Ecosystem like Flume, Hbase, ZooKeeper, Oozie Hive, Sqoop, PIG and YARN.
  • Exceptional understanding of Hadoop architecture and different components of Hadoop clusters which include Job Tracker, Task Tracker, Name Node and Data Node.
  • Developed scripts, numerous batch jobs to schedule various Hadoop programs.
  • Experience in analyzing data using HiveQL, PIG Latin, and custom MapReduce programs in Java.
  • Hands on experience in importing and exporting data from different databases like Oracle, Teradata into HDFS and Hive using Sqoop.
  • Extensive experience in collecting and storing stream data like log data in HDFS using Apache Flume.
  • Extensively used MapReduce Design Patterns to solve complex MapReduce programs.
  • Developed Hive and PIG queries for data analysis to meet the business requirements.
  • Experience in extending Hive and Pig core functionality by writing custom UDFs like UDAFs and UDTFs.
  • Experienced implementing Security mechanism for Hive Data.
  • Experience with Hive Queries Performance Tuning.
  • Experienced with improving data cleansing process using Pig Latin operations, transformations and join operations.
  • Extensive knowledge in NoSQL databases like HBase, Cassandra, MongoDB.
  • Experienced with performing CRUD operations using HBase Java Client API and Rest API.
  • Good knowledge on Cassandra, DataStax Enterprise, DataStax OpsCenter and CQL.
  • Experience with Oozie Workflow Engine to automate and parallelize Hadoop Map/Reduce, Hive and PIG jobs.
  • Experienced with processing different file formats like Avro, XML, JSON and Sequence file formats using MapReduce programs.
  • Excellent Java development skills using J2EE Frameworks like Spring, Hibernate, EJBs and Web Services
  • Implemented SOAP and RESTful Web Services.
  • Experienced in creating and analyzing Software Requirement Specifications (SRS) and Functional Specification Document (FSD).
  • Exposed to each of the phases of complete Software Development Life Cycle (SDLC).
  • Extensively worked with Object Oriented Analysis, Design (OOAD) and development of software using UML Methodology, good knowledge of J2EE design patterns and Core Java Design Patterns.
  • Good knowledge in creating PL/SQL Stored Procedures, Packages, Functions, Cursors with Oracle (9i, 10g, 11g), and MySQL server.
  • Worked with Junit and Easymock and MRUnit to implement testcases
  • Experienced with build tools like Maven, Ant and CI tools like Jenkins.
  • Good knowledge with versioning tools like Clear case, Peforce, SubVersion and CVS.
  • Exposed into methodologies like Scrum, Agile and Waterfall.
  • Multi - cultured Team Player with complete flexibility to work independently as well as in a team and have quick grasping capabilities to work with the newly emerging technologies.
  • Motivated high flier with excellent verbal/written communication skills, admirable presentation capabilities, efficient requirement gathering ability and effectively convey them to other members in the team.

TECHNICAL SKILLS

Hadoop Ecosystem: Hadoop, MapReduce, Sqoop, Hive, Oozie, PIG, HDFS, Zookeeper, Flume.NoSQL Database Hbase, Cassandra.

Java& J2EE Technologies: Core Java, Servlets, JSP, JDBC, JNDI, Java Beans.

Languages: C,C++,Java,SQL,PL/SQL, PIG Latin, HiveQL, Unix Shell Scripting.

Frameworks: MVC, Spring, Hibernate, Struts 1/2, EJB, JMS, JUnit, MRUnit.

Databases: Oracle 9i/10g/11g, IBM DB2, MS SQL Server 2008/2010, MySQL

IDE / Tools: Eclipse, My Eclipse,IBM RAD, NetBeans, Toad.

Application Servers: IBM Websphere 5.1/6.0, BEA Weblogic Server 8x/9x/10x, JBoss 4.2.2,Apache Tomcat5.5/6.0/7.

Web Services: WSDL, SOAP, Apache CXF, Apache Axis, REST, Jersey

Methodologies: Scrum, Agile, Waterfall.

PROFESSIONAL EXPERIENCE:

Confidential, Baltimore, MD

Sr. Hadoop Developer

Responsibilities:

  • Extracted the data from Teradata/MySQL into HDFS using Sqoop export/import.
  • Optimized Map/Reduce Jobs to use HDFS efficiently by using various compression mechanisms.
  • Expertise in using Data organizational design patterns in Map Reduce to convert business data into custom format.
  • Used Partitioning pattern in MapReduce to move records into categories
  • Implemented Custom JOINS to create tables containing the records of Items using Spark SQL.
  • Expertise in optimization of MapReduce algorithms using Combiners, Partitioners and Distributed Cache to deliver best results.
  • Implemented LZO compression and used indexer tool to split compress data for further processing using MapReduce.
  • Experienced with handling data from different sources at a time to reducer using Object Writable in Mapreduce programs
  • Implemented Hive generic UDF's to validate business rules that specific to the category.
  • Implemented Performance tuning in Hive Queries like making partition fields as filters, optimize join performance etc.
  • Join Related Categories into single data set for further processing using PIG joins.
  • Exported analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team.
  • Continuous monitoring and managing the Hadoop cluster using Cloudera Manager.
  • Used UDF’s to implement business logic in Hadoop and responsible to manage data coming from different sources.
  • Created workflows using Oozie coordinator jobs to configure cron jobs that get data from different data sources.
  • Involved in loading data from UNIX file system to HDFS.
  • Experience in managing and reviewing Hadoop log files.
  • Consolidate all defects, report it to PM/Leads for prompt fixes by development teams and drive it to closure.
  • Wrote shell scripts to monitor the health check of Hadoop daemon services and responded accordingly to any warning or failure conditions using Ganglia.
  • Configuring automatic version build using Maven plug-in's and Jenkins

Environment: Apache Hadoop 1.1.2, MapReduce, HDFS, Hive, PIG, Oozie, Sqoop, Flume, Java, SQL, Eclipse, Unix Script, MySQL, BO, YARN and Ganglia.

Confidential, Alpharetta, GA

Hadoop Developer

Responsibilities:

  • Designed and implemented MapReduce based large-scale parallel processing.
  • Handled importing of data from various data sources, performed transformations using Hive, MapReduce, and loaded data into HDFS.
  • Experienced working with real time analytical operations using HBase.
  • Implemented CRUD operations on HBase Data using HBase Client Java API and Rest API.
  • Integrated HBase with MapReduce to work on bulk data.
  • Continuous monitoring and managing the Hadoop cluster through Cloudera Manager.
  • To set up standards and processes for Hadoop based application design and implementation.
  • Written Hive queries for data analysis to meet the business requirements.
  • Creating Hive tables and working on them using Hive QL.
  • Extending HIVE and PIG core functionality by using UDF's.
  • Experienced with performance tuning against Hive operations.
  • Experience in Designing, developing and implementing connectivity products that allow efficient exchange of data between our core database engine and Hadoop ecosystem.
  • Experience in importing and exporting the data using Sqoop from HDFS to Relational Database systems/mainframe and vice-versa.

Environment: Java, Eclipse, Linux, Apache Hadoop 1.0.3, MapReduce, HBase, Sqoop, PIG, Hive, Flume, Oracle 10g.

Confidential, Dallas, TX

HadoopDeveloper

Responsibilities:

  • Launching Amazon EC2 Cloud Instances using Amazon Images (Linux/Ubuntu) and Configuring launched instances with respect to specific applications.
  • Launching and Setup of HADOOP Cluster which includes configuring different components of HADOOP.
  • Hands on experience in loading data from UNIX file system to HDFS.
  • Implemented POC's to configure data tax Cassandra with Hadoop.
  • Experienced with Performing Cassandra Query operations using Thrift API to perform real time analytics.
  • Implemented CDH3 Hadoop cluster on CentOS.
  • Cluster coordination services through Zookeeper.
  • Installed and configured Flume, Hive, PIG, Sqoop and Oozie on the Hadoop cluster.
  • Involved in creating Hive tables, loading data and running Hive queries in those data.
  • Extensive Working knowledge of partitioned table, UDFs, performance tuning, compression-related properties, thrift server in Hive.
  • Involved in writing optimized PIG Script along with involved in developing and testing PIG Latin Scripts.
  • Working knowledge in writing PIG's Load and Store functions.
  • Used Struts validation framework for form level validation.
  • Wrote test cases in JUnit for unit testing of classes.
  • Involved in templates and screens in HTML and JavaScript.

Environment: Apache Hadoop 1.0.1, MapReduce, HDFS, CentOS, Zookeeper, Sqoop, Cassandra, Hive, PIG, Oozie, Java, Eclipse, Amazon EC2, JSP, Servlets.

Confidential, LittleRock, AR

Java Developer

Responsibilities:

  • Prepared Technical design document, Use cases and Test cases
  • Performed Use case design, object modeling using UML, like Transformation of the Use Cases into Class Diagrams, Sequence Diagrams.
  • Developed UI pages with JSF framework.
  • Developed application layout and composing tiles definitions, managed beans to use with JSF, Transfer Objects to pass data over layers, Business Delegates for invoking business methods of EJBs, Stateless Session Beans which will access Business Objects, which will in turn call DAO's to retrieve & update data in the Database.
  • Framework leverages JSF features like Event handling, Validation mechanisms, and state management.
  • Creation Managed bean used to instantiate backing beans used in a JSF application and stores them in a Scope.
  • Spring Framework at Business Tier and Uses spring's Bean Factory for initializing services.
  • Used Spring Core Annotations for Dependency Injection.
  • Developed the AJAX functionality using tags libraries.
  • Wrote configuration files for injecting EJBs.
  • Used JSF framework in developing user interfaces using JSF UI Components, Validator, Events and Listeners.
  • Prototyped use of JSF for presentation development and Spring for middle tier development to analyze if use would ease development.
  • Extensively used JSF Core and HTML tags in UI pages.
  • Implemented web service using Apache Axis, used Bottom-up approach.
  • UsedJava Mailing or Messaging Service (JMS) API’s for mailing detailed notifications depending upon the success and failure once the backend process is complete and also for mailing administrator of any system related problems.
  • Efficiently presented the data using JSF Data tables.
  • UI pages Navigation defined in faces-config.xml
  • Developed complex SQL join queries for efficiently accessing the data.
  • Used Spring Framework with Hibernate to map to Oracle database.
  • Hibernate used as Persistence framework mapping the ORM objects to tables.
  • Developed SQL queries.
  • Eclipse used for Development i.e. used as IDE.
  • Invoved in Bug fixing, Code reviews, and Unit & System testing.
  • Used Oracle 10g as database and backend implementation and using SQL created Select, Update and Delete statements.

Environment: Java, JSF 1, Spring, Hibernate, EJB, AJAX, Web services, Apache Axis 2.0, Eclipse, Tomcat, Java Beans, Sun RI, Primefaces, Clear case, ClearQuest, UML, XML, XHTML, DHTML, JavaScript, CSS, Oracle 10g, SQL, Log4j.

Confidential

Java/J2EE Developer

Responsibilities:

  • Participated in the designing of the Web framework using Struts framework as a MVC design paradigm.
  • Reviewing and analyzing data model for developing the Presentation layer and Value Objects.
  • Involved in entire life cycle development of the application.
  • Used HTML, CSS, XHTML and DHTML in view pages for front-end.
  • Extensively involved in developing Web interface using JSP, JSP Standard Tag Libraries (JSTL) using Struts Framework.
  • Used Struts & JavaScript for client-side validation
  • Used Struts Tag Libraries to develop the JSP pages.
  • Used JSTL in the presentation tier.
  • Involved in writing the client side scripts using JavaScript.
  • Used and configured Struts ValidatorForms, MessageResources, ActionErrors, Validation.xml, Validator-rules.xml.
  • Developed various java objects (POJO) as part of persistence classes for OR mapping with databases.
  • Developed Controller using ActionServlet and Action mapping provided by Struts framework.
  • Wrote Hibernate configuration and mappings xml files for database access.
  • Developed SQL stored procedures and prepared statements for updating and accessing data from database.
  • Development carried out under Eclipse Integrated Development Environment (IDE).
  • Used ClearCase Version Control for Project Configuration Management.

Environment: J2EE, Hibernate, Struts 1.2, Spring core 2.0, JSP, JSTL, Servlets, Apache Axis 1.2, JavaScript, HTML, XML, JUnit, Eclipse, TOAD, JBoss, CSS,Clearcase, Oracle9i.

Confidential

Jr.Java Developer

Responsibilities:

  • Involved in Analysis, Design, Coding, Testing and Defect fixing of requirements based on the change requests specified by the client.
  • Generating Batch Reports.
  • Client side validations were implemented using JavaScript.
  • Performing tuning of queries which caused system to crash
  • Implemented e-Agent framework based on the Model View Controller design paradigm.
  • Implemented the MVC-EJB architecture.
  • Analyze defect/issues raised by client and providing root cause and timeframe to fix the defects.
  • Designed and developed business components using Session and Entity Beans in EJB.
  • Used JDBC for data access from tables.
  • Implemented EJB’s Container Managed Persistent strategy.
  • Worked on triggers and stored procedures on IBM DB2.
  • JUnit was used to implement test cases for beans.
  • Worked on IBM RAD to write the code and integrate the application.
  • Application was deployed on WebSphere Application Server.
  • Coordinated with testing team for timely release of product.

Environment: Java, JSP, Servlets, EJB, JMS, Javascript, IBM RAD, JDBC, Web Sphere Application Server 5.0, EJB.

We'd love your feedback!