We provide IT Staff Augmentation Services!

Hadoop Developer Resume

2.00/5 (Submit Your Rating)

Reston, VA

SUMMARY:

  • Around 8+ years of experience in IT as aDeveloper, Designer & Database Administrator with cross platform integration experience inHadoop, Java/J2EE .
  • Around 3 years of experience working on BIG DATA ECOSSYSTEM using HADOOP framework tools such as Map/Reduce, HBASE, HIVE, PIG, FLUME, YARN,KAFKA, SPARK,OOZIE, SQOOP, and ZOOKEEPER
  • Experience in using Cloudera Manager for installation and management of single - node and multi-node Hadoop cluster (CDH 5.4 &CDH 4)
  • Good Experience working with Distributions such as Cloudera, HortonWorks and MapR
  • Well versed in building and maintaining multiple Hadoop clusters of different sizes and configuration
  • Experience in working with the Columnar NoSQL Databases like HBase, Cassandra,MongoDBto manage extremely large datasets.
  • Skilled in creating workflows using Oozie for CRON jobs
  • Have experience with Spark processing Framework such as Spark and Spark Sql.
  • Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems(RDBMS),Teradata and vice-versa.
  • Good experience in handling different file formats like text files, Sequence files and ORC data files using different SerDe’s in Hive.
  • Experience in writing custom UDFs and UDAFsfor extending Hive and Pig core functionalities.
  • Hands on experience with message broker such as Apache Kafka.
  • Having Experience on UNIX commands and Deployment of Applications in Server.
  • Developed and implemented shell scripts to automate the work in the Linux operating Systems
  • Created HBase tables to store variable data formats (Avro,JSON) of data coming from different portfolios using NOSQL.
  • Used Spark API over MapReduce to perform Analytics on data in Hive.
  • Highly Working experience with multiple Web/Application Servers like WebSphere 6.0/5.1, WebLogic 10g/8.1/6.1, Oracle App Server 10, Tomcat 4.X.
  • Experience of writing client side web technologies including using XML 1.0, XSL,HTML, DHTML, CSS and JavaScript, JQuery. Experienced in parsing (DOM and SAX) XML using JAXB 2.0 API
  • Highly proficient in developing SQL, PL/SQLs.
  • An excellent team player and self-starter with good communication skills and proven abilities to finish tasks before target deadlines.
  • Participated in an Agile SDLC to deliver new cloud platform services and components
  • Highly experienced in Server side development using Java/J2EE Technologies and ORM tools such as Hibernate 3.0, spring 2.5, Struts 1.x/Tiles Frameworks.
  • Exceptional ability to learn new technologies and to deliver outputs in short deadlines.
  • Architected, Designed and maintained high performing ELT/ETL Processes from multiple sources.
  • Good work experience on JAVA, JDBC, Servlets, JSP

SKILLS:

Big Data: Hadoop 2.6.2, Map/Reduce, PIG 0.13.0, Hive 1.2.1, Hbase 0.94, Sqoop 1.4.4,Zoopkeeper 3.4.5, SparkFramework,Kafka,Oozie

Java Technologies: Java, J2EE, JSTL, JDBC 3.0/2.1, JSP 1.2/1.1, Java Servlets, JMS, JUNIT,Log4j

Frameworks: Struts 1.2, Spring 3.0, Hibernate 3.2

Programming Languages: Java, Unix Shell Scripts, R, Python, Scala, Spark

Scripting Languages: Java Script, CSS, HTML5, XHTML, JQUERY

Web services: XML, SOAP, WSDL, SOA, JAX- WS, DOM, SAX, XPATH, XSLT, UDDI, JAX-RPC, REST, and JAXB 2.0, AWS EC2.

Databases: Oracle9i/10g/11g, MySQL, SQL/PL SQL

Web/Application Servers: Apache Tomcat 5.x, BEA Weblogic 8.x, IBM Websphere 6.0/5.1.1

IDE Development Tools: Eclipse 3.5, Net Beans, My Eclipse, Oracle JDeveloper 10.1.3, SOAP UI, Ant, Maven, RAD, SQL Server Management

DB Tools: MySQL, MYSQL developer, NOSQL ( HBASE, MONGODB,CASSANDRA), Teradata

Operating systems: WINDOWS, RHEL,UNIX

PROFESSIONAL EXPERIENCE:

Confidential, Reston, VA

Hadoop Developer

Responsibilities:

  • Installed, configured and fine-tuned Cloudera Hadoop (CDH4&CDH5) and other tools in the Hadoop ecosystem such as Flume, Sqoop, Zookeeper, Pig, Hive, Hbase,YARN.
  • Installed and configured Spark ecosystem components (Spark SQL,Spark Streaming, Mainframe Spark Architecture)
  • Worked on partitioning HIVE tables and running the scripts in parallel to reduce run-time of the scripts.
  • Wrote applications in Scala for large scale data processing.
  • Extract, Transform and Load operations on large sets of structured, semi structured and unstructured data.
  • Developed Sqoop scripts to import and export data from Relational Databases and handled incremental loading on the customer, transaction data by date.
  • Involved in loading data from UNIX file system to HDFS.
  • Worked on Data Serialization formats for converting complex objects into sequence bits by using AVRO, PARQUET, JSON,CSVformats.
  • Optimized MapReduce Jobs to use HDFS efficiently by using various compression mechanisms.
  • Installed and configured Hive and also wrote HiveUDF’s.
  • Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way.
  • Developed Hive queries to pre-process the data for analysis by imposing read only structure on the stream data.
  • Handled different file formats like text files,Sequence files and ORC data files using different SerDe’s in Hive.
  • Used Oozie Operational Services for batch processing and scheduling workflows dynamically.
  • Responsible for continuous monitoring and managing Elastic MapReduce cluster through AWS console.
  • Automated all jobs for pulling data from FTP server to load data into Hive tables using Oozie workflow.
  • Designed and developed the framework to consume the web services hosted by Amazon EC2 instances.
  • Supported MapReduce programs that were running on the cluster.

Environment: Hadoop Framework, MapReduce, Hive, Sqoop, Flume, Oozie, Java(JDK1.7), Amazon EC2, UNIX Shell Scripting, Oracle 11g, IBM Datastage 8.1, Cassandra

Confidential, Atlanta, GA

Hadoop Developer

Responsibilities:

  • Involved in the installation of Hadoop cluster installation, configuration and monitoring
  • Generating Scala and java classes from the respective APIs so that they can be incorporated in the overall application
  • Optimized MapReduce Jobs to use HDFS efficiently by using various compression mechanisms.
  • Administered,installed and managed distributions of Hadoop,Hive and Hbase.
  • Worked on Data Serialization formats for converting Complex objects into sequence bits by using AVRO, PARQUET, JSON, CSV formats
  • Wrote KafkaAPIs in python to queue lot of streaming data coming from multiple sources inside to spark by applying producer and consumer paradigm.
  • Exported data from DB2 to HDFS using Sqoop
  • Developed Shell scripts and some of Perl scripts based on the user requirement.
  • Involved in loading data from UNIX file system to HDFS.
  • Worked on partitioning HIVE tables and running the scripts in parallel to reduce runtime of the scripts
  • Migrated leagacy system designed in C/Oracle database and migrated it to an open source NoSQL Database (Cassandra)
  • Installed and configured Hive and also wrote Hive UDF’s.
  • Extensively worked on creating End-End data pipeline orchestration using Oozie.
  • Worked on Cluster coordination services through Zookeeper
  • Worked on loading log data directly into HDFS using Flume

Environment: Hadoop framework, MapReduce, HDFS,Scala, Pig, Hive,Kafka,HBase, Sqoop, Flume, Oozie, Java (J2EE), XML, DB2, LOG4J, ANT and Linux.

Confidential, Kansas City, MO

Java/J2EE Developer

Responsibilities:

  • Involved in Presentation Tier Development using JSF Frameworkand ICE Faces tag Libraries.
  • Implemented J2EE standards, MVC2 architecture using JSF Framework.
  • Implementing Servlets, JSP and Ajax to design the user interface.
  • Extensive experience in building GUI (Graphical User Interface) using JSF and ICE Faces
  • Experience using ICE Faces Tag Libraries to develop user interface components.
  • Used JSF, JSP, Java Script, HTML, and CSS for manipulating, validating, customizing, error messages to the UserInterface.
  • Extensively used EJBs (Session beans) to implement the business logic, JMS for communication for sending updates to various other applications and MDB for routing priority requests.
  • All the business logic in all the modules is written in core Java.
  • Wrote WebServices using SOAP for sending and getting data from the external interface.
  • Developed a web-based reporting for monitoring system with HTML and Tiles using Struts framework
  • Middleware Services layer is implemented using EJB (Enterprise Java Bean - stateless) in WebSphere environment.
  • Used Design patterns such as Business delegate, Service locator, Model View Controller, Session façade, DAO.
  • Funds Transfers are sent to another application using JMS technology asynchronously.
  • Involved in implementing the JMS (Java messaging service) for asynchronous communication.
  • Involved in writing JMS Publishers to post messages.
  • Involved in writing MDB (Message Driven Beans) as subscribers.
  • Created Stored procedures using PL-SQL for data modification (Using DML insert, update, delete) in Oracle
  • Interaction with Oracle database is implemented using Hibernate.

Environment: J2EE, EJB, JSF, ICE Faces, EJB, WebServices, XML, XSD, Agile, Microsoft Visio, Clear Case, Oracle 9.i/10.g, Weblogic8.1/10.3,RAD, LOG4j, Servlets, JSP, Unix.

Confidential, Reston, VA

Java/J2EE Developer

Responsibilities:

  • Involved in resolving high priority production issues processing XML files using JAXB parsers and transformations using XSLT.
  • Developed web based application and integrating the application using open source frameworks in Spring, Struts 2.0 and Java Messaging Service API.
  • Used JSP for developing screens for creating and updating credit line set for application customer.
  • Developed Ant build file to automate the build process.
  • Wrote action and service classes and defined action mappings in struts.xml and application-context.xml file.
  • Involved in preparation of design documents for all the impacted methods and for new functionality.
  • Implemented DAO layer using Entity Bean and wrote queries for persisting cards related information.
  • End to end design and development exposure.
  • Involved in defect fixing activity and ensuring on time Delivery by the Team.

Environment: Java 1.5, JDBC 2.0, JavaScript, JMS 1.1, Servlet 2.0, XML, CSS, HTML, XHTML, Ant, Spring Framework 2.0 and Struts 2.0., Oracle 10g.

Confidential, Bloomington, IL

Java/J2EE Developer

Responsibilities:

  • Involved in designing the application and prepared Use case diagrams, class diagrams, sequence diagrams.
  • Developed Servlets and JSP based on MVC pattern using Struts Action framework.
  • Used Tiles for setting the header, footer and navigation and Apache Validator Framework for Form validation.
  • Using Resource and Properties files for i18n support.
  • Involved in writing Hibernate queries and Hibernate specific configuration and mapping files.
  • Used Log4J logging framework to write Log messages with various levels.
  • Involved in fixing bugs and minor enhancements for the front-end modules.
  • Used JUnit framework for writing Test Classes.
  • Used Ant for starting up the application server in various modes.
  • Used Clear Case for version control.
  • Used SDLC Life Cycle

Environment: Java JDK1.4, EJB2.x, Hibernate 2.x, Jakarta Struts 1.2, JSP, Servlet, JavaScript, MS SQL Server 7.0, Eclipse3.x, Websphere 6, Ant, Windows XP, Unix, Excel Macro Development.

Confidential, San Francisco, CA

Java/J2EE Developer

Responsibilities:

  • Elaborated Use Cases based on business requirements and was responsible for creation of Class Diagrams, Sequence Diagrams.
  • Developed user interfaces using JSPs, HTML, XHTML, DHTML, CSS, Java Script, JSP Custom Tags.
  • Developed JSPs and managed beans using JSF1.2 implementation.
  • Developed Service layer using spring framework and injected the Spring beans into JSF managed bean.
  • Developed web pages using JSF UI Components.
  • Developed Asynchronous means of retrieval of data from the Server and Database using AJAX features as well JavaScript.
  • Developed Java classes for implementation of persistence of objects and caching of Data using Hibernate.
  • Extensively used Core Java such as Multi Threading, Exceptions, and Collections.
  • Designed WSDL's and elaborated type definitions schemas based on corporate standards, integration and security specifications
  • Implemented the Web Services and associated business modules integration.
  • Tested JSPs in FireFox and Internet Explorer browsers. Identified and fixed browser related issues.
  • Used ANT script to compile and build the WAR.
  • Configured the WebLogic handler for the Apache Web Server to serve static files (js, html, images and css).
  • Developed SQL Statements as well as PL/SQL Stored Procedures for searching contractors depending on Selection Criteria.
  • Developed Servlets for Document Upload, Image Streaming and Caching the data.
  • Development and Integration of the Application using Eclipse IDE and used StarTeam as Version Control Tool.
  • Involved in the full system life cycle and responsible for Developing, Testing, Implementing.
  • Involved in Unit Testing, Integration Testing, and System Testing etc.
  • Developed JavaScript validation for client side validations.
  • Performed Code reviews and code fixes.
  • Used Log4J to store log messages.

Environment: Java 1.5, J2EE, Spring, JSP, Hibernate, JSF, Struts 2.0, LDAP, AJAX, HTML, CSS, JDBC, Eclipse, Weblogic 10.x, Web Services, WSDL, Oracle, ANT, Windows, SOA, Design patterns, Firebug, IETester, jQuery, AJAX, JavaScript, HTML, CSS.

Confidential

Java/J2EE Developer

Responsibilities:

  • Involved in requirement gathering, analysis, design and development of the application.
  • Developed the web application using Struts Framework.
  • Developed application on STRUTS framework and configured struts-config.xml, web.xml.
  • Created tile definitions, struts-config files and resource bundles using Struts framework.
  • Implemented validation framework for creation of validation.xml and used validation-rules.xml.
  • Interaction with Oracle database is implemented using Hibernate.
  • Developed Classes in Eclipse for Java, using the Class Specification provided in Rational Rose.
  • Design and developed SQL Queries, Views and procedures.
  • Designed, developed and deployed necessary stored procedures, Functions using SQL, PL/SQL.
  • Created Unit Test cases for developed functionality and performed Unit testing.
  • Point of contact for the onsite team.
  • Used to make the necessary changes to the wireframe after contacting the onsite team.
  • Divide the work into modules and assign the same to the team mates with deadlines.
  • Involved in integrating and building the code.
  • Writing the test cases and performing all the tests on all the scenarios.
  • Debugging using Fire Bug (Mozilla Firefox) and Developer Tools (IE).
  • Point of contact for the testing team and would explain them the flow when in doubt.
  • Modifying and developing the website according to the buyers.

Environment: Java/JDK 1.5, Struts, Eclipse, J2EE, JBoss Application server and Oracle, JSP, RDBMS, SQL, PL/SQL, JavaScript, JQuery, JDBC, Servlet, Unified Modeling Language, Toad, JUnit, Core Java, Struts.

We'd love your feedback!