We provide IT Staff Augmentation Services!

Hadoop Admin/developer Resume

3.00/5 (Submit Your Rating)

Sterling, VA

SUMMARY:

  • 10+ Years of Professional Software Development Experience in designing and developing Client - Server, Cloud & Distributed Applications.
  • 2 Years of Experience with Large-Scale Distributed Systems development, with strong understanding of scaling and performance using the Hadoop Stack
  • Working knowledge with BigData technologies like Hive, Pig, Sqoop, Flume and managing Large Hadoop Clusters
  • Experienced in HBase Schema Design addressing Data Volume and Performance Issues
  • Profound knowledge and experience in working with the entire Spring Framework and its core concepts like DI, AOP and also its support for Transaction Management, and ORM
  • Expertise in design of persistence layer using Hibernate/JPA and JDBC
  • Experienced in implementing various Design patterns like Data Access Objects (DAO), Value Object, MVC, Singleton, Factory, Business Delegate, Adapter, Strategy, and Session façade.
  • Hands on experience in working with Web Technologies like Dojo, JavaScript, HTML, CSS, AJAX, XML, and XSL
  • Expertise in coding optimized SQL queries, PL/SQL Stored Procedures, Functions, Packages, Triggers on databases like Oracle 8i/9i/10g, MYSQL, and DB2 etc.
  • Working knowledge of version control systems like Git and Subversion
  • Possesses good leadership qualities, good Interpersonal Skills, team-working attitude, takes initiatives in solving problems and providing best solutions

TECHNICAL SKILLS:

Big Data Technologies: HDFS, MapReduce, Pig, Hive, HBase, Sqoop, Flume

Programming Languages: Java 1.6, C, C++, PHP

Java Technologies: Servlets, JSP, EJB 3.0, JNDI, JMS, JSTL, 1.0, JDBC, Ant, Log4J, JSF

Framework and Tools: Spring, Struts, Hibernate, Zend, Doctrine

Web Technologies: AJAX, JavaScript,JQuery, Dojo HTML, XML, XSL, XSLT, DOM, CSS

Web Services Technologies: SOAP, UDDI, WSDL, Apache Axis 1.x

Databases: Oracle 8i/9i/10g, MySQL, PostgreSql, DB 2

Version Control: Git, Sub Version, CVS

PROFESSIONAL EXPERIENCE:

Confidential, Sterling, VA

Hadoop Admin/Developer

Responsibilities:

  • Assisted the Big Data team in setting up and configuring Hadoop Cluster with
  • Migrated data between different Hadoop clusters
  • Performing regular backups of data and namenode metadata periodically.
  • Ensured that the data load is evenly balanced across nodes using the Balancer.
  • Commissioning and Decommissioning Nodes as and when required.
  • Tweaked the Configuration to ensure proper distribution of load across the cluster And to aid in Performance Tuning of the shuffle/sort process.
  • Configured Git for code and configuration management.
  • Preprocessing data using MapReduce to feed into Hive tables.
  • Used Sqoop to import from MYSQL to HBase
  • Designed and developed Hadoop solutions which collect various web log data from various servers and consolidated it into a centralized HDFS/Hive location.
  • Developed the PIG UDF’S to pre-process the data for analysis
  • Used Avro as the synchronization mechanism to feed data into MapReduce jobs and supported Schema Evolution of Avro data.
  • Developed procedures to extract unstructured data from internal client systems into Hadoop cluster using Apache Flume.
  • Automated all the jobs for pulling data from FTP server to load data into Hive tables using Oozie workflows.
  • Developed MapReduce jobs to perform Partitioned Map File lookups and Complete Sorting.
  • Improved performance of MapReduce jobs using Combiners, Compression, and Serialization.

Environment: HDFS, MapReduce, Hive, HBase, Pig, Sqoop, Flume, Oozie, Git, Java, UNIX

Confidential, CA

Hadoop Developer

Responsibilities:

  • Followed a SCRUM based methodology
  • Performed Performance Tuning of the existing cluster to load balance the data and improve MapReduce performance
  • Design and develop Satellite data processing and analysis using Hadoop, MapReduce and HBase
  • Addressed issues related to Secondary Indexes and Alternate Query Paths in HBase Schema Design.
  • Worked out Complex Algorithms to break down complex Spatial Problems into MapReduce Jobs.
  • Developed POC for YARN Setup on a Mini Cluster
  • Developed MapReduce jobs to summarize data in HBase and copy to PostgreSql
  • Used MapReduce to process Geo-Spatial Imagery and Vector data.
  • Developed a MapReduce job for Database partitioning function computation and construction R-Trees for each partition.
  • Used HBase to process requests with low latency random access
  • Used Oozie for streamlining complex geospatial data.
  • Developed a MapReduce job for Aerial Image Quality Computation
  • Developed PIG Latin scripts to extract the data from the web server log files to load into HDFS
  • Developed PIG scripts embedded in Java to handle complex control flows
  • Developed Unit Tests for MapReduce job using MRUnit

Technologies: HDFS, MapReduce, HBase, Oozie, Git, Java, PostgreSQL, UNIX

Confidential, Santa Clara, CA

PHP Developer

Responsibilities:

  • Followed a SCRUM approach for development involving 2 week SPRINT’s.
  • Used Rally as a project tracking tool.
  • Worked along with the architect in the backend design.
  • Configured the LAMP environment.
  • Setting up the application environment with a modular structure using Zend Application component of the Zend framework.
  • Used Zend MVC framework for separation of business logic from the interface.
  • Developed a proprietary ORM to be used for the application.
  • Took lead in designing a new database schema using MYSQL
  • Took active part in the research to improve the potential users and took lead in designing an effective SEO campaign.
  • Developed application wide Search Module and performed Query Optimizations to enhance search performance.
  • Developed Bash Scripts to integrate Unit Testing into the Deployment Process.

Environment: LAMP (PHP 5), PHPMyAdmin, PEAR, CSS, HTML, Subversion, Zend Framework, PHPUnit, JQuery

Confidential, Centreville, VA

J2EE Developer

Responsibilities:

  • Participated in entire project SDLC Life Cycle.
  • Extensively used Spring Dependency Injection for all the Domain and Service layer classes.
  • Used Spring AOP for Transaction management service and Logging using log4j.
  • Implemented the Service layer which is consumed in different ways.
  • Implemented Design Patterns like Strategy, Observer, and DAO to reduce coupling.
  • XSL was used to convert all the clients’ data into one definition.
  • Consumed as well as developed Web services using Apache Axis.
  • Designed and implemented the complete ORM layer using JPA with Hibernate Entity Manager and integrated into the spring framework.
  • Extensively used Dojo for providing Ajax capabilities.
  • Developed Unit Tests using JUnit.

Environment: Spring 2.0, Hibernate 3.0, J2EE (Jsp, Servlets), ORACLE 9i, Subversion, Log4J, JUnit, Apache Axis, XML, XSL, SOAP, WSDL, UDDI

Confidential, Hartford, CT

J2EE Developer

Responsibilities:

  • Developed Message Driven Beans to communicate with the JMS server asynchronously.
  • Used the JMS and connection factories to establish MQ Service connections.
  • Performed data conversion using the Queue Manager of WebSphere MQ.
  • Involved in coding Stateless Session Bean that validates an input XML and sends the validated XML to the Queue using JMS API. These session beans are called by Message Driven Beans.
  • Developed a Stateful Session Bean which delegates the processing of the information to a custom written Web service.
  • Responsible for designing the persistence layer using Hibernate.
  • Extensively used Ajax load dynamic content and static page caching.
  • Written JavaScript for Client Side Validations.

Environment: JDK, UML, Javascript, JSF, Oracle 9i, Hibernate, JSP, Subversion, Junit. HTML, CSS

Confidential, Coppell, TX

J2EE Developer

Responsibilities:

  • Understanding the user requirements and designed the application according to business requirements.
  • Used Spring Dependency Injection for the Domain and Service layer classes.
  • Used the Spring Transaction template and the Hibernate Template classes to simplify the code development process.
  • Used Spring AOP for logging using log4j.
  • Developed the persistence layer using Hibernate for Categories, Subcategories, and Resources which have complex relationships among them.
  • Designed and developed Value Objects for Landing Page Service.
  • Developed the code for Internationalization using JSTL Tags and Resource Bundle.

Environment: Java, UML, Javascript, Oracle 9i, Hibernate, Spring, JSP, CVS, Junit, HTML, CSS

Confidential, New Ulm, MN

J2EE Developer

Responsibilities:

  • Involved in accepting, understanding and resolving production support calls.
  • Developed Web Services to expose underlying shipping application to be accessed by other external systems.
  • Created persistence layer framework using Hibernate where we map our domain classes to the database tables.
  • Coordinated with offshore team for certain deliverables on time.
  • Integrated the Struts framework and Hibernate framework.
  • Developed re-usable Java Scripts for client side validation.
  • Written Ant scripts for automating the build process.
  • Used Rational Clear Case as version control tool.

Environment: Java/J2EE, Apache Axis 1.3, Struts, Hibernate, Oracle, Clear case, XML/XSLT, PL/SQL.

Confidential, West Allis, WI

J2EE Developer

Responsibilities:

  • Involved in complete SDLC life cycle process from designing to deployment and testing.
  • Built WSDL from Java classes using JAVA2WSDL tool of Apache Axis.
  • Converted WSDL to java Artifacts using WSDL2JAVA.
  • Created a Web service to communicate between different clients.
  • Created Axis Clients to invoke web services and test them.
  • Implemented different design patterns like DAO, Singleton, session façade, Business delegate etc.
  • Responsible for writing the DAO classes for each individual activity to communicate with DB2.
  • Configured a Data Source and used JDBC.
  • Extensively participated in testing and coordinated with the testing team.

Environment: HL7 messaging, JBoss, J2EE ( EJB 2.0, Servlets, JSP), AXIS 1.3, Web Services, SOAP, UDDI, WSDL, Struts 1.2, ANT, ORACLE, JMS, Log4J

Confidential, Austin, TX

J2EE Developer

Responsibilities:

  • Involved in requirement analysis and designing the application using OOAD and prepared UML diagrams with Rational Rose.
  • Created/Modified/Analyzed Use Case, Sequence, Class Diagrams with Rational Rose.
  • Responsible for development of web and business tier components using Java, J2EE, JSP, servlets, XML, HTML, and CSS.
  • Coding of Handler classes and Value Objects passed to the front end for display.
  • Used Java Script for adding dynamic behavior to the web page and for performing Client Side Validations.
  • Written ANT build scripts to automate the build process.
  • Developed JUnit test cases.
  • Provided thorough technical documentation for the complete project.

Environment: Java, J2EE, XML, HTML, CSS, Java Script, Rational Rose, Namespaces, DTDs, J2EE, Struts, Weblogic server, and Oracle.

We'd love your feedback!