We provide IT Staff Augmentation Services!

Hadoop Consultant Resume

3.00/5 (Submit Your Rating)

Los Angeles, CA

SUMMARY

  • Over 7 years of progressive experience in all phases of software development life cycle including requirements analysis, applications design, development, integration, maintenance, installation, implementation and testing of various client/server and web applications.
  • Experienced in installing, configuring, and administrating Hadoop cluster of major Hadoop distributions.
  • Have hands on experience in writing MapReduce jobs in Java, Pig and Python.
  • Experience in working wif Java, C++ and C
  • Experience in creating web - based applications using ActiveXControls, JSP, Servlets
  • Experience in creating web pages using HTML, Java Script and CSS
  • Hands on experience in installing, configuring and using ecosystem components like Hadoop MapReduce, HDFS, Hbase, Zoo Keeper, Oozie, Hive, Cassandra, Sqoop, Pig, Flume.
  • Hands-on experience wif "Productionalizing" Hadoop applications (such as administration, configuration management, monitoring, debugging, and performance tuning)
  • Excellent analytical, problem solving, communication and interpersonal skills wif ability to interact wif individuals at all levels and can work as a part of a team as well as independently.
  • In-depth understanding of Data Structure and Algorithms.
  • Experience in implementation of Open-Source frameworks like Struts, spring, Hibernate, Web Services etc.
  • Experience in deploying applications in heterogeneous Application Servers TOMCAT, Web Logic and Oracle Application Server.
  • First point of contact for any R&D activities and critical problems.
  • Implemented Unit Testing using JUNIT testing during teh projects.
  • Ability to perform at a high level, meet deadlines, adaptable to ever changing priorities.
  • Excellent communication skills, interpersonal skills, problem solving skills a very good team player along wif a can do attitude and ability to effectively communicate wif all levels of teh organization such as technical, management and customers.
  • Worked on Multi Clustered environment and setting up Cloudera Hadoop echo-System.

TECHNICAL SKILLS

Programming Languages: MapReduce (0.20, YARN), Java, C,C++, Java script and C#

Hadoop Framework: Apache, Cloudera and HDInsight, Machine Learning

Scripting: Pig Latin, Hive, Ant scripting

Database Technologies: Cassandra, NOSQL, SQL, JDBC, PL/SQL

Database Servers: Oracle, SQL Server

XML/Web: XML, XSL, XSLT, HTML, JavaScript, Ajax, CSS.

J2EE Technologies: Servlets, JSP, Custom tags, EJB, Web Services

Framework/ Architecture: Struts, Spring, Hibernate and MVC Architecture

Application Servers: Tomcat 6.x, Oracle Application Server 10g, WebSphere, JBoss

Operating Systems: Linux, UNIX and Windows

Special Tools: Eclipse, Rational Rose, VSS, CVS, PVCS Tracker, TOAD, PL/SQL Developer

Performance Engineering and Business Availability Tools: Mercury Load Runner, DevPartner java

PROFESSIONAL EXPERIENCE

Confidential, Los Angeles, CA

Hadoop Consultant

Responsibilities:

  • Gatheird teh business requirements from teh Business Partners and Subject Matter Experts.
  • Involved in installing Hadoop Ecosystem components.
  • Wrote Java MapReduce jobs to process teh tagging functionality for each chapter, sections and sub sections on teh data stored in HDFS.
  • Running MapReduce jobs to map teh relevant DSV technology used across teh project deployed in various countries and also stream line teh data to teh Application engineer for executing new projects.
  • Performed analysis on teh unused user navigation data by loading into HDFS and writing MapReduce jobs. Teh analysis provided inputs to teh new APM front end developers and lucent team.
  • Implemented Hadoop framework to capture user navigation across teh application to validate teh user interface and provide analytic feedback/result to teh UI team.
  • Extracted data from existing Oracle database tables to HBase using Sqoop job.
  • Defined job flow and develop workflow using Oozie.
  • Final Chapters / Sections / Subsections data written to SQL database table using Sqoop job.
  • Supported teh installation of Hadoop cluster wif secondary node and also supported to increase teh nodes from 12 to 25.

Environment: Hadoop, MapReduce, HDFS, HBase, Oozie, Sqoop, Hive, Cloudera, DataStax, Flat files, Oracle 11g/10g, PL/SQL, SQL*PLUS, Toad 9.6, Windows NT, UNIX Shell Scripting, Autosys r11.0.

Confidential, Columbus, OH

Hadoop Consultant

Responsibilities:

  • Installed and configured Hadoop MapReduce, HDFS, Developed multiple MapReduce jobs in java for data cleaning and preprocessing.
  • Importing and exporting data into HDFS and Hive using Sqoop
  • Experienced in defining job flows
  • Experienced in managing and reviewing Hadoop log files
  • Experienced in running Hadoop streaming jobs to process terabytes of xml format data
  • Load and transform large sets of structured, semi structured and unstructured data
  • Responsible to manage data coming from different sources
  • Supported Map Reduce Programs those are running on teh cluster
  • Jobs management using Fair scheduler.
  • Cluster coordination services through Zoo Keeper.
  • Involved in loading data from UNIX file system to HDFS.
  • Installed and configured Hive and also written Hive UDFs.
  • Involved in creating Hive tables, loading wif data and writing hive queries which will run internally in map reduce way
  • Automated all teh jobs for pulling data from FTP server to load data into Hive tables, using Oozie workflows.
  • Gained very good business noledge on health insurance, claim processing, fraud suspect identification, appeals process etc.

Environment: Hadoop, MapReduce, HDFS, Hive, Java (JDK1.6), Hadoop distribution of Cloudera, MapR, DataStax, IBM DataStage 8.1(Designer, Director, Administrator), Oracle 11g/10g, PL/SQL, SQL*PLUS, Toad

Confidential, Detroit, MI

J2EE/WEB Developer

Responsibilities:

  • Developed and implemented complex internet and intranet applications, performed website and portal monitoring.
  • Acted as an escalation point for production troubleshooting guidance.
  • Used noledge of web technologies to lead projects resulting in functional enhancements of web-based applications.
  • Evaluated systems specifications for client web site requirements, led design presentations, influenced direction and implemented teh most efficient and cost-effective software/package solution. Coordinated wif system partners outside teh group. Performed web-enabled database development and module design.
  • Used Struts MVC to handle/intercept teh user requests and usedvarious controllers to delegate teh request flow to teh Backend tier of teh application.
  • Developed and enhanced UI modules using JSP, JavaScript, CSS and JQuery.
  • Involved in writing complex SQL, Stored Procedures to handle teh persistence operations.
  • Developed DAO layers using FireStorm.
  • Involved in teh development of many Web Services using SOAP and WSDL to accommodate pricing for AOW.
  • Application is built using standard design patterns such as DAO, Abstract Factory, Singleton and MVC.
  • Used JUnit framework for Unit testing of application.
  • Involved in defect fixing during SIT and UAT phases of teh application.
  • Worked on Production Support and resolving Production Defects in timely manner.
  • Developed teh custom Logging framework used to log transactions executed across teh various applications using Log4j.
  • Used Clear Quest for defect tracking and PAC2000 for user tickets.
  • Monitored production logs and errors through SPLUNK.
  • Involved in regression and stress testing.
  • Developed and monitored performance reports for different services using OpTier.
  • Actively participated and presented teh completed specifications during teh code reviews to ensure teh development is complete and follows teh corporate standards.

Environment: JDK 1.6, Struts 1.3, JSP, Servlets, Tomcat Application Server 6.x, Oracle 10g/11g, AJAX, CVS, Clear Case, DB Visualizer, JDBC, SOAP Web Services, XML, XSLT, CSS, DOM, HTML, JQuery, ANT, JUnit, Eclipse, OpTier, PAC2000, FireStorm.

Confidential, Des Moines, IA

J2EE Developer

Responsibilities:

  • Mavenized teh existing applications using Maven tool.
  • Used Nexus Repository to add teh required jar files to teh application as dependencies to teh pom.xml file.
  • Used JSF & Spring frameworks to interact wif teh front end.
  • Made many coding changes to various applications to support its migration to WAS 7.0.
  • Used WINSQL for teh DB2 database changes.
  • Participated in group sessions, design reviews, and code analyzing.
  • Documented teh steps, work around and issues while mavenizing and migrating to WAS 7.0.
  • Used Web Sphere Application server for deploying teh applications.
  • Used RAD IDE for developing, testing and deploying applications.
  • Used Clear Case, Tortoise Hg and SVN for version control.
  • Proactively communicate wif teh development and QA team to anticipate configuration management issues/processes.
  • Junit, log4j were used for unit testing and as logging frameworks.
  • Worked on configuring application specific sign-on's.

Environment: JDK 1.6, JSF1.2/2.0, Spring 2.5, JSP, Servlets, Hibernate, JPA, Websphere Application Server 6.0/6.1/7.0 10.3.4, AJAX, SVN, Clear Case, Tortoise Hg, JDBC, Web Services, XML, XSLT, CSS, DOM, HTML, Maven, ANT, DB2, JUnit, RAD 7.5/8.0, Nexus Repository, Mercurial.

Confidential, Memphis, TN

J2EE Developer

Responsibilities:

  • Used UML for developing Use Cases, Sequence Diagrams and preliminary Class Diagrams for teh system and involved in low-level design.
  • Extensively used Eclipse IDE for building, testing, and deploying applications.
  • Developed teh whole frame work for teh projects, based on Struts MVC & Spring MVC.
  • Developed teh presentation layer and GUI framework based on spring framework involving JSP, HTML, JavaScript, AJAX, CSS.
  • Developed a new screen for teh VAT using Icefaces.
  • Designed and developed a Batch process to for VAT.
  • Involved in writing JavaScript functions and implementation of AJAX on presentation layer.
  • Developed controllers, repositories, Service modules, form beans and validations.
  • Developed beans and persisted bean in teh database using JDBC and Hibernate.
  • Involved in connecting bean wif database using Hibernate configuration file.
  • Involved in development of Spring DAO layer which invoked database queries.
  • Developed Session Beans for teh transactions in teh application.
  • CreatedSQLqueries,PL/SQLStored Procedures, Functions for teh Database layer by studying teh required business objects and validating them wif Stored Procedures. Also used JPA wif Hibernate provider.
  • Written ANT scripts to build teh entire module and deploy it on Weblogic application Server.
  • Implemented JUnit framework to write test cases for different modules and resolved teh test findings.
  • Used Subversion for software versioning and as a revision control system.
  • Critical to planning and overseeing our software development activities, leading teams against competing deliverables, and actively identify production issues/bringing them to quick resolution.

Environment: JDK 1.6, Icefaces, DAO, JPA, JSP, Servlets, Hibernate, Weblogic 10.3.4, AJAX, SVN JDBC, Web Services, REST, XML, XSLT, CSS, DOM, HTML, ANT, DB2, MsSql,, UML, JUnit, JQuery, Toad, Maven.

Confidential 

Java Developer

Responsibilities:

  • Developed Admission & Census module, which monitors a wide range of detailed information for each resident upon pre-admission or admission to your facility.
  • Involved in comprehensive library of problems, goals and approaches. You have teh option of tailoring (adding, deleting, or editing problems, goals and approaches) these libraries and teh disciplines you will use for your care plans.
  • Involved in development of General Ledger module, which streamlines analysis, reporting and recording of accounting information. General Ledger automatically integrates wif a powerful spreadsheet solution for budgeting, comparative analysis and tracking facility information for flexible reporting.
  • Developed UI using HTML, JavaScript, and JSP, and developed Business Logic and Interfacing components using Business Objects, XML, and JDBC.
  • Designed user-interface and checking validations using JavaScript.
  • Managed connectivity using JDBC for querying/inserting & data management including triggers and stored procedures.
  • Developed various EJBs for handling business logic and data manipulations from database.
  • Involved in design of JSP’s and Servlets for navigation among teh modules.
  • Designed cascading style sheets and XML part of Order entry Module & Product Search Module and did client side validations wif java script.

Environment: J2EE, Java/JDK, JDBC, JSP, Servlets, JavaScript, EJB, JNDI, JavaBeans, XML, XSLT, Oracle 9i, Eclipse, HTML/ DHTML, SVN.

We'd love your feedback!