We provide IT Staff Augmentation Services!

Hadoop Developer Resume

0/5 (Submit Your Rating)

San Mateo, CA

SUMMARY

  • Eight years of experience with emphasis on Big Data Technologies, Design and Development of Java based enterprise applications.
  • Three years of experience in Hadoop Development and fiveyears of java application development.
  • Experience in installation, configuration, supporting and managing Hadoop clusters.
  • Up to date on evaluating new analytical tools and projects coming up big data space like Apache Spark and Apache Shark, Datameer, Platfora etc.
  • Implemented in setting up standards and processes for Hadoop based application design and implementation.
  • Responsible for writing MapReduce programs.
  • Logical Implementation and interaction with HBase.
  • Developed MapReduce jobs to automate transfer of data from HBase.
  • Perform data analysis using Hive and Pig.
  • Load log data into HDFS using Flume.
  • Gained good knowledge on creating strategies on risky transactions.
  • Assist with the addition of Hadoop processing to the IT infrastructure.
  • Support development, testing, and operations teams during new system deployments.
  • Evaluate and propose new tools and technologies to meet the needs of the organization.
  • Experience in using Scoop, ZooKeeper and Cloudera Manager.
  • Good Knowledge on Hadoop Cluster architecture and monitoring the cluster.
  • 24/7 operational support to production servers and related infrastructure clusters.
  • Experience in Administering, Performance Monitoring and Fine - tuning of Linux Redhat.
  • Worked on debugging tools such as Dtrace, Struss and Top. Expert in setting up SSH, SCP, SFTP connectivity between UNIX hosts.

TECHNICAL SKILLS

Programming Languages: Java, C++,SQL, PIG,PL/SQL.

Java Technologies: Java, JAXP, AJAX, JFC Swing, Log4j, Java Help API

J2EE Technologies: JSP Servlets, JDBC,JNDI, XML, JAXP, Java Beans

Methodologies: Agile, UML, Design Patterns (Core & J2EE)

Frame Works: Jakarta Struts, JUnit and JTest, LDAP.

Databases: Oracle, NO SQL (HBase), MY SQL,MS SQL server.

Application Server: Apache Tomcat, Jboss

IDE’s & Utilities: Eclipse and JCreator, NetBeans.

Web Dev. Technologies: HTML, Java Script, XML, DTD, XSL, XSLT, XPath, DOM, XQuery.

Protocols: TCP/IP, HTTP and HTTPS.

Operating Systems: Linux, MacOS, WINDOWS.

Hadoop ecosystem: Hadoop and MapReduce, Spark, Sqoop, Hive, PIG, HBASE, HDFS, Flume, Hue, Zookeeper, Lucene, Sun Grid Engine Administration.

PROFESSIONAL EXPERIENCE

Confidential, San Mateo, CA

Hadoop Developer

Responsibilities:

  • Worked on analyzing Hadoop cluster and different big data analytic tools including Pig, Hbase database and Sqoop.
  • Responsible for building scalable distributed data solutions using Hadoop.
  • Implemented nine nodes CDH3 Hadoop cluster on Red hat LINUX.
  • Involved in loading data from LINUX file system to HDFS.
  • Created HBase tables to store variable data formats of PII data coming from different portfolios.
  • Implemented a script to transmit sysprint information from Oracle to Hbase using Sqoop.
  • Implemented best income logic using Pig scripts and UDFs.
  • Implemented test scripts to support test driven development and continuous integration.
  • Developed the technical strategy of using Apache Spark on Apache Mesos as a next generation, Big Data and “Fast Data” (Streaming) platform
  • Up to date on evaluating new analytical tools and projects coming up big data space like Apache Spark and Apache Shark, Datameer, Platfora etc.
  • Worked on tuning the performance Pig queries.
  • Responsible to manage data coming from different sources.
  • Involved in loading data from UNIX file system to HDFS.
  • Load and transform large sets of structured, semi structured and unstructured data
  • Cluster coordination services through Zookeeper.
  • Experience in managing and reviewing Hadoop log files.
  • Job management using Fair scheduler.
  • Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team.
  • Responsible for cluster maintenance, adding and removing cluster nodes, cluster monitoring and troubleshooting, manage and review data backups, manage and review Hadoop log files.
  • Installed Oozie workflow engine to run multiple Hive and pig jobs.
  • Analyzed large amounts of data sets to determine optimal way to aggregate and report on it.
  • Supported in setting up QA environment and updating configurations for implementing scripts with Pig and Sqoop.

Environment: Hadoop, HDFS, Pig, Sqoop, HBase, Spark, Shell Scripting, Ubuntu, Linux Red Hat, HadoopDistribution of HortonWorks.

Confidential, Philadelphia, PA.

Hadoop Developer

Responsibilities:

  • Involved in review of functional and non-functional requirements.
  • Facilitated knowledge transfer sessions.
  • Importing and exporting data into HDFS and Hive using Sqoop.
  • Experienced indefining jobflows.
  • Experienced in managing andreviewingHadooplog files.
  • Extracted files from Couch DB through Sqoop and placed in HDFS and processed.
  • Experienced in runningHadoopstreaming jobs to process terabytes of xml format data.
  • Load and transform large sets of structured, semi structured and unstructured data.
  • Responsible to manage data coming from different sources.
  • Got good experience with NOSQL database.
  • Supported Map Reduce Programs those are running on the cluster.
  • Involved in loading data from UNIX file system to HDFS.
  • Installed and configured Hive and also written Hive UDFs.
  • Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way.
  • Gained very good business knowledge on health insurance, claim processing, fraud suspect identification, appeals process etc.
  • Developed a custom FileSystem plug in for Hadoop so it can access files on Data Platform.
  • This plugin allows Hadoop MapReduce programs, HBase, Pig and Hive to work unmodified and access files directly.
  • Designed and implemented Mapreduce-based large-scale parallel relation-learning system
  • Extracted feeds form social media sites such as Facebook, Twitter using Python scripts.
  • Setup and benchmarked Hadoop/HBase clusters for internal use
  • Setup Hadoop cluster on Amazon EC2 using whirr for POC.

Environment: Java, Eclipse, Oracle, Sub Version, Hadoop, Hive, HBase, Linux, MapReduce, HDFS, Hive, Java, HadoopDistribution of HortonWorks, MapReduce, DataStax, IBM DataStage 8.1, Oracle, PL/SQL, SQL*PLUS, Toad, Windows NT, UNIX Shell Scripting.

Confidential, Chicago, IL

Hadoop Developer

Responsibilities:

  • Worked on analyzing Hadoop cluster using different big data analytic tools including Pig, Hive, and MapReduce
  • Collecting and aggregating large amounts of log data using Apache Flume and staging data in HDFS for further analysis
  • Implemented nine nodes CDH3 Hadoop cluster on Red hat LINUX.
  • Involved in loading data from LINUX file system to HDFS.
  • Created HBase tables to store variable data formats of PII data coming from different portfolios.
  • Implemented a script to transmit sysprin information from Oracle to Hbase using Sqoop.
  • Implemented best income logic using Pig scripts and UDFs.
  • Worked on debugging, performance tuning of Hive & Pig Jobs
  • Created Hbase tables to store various data formats of PII data coming from different portfolios
  • Implemented test scripts to support test driven development and continuous integration
  • Worked on tuning the performance Pig queries
  • Involved in loading data from LINUX file system to HDFS
  • Importing and exporting data into HDFS and Hive using Sqoop
  • Experience working on processing unstructured data using Pig and Hive
  • Supported MapReduce Programs those are running on the cluster
  • Gained experience in managing and reviewing Hadoop log files
  • Involved in scheduling Oozie workflow engine to run multiple Hive and pig jobs
  • Created and maintained Technical documentation for launching HADOOP Clusters and for executing Hive queries and Pig Scripts

Environment: Hadoop, HDFS, Pig, Hive, MapReduce, Sqoop, Oozie, Cloudera, LINUX, and Big Data

Confidential, Winston Salem, NC

Hadoop and Java Developer

Responsibilities:

  • Worked with several clients with day to day requests and responsibilities.
  • Installed/Configured/Maintained Apache Hadoop clusters for application development and Hadoop tools like Hive, Pig, HBase, Zookeeper and Sqoop.
  • Involved in analyzing system failures, identifying root causes and recommended course of actions.
  • Worked on Hive for exposing data for further analysis and for generating transforming files from different analytical formats to text files.
  • Wrote the shell scripts to monitor the health check of Hadoop daemon services and respond accordingly to any warning or failure conditions.
  • Managing and scheduling Jobs on a Hadoop cluster.
  • Implemented and maintained various projects in Java.
  • Utilized Java and MySQL from day to day to debug and fix issues with client processes.
  • Developed, tested, and implemented financial-services application to bring multiple clients into standard database format.
  • Assisted in designing, building, and maintaining database to analyze life cycle of checking and debit transactions.
  • Excellent JAVA, J2EE application development skills with strong experience in Object Oriented Analysis, Extensively involved throughout Software Development Life Cycle (SDLC).
  • Strong experience of J2SE, XML, Web Services, WSDL, SOAP, UDDI, TCP, IP.
  • Strong experience of software and system development using JSP, Servlet, Java Server Face, EJB, JDBC, JNDI, Struts, Maven, Trac, Subversion, JUnit, SQL language.
  • Rich experience of database design and hands-on experience of large database systems: Oracle 8i and Oracle 9i, DB2, PL, SQL.
  • Hands-on experience of Sun One Application Server, Web logic Application Server, Web Sphere Application Server, Web Sphere Portal Server, and J2EE application deployment technology.

Environment: Hive, Pig, HBase, Zookeeper, Sqoop,Cloudera,Java, JDBC, JNDI, Struts, Maven, Trac, Subversion, JUnit, SQL language, spring, Hibernate, Junit, Oracle, XML, Altova XmlSpy, Putty and Eclipse.

Confidential, New York, NY

Java/JEE Architect/developer

Responsibilities:

  • Architected a JSF, Web sphere, Oracle, spring, and Hibernate based 24x7 Web application.
  • Built an end to end vertical slice for a JEE based billing application using popular frameworks like Spring, Hibernate, JSF, Facelets, XHTML, Maven2, and Ajax by applying OO design concepts, JEE &GoF design patterns, and best practices.
  • Integrated other sub-systems like loans application, equity markets online application system, and documentation system with the structured products application through JMS, Websphere MQ, SOAP based Web services, and XML.
  • Designed the logical and physical data model, generated DDL scripts, and wrote DML scripts for Oracle 9i database.
  • Tuned SQL statements, Hibernate mapping, and Websphere application server to improve performance, and consequently met the SLAs.
  • Gathered business requirements and wrote functional specifications and detailed design documents.
  • Improved the build process by migrating it from Ant to Maven2.
  • Built and deployed Java applications into multiple Unix based environments and produced both unit and functional test results along with release notes.

Environment: Java 1.5, JSF Sun RI, Facelets, Ajax4JSF, Richfaces, Spring, XML, XSL, XSD, XHTML, Hibernate, Oracle 9i, PL/SQL, MINA, Spring-ws, SOAP Web service, Websphere, Oracle, JMX, ANT, Maven2, Continuum, JUnit, SVN, TDD, and XP.

Confidential

Java developer

Responsibilities:

  • Developed Admission & Census module, which monitors a wide range of detailed information for each resident upon pre-admission or admission to your facility.
  • Involved in development of Care Plansmodule, which provides a comprehensive library of problems, goals and approaches. You have the option of tailoring (adding, deleting, or editing problems, goals and approaches) these libraries and the disciplines you will use for your care plans.
  • Involved in development of General Ledgermodule, which streamlines analysis, reporting and recording of accounting information. General Ledger automatically integrates with a powerful spreadsheet solution for budgeting, comparative analysis and tracking facility information for flexible reporting.
  • Developed UI using HTML, JavaScript, and JSP, and developed Business Logic and Interfacing components using Business Objects, XML, and JDBC.
  • Designed user-interface and checking validations using JavaScript.
  • Managed connectivity using JDBC for querying/inserting & data management including triggers and stored procedures.
  • Developed various EJBs for handling business logic and data manipulations from database.
  • Involved in design of JSP’s and Servlets for navigation among the modules.
  • Designed cascading style sheets and XML part of Order entry Module & Product Search Module and did client side validations with java script.

Environment: J2EE, Java/JDK, JDBC, JSP, Servlets, JavaScript, EJB, JNDI, JavaBeans, XML, XSLT, Oracle 9i, Eclipse, HTML/ DHTML,SVN.

We'd love your feedback!