Hadoop Admin/developer Resume
Tampa, FL
SUMMARY:
- 6 years of professional IT experience with strong emphasis on object oriented analysis, design, development and implementation; Expertise in Java application development and Big Data & Hadoop ecosystems.
- Over 2 years of experience as Hadoop Developer with good knowledge on Hadoop, HDFS, MapReduce, Pig, Hive, HBase, Sqoop,Flume, Zookeeper and Oozie
- Experience in developing MapReduce Programs using Apache Hadoop for extracting and analysing the data stored across different nodes.
- Good knowledge on the Hadoop cluster architecture and monitoring the cluster.
- Implemented proofs of concept on Hadoop stack
- Working knowledge on major Hadoop ecosystems such as PIG, HIVE, HBASE and Cloudera
- Experience in developing PIG Latin Scripts and using Hive Query Language
- Experience working on NoSQL databases (Cassandra and HBase)
- Experience using Sqoop to import data into HDFS from RDBMS and vice - versa
- Around 4 years of experience in Core Java programming with hands-on in Java Server Pages framework and web technologies like HTML, JavaScript, CSS and XML.
- Experience in database development using SQL and experience working on databases like Oracle 9i/10g and MySQL.
- Excellent interpersonal skills, good experience in interacting with clients with good team player and problem solving skills.
TECHNICAL SKILLS
Hadoop/Big Data Technologies: Hadoop, HDFS, MapReduce, HBase, Pig, Hive, Sqoop, Flume, Cassandra, Oozie, Avro and Zookeeper
Programming Languages: Java, C, C++ and COBOL
Scripting/Web Technologies: JavaScript, HTML, XML, Shell Scripting and CSS
ETL/BI Tools: Pentaho, SAS Enterprise Miner, Rapid Miner and Weka
Databases: Oracle 9i/10g/11g, MySQL and HBase
Operating Systems: Linux, Unix and Windows
Additional Skills: Data mining algorithms, Statistics concepts, Tableau and R
PROFESSIONAL EXPERIENCE
Hadoop Admin/Developer
Confidential, Tampa, FL
Responsibilities
- Installed and configured Apache Hadoop to test the maintenance of log files in Hadoop cluster
- Developed Java MapReduce programs for the analysis of sample log file stored in cluster
- Load data from various data sources into HDFS using Flume.
- Worked on Cloudera to analyze data present on top of HDFS
- Worked extensively on Hive and PIG
- Worked on large sets of structured, semi-structured and unstructured data
- Use of Sqoop to import and export data from HDFS to Oracle RDBMS and vice-versa
- Developed PIG Latin scripts to play with the data
- Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way.
- Good knowledge on reading data from HBase and also writing to it.
Environment: Apache Hadoop, HDFS, Cloudera Manager (CDH3), MapReduce, Eclipse, Hive, PIG, HBase, Sqoop, Flume, Oozie, WinSCP, Java, Eclipse and Linux
Hadoop Developer
Confidential, St.Louis, MO
Responsibilities
- Importing and exporting data into HDFS and Hive using Sqoop
- Involved in defining job flows, managing and reviewing log files.
- Extracted files from Oracle through Sqoop and placed in HDFS and processed.
- Load and transform large sets of structured, semi structured and unstructured data
- Responsible to manage data coming from different sources.
- Supported Map Reduce Programs those are running on the cluster
- Involved in loading data from UNIX file system to HDFS.
- Configured Pig and also written Pig queries and UDFs.
- Involved in creating Hive tables, loading with data and writing Hive queries which will run internally in Map Reduce way.
Environment: Java, Hadoop, MapReduce, Pig, Hive, Linux, Sqoop, Eclipse and Cloudera CDH3
Java Developer
Confidential, Farmington, CT
Responsibilities
- Involved in the Research and Development of the “pilot “project.
- Involved in Requirement Analysis and documentation on Requirement Specification.
- Developed a prototype to identify the possible occurrences of ICD-9 codes in the entire product.
- Researched on using scripts and other technologies such as Hadoop MapReduce to automate this project
- Identified the instances of ICD-9 codes in thousands of Java, COBOL, HTML, JavaSript, XML programs and scripts.
- Identified the instances of ICD-9 codes in database tables and stored procedures.
- Created design documents that include changes to be done by the programmers for ICD-9 to ICD-10 migration.
- Involved in the modification of Java programs to ensure that the lines of code that refers ICD-9 codes to be changed to support the new ICD-10 format.
- Involved in the code deployment, unit test and test case preparation for QA teams.
Environment: Java, HTML, JavaScript, XML, COBOL, UNIX scripts, PERL, PL/SQL, MS Office and WinSCP
Java Developer
Confidential, Birmingham, AL
Responsibilities
- Involved in many phases of SDLC such as requirements analysis, preparation of specifications document, design, development, deployment and unit test
- Designed implementation logic for core functionalities and screen validations
- Developed service layer logic for core modules using JSPs, Involved in implementation of presentation layer logic using HTML, CSS, JavaScript and XML
- Design of Oracle database tables to store customer's general and billing details
- Used JDBC connections to store and retrieve data from the database.
- Development of complex SQL queries and stored procedures to process and store the data
- Used ANT, a build tool to configure application
- Developed test cases using HP Quality Center
- Involved in code deployment, unit testing and bug fixing.
- Prepared design documents for code developed and defect tracker maintenance.
Environment: Java Server Pages (JSP), Java, HTML, CSS, XML, JavaScript, Apache Tomcat, Ant, Oracle
Software Engineer
Confidential
Responsibilities
- Maintained the UI screens using web technologies like HTML, JavaScript, JQuery and CSS
- Worked on the entire SDLC while working on few enhancements
- Provided regular updates to the customers on the status of enhancements
- Coding of assigned task and peer review
- Documented the changes for future development projects
- Prepared test cases for QA team
- Collaborated with QA team in testing the applications
- Involved in code deployment, unit testing and bug fixing.
- Prepared design documents for code modified and ticket maintenance.
Environment: Java, HTML, CSS, XML, JavaScript, JQuery, Apache Tomcat, Ant, SQL