Hadoop Developer Resume
NJ
SUMMARY:
- 8+ years of extensive experience in the IT Industry which includes Big Data Analytics, Hadoop implementations, and Java.
- 2+ yearsof experience withHadoop,HDFS,MapReduceand Hadoop Ecosystem (Pig,Hive, andSqoop).
- Extensive hands on experience with working level knowledge on Big data and NoSQL (Not Only SQL) technologies including: Hadoop, Hive, HBase, Flume, Map Reduce using Java, HDFS (Hadoop Distributed File System), Master - Slave architectural model, Clustering, Node management etc.
- Strong working experience with Hadoop Architecture and the components of Hadoop - MapReduce, HDFS, JobTracker, TaskTracker, NameNode and DataNode.
- Experience in setting up Hadoop clusters, both in-house as well as on the cloud (Amazon EC2).
- Capturing data from existing databases that provide SQL interfaces using Sqoop.
- Efficient in building hive, pig and map Reduce scripts to analyze data.
- Extending Hive and Pig core functionality by writing custom UDFs.
- Successfully loaded files to Hive and HDFS from SQLServer, HBase.
- Loaded the dataset into Hive for ETL Operation.
- Good knowledge on Hadoop Cluster architecture and monitoring the cluster.
- In depth knowledge of database concepts and programming practices using SQL.
- Experience in database design using Stored Procedure, Functions, Triggers and strong experience in writing complex queries for SQL Server, MySQL.
- Experience with ETL tools (Informatica, SSIS).
- Good knoledge of IBM Infosphere and Big Insight Tools
- Having strong Object Oriented Design experience in JAVA and PHP.
- Hands on experience in application development using Java, RDBMS, and Linux shell scripting.
- Worked extensively in Java, J2EE, XML, JDBC, MVC, Spring2.0, Design Patterns and UML, PHP, JQuery, JavaScript, HTML 5, CSS.
- Excellent analytical, problem solving, communication and interpersonal skills with ability to interact with individuals at all levels and can work as a part of a team as well as independently.
- Ability to perform at a high level, meet deadlines, adaptable to ever changing priorities.
TECHNICAL SKILLS:
Hadoop: HDFS, Pig, Hive, HBase, Sqoop, MapReduce, Flume, HUE, Zookeeper, Oozie.
Hadoop Distribution: Cloudera, Raw Hadoop Installation
Programming Languages: Java, PHP, Shell Script
Web Technologies: HTML, CSS, JavaScript, JQuery, Dojo, AJAX.
Platforms: Windows XP/7, UNIX/LINUX/SOLARIS, MAC.
Databases: Oracle 11g/10g/9i, MySQL 5.2, SQL Server 2000/2005/2008, MS Access, Teradata
ETL Tools: Informatica, SSIS.
Tools: SQL developer Management Studio, TOAD, Eclipse, IBM Big Insight
WORK EXPERIENCE:
Confidential, NJ
Hadoop Developer
Responsibilities:
- Worked on analyzing Hadoop cluster and different big data analytic tools including Pig, Hbase NoSQL database and Sqoop.
- Implemented nine nodes CDH3Hadoop cluster on Centos LINUX.
- Installed and configured Hadoop Map Reduce, HDFS, Developed multiple Map Reduce jobs in java for data cleaning and pre-processing.
- Importing and exporting data in HDFS and Hive using Sqoop.
- Extracted files from Oracle 11g through Sqoop and placed in HDFS and processed.
- Experience with NoSQL databases.
- Installed and configured Hive and also written Hive UDFS.
- Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way.
- Involved in the regular Hadoop Cluster maintenance such as patching security holes and updating system packages.
- Synchronized different configuration files of hadoop cluster nodes across the system.
- Configured the MapReduce property to make sure local temporary storage is using large disk partitions.
- Analyzed the web log data using the HiveQL.
Environment: Java 6, Eclipse, Hadoop, Hive, Hbase, Oracle 11g, Linux, Map Reduce, HDFS, Shell Scripting, MySQL.
Confidential, Philadelphia, PA
Hadoop Developer
Responsibilities:
- We have written Map/Reduce programs, Pig scripts to specify the conditions to separate the fraudulent claims.
- These conditions were derived after processing the past 20 years of health care data that we possesses.
- This data was exported into HDFS using Sqoop.
- Hive was used to integrate with Micro-Strategy - to produce results quickly based on the report that was requested.
- Flume was used to collect the logs with error messages across the cluster.
- Oozie and Zoo-keeper were used to manage the flow of jobs and coordination in the cluster respectively.
- LZO compression technique was used to make optimum utilization of the network bandwidth.
- Played a key-role is setting up a Hadoop cluster (in-house).
- Lead a team which consisted of 3 resources.
- Worked on a stand-alone as well as a distributed Hadoop.
- Worked on a Cloudera Hadoop distribution.
- Updated the classification levels that were achieved on the data every day to the on-site team.
Environment: JAVA, HADOOP, HIVE, PIG, SQOOP, FLUME, HBASE, IBM InfoSphere, IBM Big Insight Tools.
Confidential, MA
Java/J2EE Developer
Responsibilities:
- Created Java Server Pages for client presentation and interaction with business layer.
- Developed Perl scripts for doing implementing automated tasks on UNIX systems.
- Implemented the web layer with Struts for a module for authorization.
- Involved in developing interface for WEB pages like user registration, login, registered access control for users depending on logins using HTML and Java Script.
- Deployed servlets and JSPs and fine-tuned them for better performance.
- Designed and Developed web services to maintain a data cache for the frequently used data.
- Responsible for functional requirements and technical designing, designed customized screens, developed SMTP mail services and easy Web Self Service.
- Developed and Deployed Java Servlets and JSP for Dynamic HTML generation and for session management using Weblogic.
- User Authentication privileges using JAAS Login Module.
- Used Spring framework to auto wire/inject components and also configure the batch jobs
- Designed JNDI Component for data base communication and message service.
- Implemented ANT tool varying its versions depends on latest Mile stones.
- To keep track of latest Versions implemented CVS Structure.
- Generated few dynamic Tag Libs and implemented MVC design patterns using Java Struts.
- Preformed Unit Testing using JUnit and designed test cases.
Environment: J2EE, JavaScript, HTML, JSP, Servlets, JDBC, Oracle, REST, Spring, CVS, XML, XSL, Rational Rose, Eclipse2.0, UNIX Scripts, UNIX, Web logic 7.1
Confidential, OH
Java / J2EE Developer
Responsibilities:
- Created JSP pages to get user information such as and other details.
- Struts Framework was used in creating the front-end application and providing proper validations using validator plugin. Custom validations were written for some fields.
- Team orchestration to effectively carry out all project activities such as analysis & design, coding, integration and testing.
- Tortoise SVN was used as the Version Control Software.
- Database Queries were handled using SQL PLUS.
Environment: J2EE, JSP 2.2, Struts, Eclipse, SQL, Starteam 7.0, XML, Tomcat, HTML, JavaScript, Windows 2000, UNIX.
ConfidentialSoftware Developer
Responsibilities:
- Software development life cycle: analysis, detail design, development, system and integration testing.
- Wrote JavaScript functions to validate input fields.
- Developed using design patterns like MVC, Singleton Factory etc.
- Developed and deployed the application on Tomcat Server
- Wrote SQL statements to update and fetch data from the database.
- Performed Unit testing using JUnit.
- Reviewed and modified design documents.
- Was involved in Code review and integration testing.
Environment: Java, Jsp, MVC, SQL, Junit, JavaScript.
