Hadoop Developer Resume
CA
SUMMARY
- About 8 years of experience in IT industry that includes about 2+ years of as Hadoop Developer (with knowledge of Sqoop, Pig, Hive, HBase, Flume)
- 8 years of diversified experience in Information Technology including PL/SQL, System Analysis, Development. Strong Database and Testing concepts.
- Experience in developing, designing, testing and maintaining object oriented application.
- Expertise in Hadoop echo systems HDFS, Map Reduce, Pig, Sqoop and Hive for scalability, distributed computing and high performance computing.
- Strong knowledge on creating and monitoring Hadoop clusters on EC2, VM, CDH3, CDH4 Cloudera Manager on Linux, Ubuntu OS etc.
- Experience in developing PIG Latin Scripts and using Hive Query Language for data Analytics.
- Strong knowledge in NOSQL column oriented databases like HBase and its integration with Hadoop cluster
- Good working experience using Sqoop to import data into HDFS from RDBMS and vice - versa.
- Good knowledge in using job scheduling and monitoring tools like Oozie and ZooKeeper
- Well versed in Core Java.
- Extensive experience in Software development life Cycle (SDLC)
- Having Good knowledge on Single node and Multinode Cluster Configurations.
- Knowledge of MS SQL and MS access.
- Sound network security and management concepts.
- A very good team player with the ability to work independently
- A competent, co-operative and result driven IT consultant possessing excellent interpersonal, written and oral communication skills
- Good analytical and debugging skills; systematic approach to programming tasks; good interpersonal skills
TECHNICAL SKILLS
Specialties: Hadoop, Big Data, PL / SQL Database, Oracle E Business suite (Oracle iRecruitment) Data Integration, Data Quality, Databases, Quality Control and Quality Assurance
Databases: Oracle, MySql, HBase
Languages: Java, SQL, Sqoop, Hadoop, Pig, Eclipse, Hive, YARN,Zookeeper,oozie, HTML, XML, Javascript
Operating System: Ms-Windows & UNIX
Languages: SQL, PL/SQL, Shell Scripting
FTP Tools: FileZilla, Putty
Other tools: SQL Developer, TOAD 7.6/8.5, MS Office (Access, Excel, Power Point, Word)
PROFESSIONAL EXPERIENCE
Confidential, CA
Hadoop Developer
Responsibilities:
- Application installation of Hadoop, Hive, MapReduce & Sqoop
- Involved in moving all log files generated from various sources to HDFS for further processing through Flume.
- HDFS support and maintenance and Adding/Removing a Node, Data Rebalancing.
- Developed MapReduce application using Hadoop, MapReduce programming and Hbase.
- Created Hive tables to store the processed results in a tabular format.
- Involved in developing the Pig scripts
- Involved in developing the Hive Reports.
- Involved in writing Mapreduce programs and tested using MRUnit.
- Analyzed large amounts of data sets to determine optimal way to aggregate and report on it.
- Participate in requirement gathering and analysis phase of the project in documenting the business requirements by conducting workshops/meetings with various business users.
Confidential, Hoffman Estates, IL
Hadoop Developer / Support
Responsibilities:
- Involved in Design and Development of technical specifications using Hadoop technology.
- Involved in moving all log files generated from various sources to HDFS for further processing.
- Written the Apache PIG scripts to process the HDFS data.
- Created Hive tables to store the processed results in a tabular format.
- Monitoring Hadoop scripts which take the input from HDFS and load the data into Hive.
- Created external tables in Hive.
Confidential, Bolingbrook, IL
Java/Hadoop Developer
Responsibilities:
- Analyzed Hadoop clusters, other analytical tools used in big data like Hive, Pig and databases like HBase.
- Used Hadoop to build scalable distributed data solution
- Extracted feeds form social media sites such as Facebook, Twitter using Flume
- Used Sqoop extensively to ingest data from various source systems into HDFS.
- Extracted feeds form social media sites such as Facebook, Twitter using Flume
- Used Sqoop extensively to ingest data from various source systems into HDFS.
- Written Hive queries for data analysis to meet the business requirements
- Created Hive tables and worked on them using Hive QL.
- Installed cluster, worked on commissioning & decommissioning of Datanode, Namenode recovery, capacity planning, and slots configuration
- Assisted in managing and reviewing Hadoop log files
- Assisted in loading large sets of data (Structure, Semi Structured, Unstructured)
- Implemented Hadoop cluster on Ubuntu Linux
- Installed and configured Flume, Sqoop, Pig, Hive, HBase on Hadoop clusters
- Managed Hadoop clusters include adding and removing cluster nodes for maintenance and capacity needs.
- Wrote test cases in JUnit for unit testing of classes
- Involved in templates and screens in HTML and JavaScript.
Confidential, Plano, TX
QA- Product Ads Auditor
Responsibilities:
- Understanding the Functional Requirements and Specifications.
- Creation of Test Cases and execution of Test cases.
- Experience in reviewing the Test Case documents.
- Performed Functional, Integration, System Testing.
- Identifying the test cases for automation.
- Responsible for sending daily and weekly status report.
Confidential
Quality Assurance (QA)
Responsibilities:
- Understanding the Functional Requirements and Specifications.
- Creation of Test Cases and execution of Test cases.
- Experience in reviewing the Test Case documents.
- Performed Functional, Integration, System Testing.
- Identifying the test cases for automation from manual test case list.
- Writing and executing the automation test scripts.
- Performed Defect logging and Tracking.
- Used SQL queries for database check.
- Responsible for sending daily status report.
Confidential, Tempe, AZ
PL SQL Programmer
Responsibilities:
- Design and Developing of workflow procedures.
- Has done many migrations of project’s application interfaces.
- Was responsible for handling the Billing application and related Change requests.
- Implemented PL and SQL queries, triggers and Stored Procedures as per the design and development related requirements of the project.
- Has done end to end testing of the applications and Error casual analysis.
- Has done proper documentation of the application I’ve developed, for better future understanding.
- Prepare project-phase plans and implementation schedule, plan and conduct meeting and workshops relative to the project plans, and communicate day to day project status to all levels of management.