Hadoop Developer Resume
Woburn, MA
SUMMARY
- 6+ years of total IT with hands on experience of Hadoop Big Data development experience
- Good Exposure on Apache Hadoop Map Reduce programming, PIG Scripting and Distribute Application and HDFS
- Working knowledge in HDFS Admin Shell commands.
- Experience in Object Oriented Analysis and Design (OOAD) using UML (Use Cases, Activity, Sequence, Class Diagrams etc.).
- Hands on development experience with RDBMS, including writing complex SQL queries, PLSQL, views, stored procedure, triggers, etc.
- Working experience in Map Reduce programming model and Hadoop Distributed File Systems.
- Excellent understanding and knowledge of NOSQL databases like MongoDB, HBase, and Cassandra.
- Working experience in Pig Latin, a Scripting Language for Hadoop Distributed File system.
- Hands on experience in installing, configuring Cloudera Apache Hadoop ecosystem components like Flume, Hbase, Zoo Keeper, Oozie, Hive, Sqoop and Pig.
- Knowledge of writing Hive Queries to generate reports using Hive Query Language.
- Good understanding of all stages of Software Development Life Cycle (SDLC)
- Experience in Object Oriented Analysis and Design (OOAD) using UML (Use Cases, Activity, Sequence, Class Diagrams etc.).
- Hands on development experience with RDBMS, including writing complex SQL queries, PLSQL, views, stored procedure, triggers, etc.
- Strong analytical design and development skills
- Excellent communication and interpersonal skills
TECHNICAL SKILLS
Programming Languages: C/C++, Core Java,.NET
Scripting Languages: HTML, Java Script, VB, CSS
Database Design: SQL, Oracle
Operating Systems: Windows XP/ Vista/7/8, Linux, UNIX
Software Applications: MSOffice suite, Adobe Flex
Hadoop Big Data: Map Reduce, High - performance computing, Android App Development, MVC Framework, Design JSP, OOP Apache/Tomcat/IIS, AVRO Flume, Hbase, Zoo Keeper, Oozie, Hive, Sqoop and Pig
PROFESSIONAL EXPERIENCE
Confidential, Woburn, MA
Hadoop Developer
Responsibilities:
- Worked onHadoopcluster which ranged from 4-8 nodes during pre-production stage and it was sometimes extended up to 20nodes during production
- Installed and configured HadoopMapreduce, HDFS, Developed multiple MapReduce jobs in java for data cleaning and preprocessing.
- Established custom MapReduce programs in order to analyze data and usedPig Latinto clean unwanted data
- Did various performance optimizations like using distributed cache for small datasets, Partition, Bucketing in hive and Map Side joins.
- Built reusableHiveUDF libraries.
- UsedSqoopto import the data from RDBMS toHadoopDistributed File System (HDFS) and later analyzed the imported data usingHadoopComponents.
- CreatedHive tables, then appliedHiveQLon those tables, this will invoke and run MapReduce jobs automatically
- Performedloading and transforming large sets of Structured, Semi-Structured and Unstructured data and analyzed them by running Hive queries and Pig scripts
- InstalledOozie workflowengine to run multiple Hive and Pig jobs which run independently with time and data availability
- Performed Hadoopinstallation,updates, patches and version upgrades when required
- Bug fixing and 24x7production support
Environment: Hadoop, MapReduce, HDFS, Java 6, Hadoop distribution of Cloudera Manager v4.7.1, Hadoop CDH4.4, Hive, Pig, Hbase, Flume, Oozie, Centos 6.3/6.4, Java Web Services, UNIX/LINUX Shell Scripting.
Confidential
Hadoop Admin/Developer
Responsibilities:
- Installed and configured Hadoop MapReduce, HDFS, Developed multiple mapreduce jobs in java for data cleaning and preprocessing.
- Importing and exporting data into HDFS and Hive using Sqoop
- Experienced in defining job flows
- Experienced in managing and reviewing Hadoop log files
- Responsible to manage data coming from different sources
- Supported Map Reduce Programs those are running on the cluster
- Involved in loading data from UNIX file system to HDFS.
- Installed and configured Hive and also written Hive UDFs.
- Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way
Environment: Hadoop, HDFS, Map Reduce, Hive, pig, DB2, Oozie, MySQL, XHTML, Java Script, JQuery, Web Services
Confidential
Senior Software Developer
Responsibilities:
- Developing application, modification, database design (create tables, store procedures, functions) as per requirements
- Coding for various modules, error handling, modification and testing
Environment: VB.NET, AJAX, Active Report, VB 6, SQL, PL/SQL, C++, C, JavaScript, VBScript, HTML, CSS, MS SQL Server 2008/2005/7.0/6.5 , MS Access, Crystal Reports Enterprise, Windows 7, Windows Vista, XP, Win 2003, NT
Confidential
Senior Software Developer
Responsibilities:
- Developing application, modification, database design (create tables, store procedures, functions) as per requirements
- Coding for various modules, error handling, modification and testing
Environment: JSP, Servlets, Java Beans, XML, UML, AJAX, MySql, Tomcat
Confidential
Senior Software Developer
Responsibilities:
- Developing application, modification, database design (create tables, store procedures, functions) as per requirements
- Coding for various modules, error handling, modification and testing
Environment: JSP, Servlets, Java Beans, XML, UML, AJAX, MySql, Tomcat
Confidential
Software Developer
Responsibilities:
- Analysis, developing application, modification, bug solving
- Coding for various modules, error handling, modification and testing
Environment: JSP, JavaScript, Servlets, Java Beans, XML, AJAX, UML, MySql, Tomcat