Hadoop Developer Resume
Mountain View, CA
SUMMARY
- 11 years of IT experience which includes 3 years in big data development. My overall development includes requirement gathering, design, development, testing, implementation and maintenance using programming language Java and scripting languages Perl, PHP, Python, Shell scripting, Linux, cloud based platforms, bash profile, Javascript.
- Experience in database design and development in SQL, MYSQL, NOSQL i.e HBase, Cassandra, MONGODB.
- Experience in development of Big Data projects using Hadoop MapReduce, Hive, Sqoop, Oozie, Spark and other open source tools/technologies.
- Experience in developing web services using REST implementation.
- Experience in writing HiveQL queries to store processed data into Hive tables for analysis.
- Bachelor of Engineering, Computer Science from Sreenidhi institute of science and technology (2000 - 2004), JNTU University, Hyderabad, India.
TECHNICAL SKILLS
Client side technologies: HTML, Javascript, CSS, XML, AJAX,JQUERY, JSON
Languages: Java, PERL, PHP, Python, Shell scripting, PLSQL, Bash, web services implementation using REST Api’s
Big data Tools: Hadoop, Hive, Map Reduce,Scoop, oozie, HQL, Apache Spark, Flume, Tableau
Version Control Tools: Clearcase, CVS, GIT
Operating Systems: Windows, Unix, Linux, Solaris, VM (virtual machines), MAC, Cloud based
Databases: SQL, ORACLE, MYSQL, Hive, MONGODB, Cassandra
Bug tracking tools: BUGDB, Bugzilla, JIRA, CCT
PROFESSIONAL EXPERIENCE
Hadoop developer
Confidential
Responsibilities:
- Worked as a Back end developer in a close knit team of 4 engineers.
- Responsible for development and unit testing of MapReduce programs using java.
- Processing data by collecting from Mysql and Apache logs using Sqoop and Flume and converting it into structured format using multiple Map-Reduce,Pig UDF's and creating aggregated table, quering using HQL(Hive).
- Working closely with Hadoop Admin for cluster set up.
- Experienced in handling different file formats like Text file, Sequence files and Json files.
- Used big data technology as per Business requirements to perform analysis on website statistics like number of user visiting which pages, which areas are they interested in sites, why are the vistors dropping, analysis of comments on each article etc.
- Integration of tableau tool with spark to analyse the data from our website and prepare dashboards or reports for analysis of real time stats on the website.
- Development of user visible site using Perl, back end admin sites using Python and big data using core java.
- Development of dynamic site announcement tool. Admin can enter desired announcement text and publish it on the site.
- Development of continuous video player on the site so that user can see related videos continuously using integrated api’s from partner sites ooyala. Ex: like youtube.
- Implementation of ui and rest api’s for same functionalities in the project.
Lead developer
Confidential, Mountain View, CA
Responsibilities:
- Completed handled all project from design to implementation stage.
- Implementation of rest api’s to get the storage usage.
- Imported data frequently from MySQL to HDFS using Sqoop.
- Written Map reduce jobs to track storage usage.
- Displayed tabular reports which convey information like total number of volumes in filers, last transfer information like lag time, size etc and also worked on graphical representation for reports generated i.e pie charts, graphs.
Confidential, San Jose
Senior consultant
Responsibilities:
- Expertise in programming for UI development.
- Developed enhancement support for few contact users, created and last updated users for various entities like domains, subdomains, forward domain etc in create/ modify/ delete pages.
- Worked on cli based issues and fixed them and even developed new functionalties using rest api implementation.
- Gained knowlege of writing map reduce jobs using big data integrated with java.
Confidential
Senior Member of Technical Staff
Responsibilities:
- Expertise in perl programming for UI development and in search implementations using perl.
- Worked on reimplementation of functionalities of ui’s using java due to organisational changes.
- Played crucial role for database upgrade from 10G to 11G for entire project without any issues.
- Played crucial role using shell scripts, bash profiles for developing some automated scripts and executing some important scripts for production and demo support with root access and played support of L1, L2, L3.
- Advanced Search Feature implementation which supports various features like dynamic generation of columns among search results based on user selection of columns i.e. column layout, search for required number of rows using perl.
- Feature to export search results to csv files using perl, save and edit searches.
- Involved in developing various functionalities in the form of User Interface and cli/rest i.e. command line interface which returns output in the form of xml.
- Used apache server to implement UI’s.
Confidential
Software Engineer
Responsibilities:
- Crucial change of search engine from exact match to phrase match
- Avoided fraud payments from advertisers through credit card verification process
- Implemented referral program concept
- Rewritten existing server from perl to c to increase efficiency.
Confidential
Software Engineer
Responsibilities:
- Involved in complete design, implementation, testing of project.
- Involved in ui’s to get parties orders using third parties or events and venues and manage them in system and book them so that regular trading business happens for the company to have their revenue.
Confidential
Software Engineer
Responsibilities:
- Designing the Workflow Processes.
- Involved in developing all phases of the project
- Involved in ecommerce implementation of the site like gathering the orders from the customers or attracting them using impressive pictures etc and then credit card implementation etc related UI’s.
