Hadoop Developer Resume
0/5 (Submit Your Rating)
Provo, UT
SUMMARY:
- Over seven years of IT experience in meeting high standards and working with the latest technologies and database administration.
- Developed applications in an Agile environment in addition to experience in leading and teams while working in a retail - oriented environment.
- I am excited about achieving my dreams and goals amid the opportunities and the interactive environment existing at your organization.
TECHNICAL SKILLS:
Languages: Python, Java, C#, C++, C
Web Development: HTML, CSS3, jQuery, jQueryMobile, AJAX, JSON, JavaScript, XML
Server Side Technologies/Mobile Application: ASP.NET, VBScript, AppML, SQL, PHP, ASP, ADO Android SDK in Eclipse
WORK EXPERIENCE:
Confidential, Provo, UT
Hadoop Developer
Responsibilities:
- Developed custom Flume components for data ingestion
- Designed and managed a multi-stage workflow with Oozie
- Managed pipeline execution and constructing new pipelines with Crunch
- Transformed data and index it into Solr in order to make it available for search queries with Morphlines
- Worked on loading the data from MySql to HBase where necessary using Sqoop.
- Implemented Hadoop and Solr with Cassandra to store majority of data which was partitioned according to constraints
- Experimented with Spark using Python scripts for faster analytics and data processing
Confidential, Omaha, NE
Hadoop Developer
Responsibilities:
- Processing real-time streaming data using Yarn based Storm
- Experienced in collecting, aggregating, and moving large amounts of streaming data into HDFS using Flume.
- Conducted interactive SQL analysis on data stored in HDFS with Impala UDFs
- Used MapReduce and Flume to load, aggregate, store and analyze web log data from different web servers.
- Wrote Pig Scripts to generate MapReduce jobs and performed ETL procedures on the data in HDFS.
- Processed HDFS data and created external tables using Hive, in order to analyze visitors per day, page views and most purchased products.
- Exported analyzed data to MySQL database using Sqoop for generating reports.
Confidential, St. Louis, MO
Hadoop Developer
Responsibilities:
- Developed Pig Scripts, Pig UDFs, and Hive Scripts, Hive UDFs to transform data files.
- Managed Agile Software Practice using Jira - GreenHopper by creating Product Backlog, Iterations, Sprints in collaboration with the Product Team.
- Developed R Script to detect/update, install and load required or missing R-packages on cluster by running scheduled Cron jobs.
- Wrote unit tests for Monsanto Field Scripts, which enables to mock HDFS and use test data locally.
- Created Download service application using AWS-S3 java API to download SST Summit data from Amazon S3 to NetApp storage and transfer to HDFS using WebHDFS REST API.
- Provided technical documentation for Download Services.
- Utilized Environments CDH4, Hive, Pig, Impala, R, Oozie, Cloudera Manager, Hue, REST, AWS - S3, IntelliJ, SVN, Maven
- Debugging and optimizing MapReduce programs
Confidential, Atlanta, GA
Hadoop Developer
Responsibilities:
- Developed and configured Hadoop MapReduce jobs in java for data processing.
- Importing and exporting data into HDFS using Sqoop
- Used Hive to analyze the partitioned and bucketed data and compute various metrics for reporting.
- Reviewing and capturing logging in Hadoop Production cluster.
- ETL with Pig to do transformations and some pre-aggregations before storing the data onto HDFS.
- Supported Map Reduce Programs running on the cluster
- Installed and configured Hive and written Hive UDFs.
- Utilized Zookeeper for synchronization of jobs with each other using znodes
- Scheduled Oozie workflow engine for to coordinate recurring workflows.
Confidential, Atlanta, GA
Research and Development Lab Assistant/Junior DBA
Responsibilities:
- Provided application support for an end-user testing suite utilized by the nursing students during an operating system transition/update.
- Responsible for creating reports, maintaining, and analysis of inventory data using SQL queries and MS Access.
- Collaborated and worked with the team on all aspects ofthe design, modification, development, and implementation of software applications.
- Utilized Python and R to analyze protein data and understand trends within produced clusters.
Confidential, Atlanta, GA
Jr. Java Developer
Responsibilities:
- Developed the application under JEE architecture, developed Designed dynamic and browser compatible user interfaces using JSP, Custom Tags, HTML, CSS, and JavaScript.
- Deployed & maintained the JSP, Servlets components on Tomcat.
- Preparation of Developer’s and Deployment Guide.
- Developed and utilized J2EE Services and JMS components for messaging communication in Web Logic
- Analyzed policy and specification requirements and created detailed Technical Design Document.
- Developed JSPs for front end and Servlets and Session Beans in the middle tier.
- Developed DAO Classes for accessing and storing data in database.
- Deployed application on the Web sphere Application server.
- Performed testing by writing test cases.
Confidential,Lawrenceville, GA
Tutor/Web Developer
Responsibilities:
- Able to clearly explain efficient and proper methods to study and approach subjects to clients
- Provided lecture and presentations within an academic environment
- Was key in development of various websites for client purposes using HTML, CSS3, jQuery, AJAX, JSON, JavaScript, XML, ASP.NET, SQL, and PHP
- Involved with marketing strategy and leading team planning for reaching wider demographic
