Hadoop Lead Developer / Data Analyst Resume

PROFILE SUMMARY:

I am working as Technology Lead in Big Data practice of Confidential .
7+ years of IT experience with 4+ years in Hadoop/Big Data analytics.
Have been working on Big Data Technologies which include Hadoop, MapReduce, HDFS, Pig, Hive, Oozie, Zookeeper, AWS EC2, S3 & EMR etc.
Good hand on using cluster monitoring tool like CM (ClouderaManager)
Confidential certified hadoop developer.
Very good experience in Unix (bash / KSH) shell scripting.
Primarily worked on projects in JAVA/J2EE space and have exposure to all the phases of SDLC.
From 4+ years, working with client " Confidential Inc" in Big Data technologies.
Writing Pig and MapReduce jobs to process peta bytes of logs everyday.
Manage large scale Hadoop cluster environments, handling all Hadoop environment builds, cluster setup, performance tuning and ongoing monitoring.
Experience in using Pig, Map - Reduce and Cloudera Manager.
Hands-on experience on major components in Hadoop Ecosystem including PIG, Map-Reduce using Cloudera Distribution.
Average exposure in Amazon Web Services like AWS S3, EMR & EC2 .
Experience in installation, configuration, supporting and managing Hadoop clusters of CDH3, CDH4 and CDH5 of Cloudera Distribution.
Evaluate and propose new tools and technologies to meet the needs of the organization.
Expertise in Unix shell scripting .
Having skill in verdad and puppet management.
Expertise in automating the regular maintenance and monitoring tasks.
Experienced in defining job work flows as per their dependencies in Oozie and inhouse workflow manager.
Extending HIVE and PIG core functionality by using custom UDF’s.
Creation of metrics and measures of utilization and performance.
Good experience in HTML & CSS with JavaScript, jQuery as well.
Development and maintenance of custom utilities in JAVA environment with REST.
Designed and developed multi-tiered web application using J2SE, J2EE, Java Script, JQuery, Ajax, Dojo, CSS, Oracle 9i/10g/11g & SqlServer 2000/2005
Capable of full life cycle systems analysis and design following with AGILE Methodology.

WORK EXPERIENCE:

Confidential

Hadoop Lead Developer / Data Analyst

Responsibilities:

Coordinated with business customers to gather business requirements.
Responsible to manage data coming from different sources.
Worked on analyzing Hadoop cluster and different Big Data analytic tools including Pig, Hive and Map-Reduce.
Load and transform large sets of structured and semi structured data.
Collecting and aggregating large amounts of log data Custom Java Frameworks and staging data in HDFS for further analysis.
Analyzed data using Hadoop components Hive and Pig.
Involved in running Hadoop streaming jobs to process terabytes of data.
Gained experience in managing and reviewing Hadoop Clusters.
Developed PIG Latin scripts for the analysis of semi structured data. Involved in debugging PIG scripts
Written a Unix based workflow framework to handle the mapreduce / pig jobs to allocate resources sparingly and log the state of job workflow.

Confidential

Technology Analyst

Responsibilities:

Requirement gathering & feasibility analysis
Prepared design document and understanding of the application.
Used internal tools for preparing incompatibility list between source and target environments.
Involved in the migration estimation process of the hosted applications.

Confidential

Java Developer

Responsibilities:

Gathering the detailed requirement for the application, designing solutions, developing some critical reusable components using latest technology such as GWT, Hibernate and spring.
Has been directly involved in the Requirements Analysis and preparation of System Specification and Detailed Design Documents.
Also responsible to perform the analysis for various enhancements, perform impact analysis to find out the systems/programs that can be potentially affected by proposed change(s), coding, and testing and implementation activities.
Responsible for fixing the issues that arise from UAT, which has a time, bound SLA.

Technologies used: JAVA, SERVLET, JSP, HTML, XML, CSS, Java Script, JQuery, AJAX, Tomcat, Windows XP/7 SQL Server2000/2005, Oracle 10g, Eclipse JDK 1.6

Confidential

Java Developer

Responsibilities:

Requirement and analysis, code development & unit testing, project process adherence, Stakeholder communication & Release

Confidential

Java Developer

Responsibilities:

Code development
Requirement and analysis project process adherence
Stakeholder communication

We provide IT Staff Augmentation Services!

We'd love your feedback!

Resume Categories

Client Services

Job Seekers

Visa Sponsorship