We provide IT Staff Augmentation Services!

Hadoop Developer Resume

4.00/5 (Submit Your Rating)

Houston, TX

SUMMARY:

  • 9 years of experience in a variety of industries, which includes hands on experience in Big Data technologies.
  • In - depth knowledge on Hadoop framework/architecture and eco-system components like Hive, Pig and Sqoop.
  • Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems and vice-versa.
  • Experience in analyzing large data sets using HiveQL and MapReduce programs efficiently.
  • Experience in Hadoop Shell and MapReduce programs.
  • Experience in handling structured arrangement of data using Partitions and Bucketing in Hive.
  • Hands on experience in application development using Java and Unix shell.
  • Strong experience with ingestion, storage, querying, processing and analysis of big data.
  • Involved in the analysis, design, coding and testing as per the client requirement.
  • Experience in data analysis using HiveQL, Pig Latin, HBase and custom Map Reduce programs in Java.
  • Good understanding of NoSQL database HBase.
  • Very good experience in complete project life cycle (design, development, testing and implementation).
  • Worked in large and small teams for systems requirement, design & development.
  • Key participant in all phases of Confidential life cycle including application coding, configuring, testing, production support & maintenance projects.
  • Experience in using IDEs like Eclipse, PLSQL Developer.
  • Strong team player with good communication, analytical, presentation and inter-personal skills.
  • Ability to quickly learn and adapt to changing dynamics of projects/assignments .

SKILL:

Big Data/Hadoop Technologies: Hadoop, HDFS, MapReduce, Hive, Sqoop, Pig, Spark, Oozie, Flume.

NO SQL Databases: HBase

Languages: Core Java, SQL, HiveQL, Pig Latin, PERL, Shell Scripting, Scala.

Java technologies: Java, Web services, Spring, JDBC.

Databases: MySQL, Oracle, HBase

Scripting and Query Languages: Unix Shell Scripting, PERL, SQL

Operating Systems: UNIX, Windows, LINUX

Development Tools: Eclipse, PLSQL Developer

Billing tools: Geneva (Versions: 5.3), Infinys RBM (2.2, 4.0, 4.3)

EXPERIENCE:

Hadoop Developer

Confidential, Houston, TX

Responsibilities:

  • Working for Customer Knowledge & Insights - Real-time Analytics
  • Selecting and integrating Big Data tools and frameworks required to provide requested capabilities.
  • Implementation of Big data infrastructure and technologies and dataflow processes including data extraction and ETL processes to populate Data Lake.
  • Builds and architect next-generation Big Data analytics framework developed on a group of core technology.
  • Working with Data Scientists to ensure availability of needed data sets.
  • Codes, tests, and documents new or modified data systems to create robust and scalable applications for data analytics.
  • Understands customer's business needs and translate needs into IT specific requirements.
  • Apply knowledge of the customer's functions and processes to develop business case and business requirement documents.
  • Demonstrate knowledge of all key business functions in the enterprise and the technologies supporting and integrating them.
  • Worked on analyzing Hadoop cluster using different big data analytic tools including Hive, Pig and MapReduce.
  • Importing and exporting data into HDFS and Hive using Sqoop.
  • Hands on experience in HiveQL.
  • Involved in loading data from LINUX file system to HDFS.
  • Processed the raw data using Hive jobs.
  • Implemented Partitioning, Dynamic Partitions, Buckets in Hive.
  • Implemented test scripts to support test driven development and continuous integration.
  • Actively involved in code review and bug fixing for improving the performance.
  • Involved in development, building, testing, and deploy to Hadoop cluster in distributed mode.
  • Created HBase tables to store data from different sources.
  • Created Pig Latin scripts to sort, group, join and filter the enterprise wise data.

Environment : Hadoop, MapReduce, HDFS, Pig, Hive, Sqoop, HBase, Oozie, MySQL.

System Analyst

Confidential, Lake Mary, FL

Responsibilities:

  • Hadoop installation, configuration of multiple nodes in Cloudera Platform.
  • Setup and optimize Stand-alone/Psuedo-Distributed/Distributed clusters.
  • Develop simple to complex MapReduce jobs.
  • Analyzing data with Hive, Pig.
  • Handled importing of data from data sources, performed transformations using Hive and loaded data into HDFS.
  • Extracted data from RDBMS into HDFS using Sqoop analyzed the data by performing Hive queries and running Pig scripts to study customer behavior.
  • Load data from Linux file system into HDFS.
  • Install and configure Hive and write Hive UDFs.
  • Create tables, load data and write queries in Hive.
  • Importing data into HDFS and Hive and vice-versa using Sqoop.
  • Codes, tests, and documents new or modified data systems.
  • Understand a customer's business needs and translate needs into IT specific requirements.

Environment : Hadoop, MapReduce , HDFS , Hive, HQL, SQOOP, UNIX

Software Prog/Analyst

Confidential

Responsibilities:

  • Developed, tested, implemented and maintained application software working with established processes.
  • Built, tested and deployed software products.
  • Waterfall systems development life cycle.
  • Worked closely with clients to establish problem specifications and system designs.
  • Identified and resolved production and non-production application issues.
  • Developed and executed unit test plans.
  • Provided support for testing phase during the testing phase.

Environment : Java, web services, Spring, Oracle, Unix, Eclipse

Software Program/Analyst

Confidential

Responsibilities:

  • Appointed as the Primary Contact for Confidential Wholesale Rating and Billing Operations from India center.
  • Proactively worked on writing different new scripts (using Shell Scripting and PERL) like monitors for different processes and worked on modifying various existing scripts for improving the operational efficiencies.
  • Running Rating and Billing for all the customers and achieved an excellent client satisfaction.
  • Perform Production Readiness Test prior implementation of various patches in production.
  • Wrote complex SQL statements providing back-end solutions to production issues, monitoring, and reporting.
  • Maintain effective relationships with various system administrators and development teams.
  • Understanding the business requirements of the client and implementing them successfully in production.
  • Monitoring all the alerts and fix the problem arise during production.
  • Leading various maintenance windows for various Patches in Production.
  • Instrumental in resolving various complex issues which arose in Production.
  • Co-ordinating among various business teams for resolving various complex issues for timely resolution.
  • Provide training to various new employees and assist with expert knowledge on all production processes.

Environment: Unix Shell scripting, PERL, SQL, Oracle 9i, PLSQL Developer, Infinys RBM 4.0

Associate (Prog/Analyst)

Confidential

Environment: Unix Shell scripting, PERL, SQL, Oracle 9i, PLSQL Developer, Infinys RBM 2.2

Responsibilities:

  • Proactively worked on writing different new scripts like monitors for different processes and worked on modifying various existing scripts for performance improvement.
  • Assist the development and testing teams to provide timely support to reach the solutions on time.
  • Performing day-to-day tasks for Rating and Billing for running the operations efficiently and effectively.
  • Identifying various problems/bugs during pre- and post-production and escalate to the concerned teams for timely solutions.
  • Worked on tracking various issues during pre- and post-production.
  • Document all production processes and resolve all issues and answer all requests.
  • Monitor all performance metrics for various production systems and identify root cause for all technical issues and recommend solutions.
  • Leading the maintenance windows for patch application.
  • Instrumental in successful day-to-day smooth operations in production.

Associate (Prog/Analyst)

Confidential

Environment: Unix Shell scripting, SQL, Oracle 9i, PLSQL Developer, Geneva 5.3

Responsibilities:

  • Performing day-to-day Rating and Billing tasks efficiently and effectively.
  • Monitor all performance metrics of production system.
  • Worked on maintenance windows for patch application.

We'd love your feedback!