We provide IT Staff Augmentation Services!

Hadoop Developer/ Big Data Technology Expert Resume

0/5 (Submit Your Rating)

Bloomington, IL

SUMMARY

  • 8 years of IT experience, which includes 3 years of work experience in Big Data,Hadoop ecosystem related technologies.
  • Very comfortable with Unix Shell Scripting and Unix OS
  • Excellent understanding ofHadooparchitecture and underlying framework including storage management.
  • Hands - on experience building, configuring and maintaining Hadoop clusters
  • Hands-on experience writing MapReduce programs to analyze data
  • Experience with Amazon Elastic MapReduce
  • Hands-on experience in using variousHadooptools such as Pig, Hive, Oozie, Flume and Sqoop for data storage & analysis.
  • Hands-on experience with scheduler tools like Zeke
  • In depth understanding of installing and configuring Hive, Pig, HBase, Sqoop, Flume and Oozie
  • Experience manipulating data in NoSQL DB like HBase.
  • Experience in importing and exporting data from relational databases to HDFS and Hive using Sqoop.
  • Experience in managing and reviewingHadooplog files.
  • Experience in designing both time driven and data driven automated workflows using Oozie.
  • Hands on experience in application development using RDBMS (Oracle and Netezza)
  • Experience writing complex SQL queries
  • Hands on experience writing packages, procedures and triggers using PL/SQL and SQL standards
  • Possesses thorough understanding of relational database architecture, data warehousing, from logical and physical design, with proficiency in data definition and data manipulation languages.
  • Experience in all phases of Agile Methodology software development
  • Ability to adapt to evolving technology, strong sense of responsibility and accomplishment
  • Strong desire and ability to perform at a high level for a fast-paced, flexible environment.
  • Excellent analytical, problem solving, communication and interpersonal skills with ability to interact with individuals at all levels and can work as a part of a team as well as independently.

TECHNICAL SKILLS

Big Data: Hadoop, HDFS, MapReduce, Elastic MapReduce Hive, Pig, HBase, Sqoop, Oozie, Flume

Programming: Java, JDBC, SQL, PL/SQL, HTML, XML, Shell Scripting, Ruby On Rails

Databases: Oracle, SQL Server, MySql and HBase.

Testing: JUnit, TestNG, Selenium, SOAPUI

PROFESSIONAL EXPERIENCE

Hadoop Developer/ Big Data Technology Expert

Confidential, Bloomington, IL

Responsibilities:

  • Understanding business needs, analyzing functional specifications and map those to develop and designing MapReduce programs and algorithms.
  • Worked in a team of 12 people
  • Execution of Hadoop ecosystem and Applications through Apache HUE.
  • OptimizedMapReduce code, Hive/Pig scripts for better scalability, reliability and performance.
  • Developed workflows for the Application execution with Oozie and Zeke.
  • Feasibility Analysis (For the deliverables) - Evaluating the feasibility of the requirements against complexity and time lines.
  • Performed data migration from Legacy Databases RDBMS to HDFS using Sqoop.
  • Wrote Pig/Hive scripts for data processing.
  • Implemented Hive tables and HQL Queries for the reports. Written and used complex data type in Hive. Storing and retrieved data using HQL in Hive. Developed Hive queries to analyze reducer output data.
  • Involved in designing the next generation data architecture for the unstructured data.
  • Set up and managed a 4-nodecluster for a client conducting aproof of concept. The cluster had 12 cores and 3 TB of installed storage.
  • Wrote Map Reduce Programs to pre process/filter data before loading.
  • Wrote Custom partitioners to manage load balancing during Map Reduce phase of data processing.
  • Developed Pig Latin scripts to extract data from source system.
  • Involved in Extracting, loading data from Hive to Load an RDBMS using Sqoop.
  • Develop Unix scripts for data processing
  • Extensively usedETLto load data from flat files.

Environment: HDFS, MapReduce, Hive, Oozie, Java, Pig, Shell Scripting, Linux, HUE, Sqoop, SQL, and Oracle 11g

Hadoop Developer/ Big Data Technology Expert

Confidential, Louisville, KY

Responsibilities:

  • Explored and usedecosystem features and architectures.
  • Worked closely with business team to gather their requirements and new support features.
  • Developed MapReduce jobs for log analysis and analytics.
  • Wrote MapReduce job to generate reports for the number of activities created on a particular day, during a time interval etc. for the analytics module.
  • The MapReduce job read the data from HDFS, where the data was dumped from the multiple sources and the output was written back to HDFS.
  • Configured Sqoop and developed scripts to extract data from MySQL into HDFS.
  • Used Hive and Pig for analysis of web site traffic.
  • Wrote programs using scripting languages like Pig and Hive to manipulate data.
  • Implemented the workflows using the Apache Oozie framework to automate tasks.
  • WroteHadoopJob Client utilities and integrated them into monitoring system.
  • Reviewed the HDFS usage and system design for future scalability and fault-tolerance.
  • Prepared Extensive Shell scripts to get the required info from logs.
  • Performed white box testing and monitoring all the logs in Dev and Prod environments

Environment: HDFS, Map/Reduce Java, Sqoop, Pig, Hive, Oozie, Java, SQL, and Linux.

PL/SQL Developer

Confidential, Toledo, OH

Responsibilities:

  • Prepared the technical requirements document by working with business analysts and understanding the business requirements.
  • Played an active role in the designing and analysis part. Also responsible for backend development activities.
  • Covered the fundamentals of Software Development Life Cycle (SDLC).
  • Different constraints on database were created and maintained.
  • Integrity of the database was maintained by developing triggers.
  • SQL Loader to perform bulk data loads into database tables from external data files.
  • Created database objects such as tables, views, synonyms, indexes, sequences and database links as well as custom packages tailored to business requirements.
  • Identified performance bottlenecks, suggested and implemented alternative approaches like range partitioning of tables, use of global temporary tables.
  • UsedPL/SQLfeatures such as stored procedures, functions, packages and database triggers for maintaining complex integrity constraints and implementing the complex business rules.
  • WroteETLScripts for generating variousETLExtracts

Environment: Oracle 9i/10g,PL/SQL,SQL Plus,SQL Loader, Toad

PL/SQL Developer

Confidential, San Diego, CA

Responsibilities:

  • Provided database design solution for new enhancements
  • Created database objects like tables, views, sequences, synonyms, stored procedures, functions, packages, cursors and triggers
  • Created indexes on tables to improve the performance by eliminating the full table scans and views for hiding the actual tables and to eliminate the complexity of the large queries
  • Wrote complexSQLqueries using joins, sub queries and correlated sub queries to retrieve data from the database
  • Coordinated with the front end design team to provide them with the necessary stored procedures and packages
  • Assisted QA Teams for bug testing, User Acceptance Testing (UAT) & System Integration Testing

Environment: Oracle 10g,SqlDeveloper, SQL Plus Toad, PL/SQL

We'd love your feedback!