We provide IT Staff Augmentation Services!

Hadoop Developer Resume

0/5 (Submit Your Rating)

DelawarE

SUMMARY

  • Overall 7+ years of software development experience in a variety of industries, which includes hands on experience in Big Data technologies.
  • In depth understanding/knowledge of Hadoop Architecture and various components such as HDFS, Namenode, Data node, Resource manager, Application master, Node manager, Job tracker, Task tracker etc.
  • Possess knowledge in Big Data Analysis tools like Hadoop, HDFS, Map Reduce, Hive, Pig, Oozie, Sqoop, Hue, Zookeeper, Kafka, Spark Core, Spark SQL and Scala.
  • Acquainted with Cloudera, Horton Works Data platform, Apache Hadoop distributions.
  • Experience in working with MapReduce programs using Apache Hadoop for working with Big Data.
  • Excellent understanding of both Classic MapReduce, YARN and their applications in BigData Analytics.
  • Developed Generic Data validation framework using Mapreduce.
  • Expertise in writing Hadoop Jobs for analyzing data using Hive and Pig.
  • Expertise in writing Hive UDF, Generic UDF's to in corporate complex business logic into hive queries in the process of performing high level data analysis.
  • Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems and vice - versa.
  • Experience in Hadoop workflows scheduling and monitoring using Oozie.
  • Good experience in working with Spark Core, Spark SQL, DataFrames, SchemaRDDs, RDD transformations and actions for faster analyzing and processing of data.
  • Good experience in Cassandra NoSQL database design, Creating keyspaces, Column families, Indexes and performing CRUD operations on data.
  • Good experience in Core and Advanced JAVA technologies.
  • Experience in development and integration of Web applications using Servlets, JSP, Spring, Framework, Web Services, XML, HTML, CSS, and JavaScript.
  • Extensive experience with Databases such as PL/SQL, Oracle 11G.
  • Self-motivated, excellent team player, with positive attitude and adhere to strict deadlines.
  • Willing to relocate: Anywhere.

PROFESSIONAL EXPERIENCE

Confidential - Delaware

Hadoop Developer

Responsibilities:

  • Played a key role in installation and configuration of the variousHadoopecosystem tools such as Pig, HBase, Flume and Sqoop.
  • Worked on analyzingHadoopstack and different big data analytic tools including Pig and Hive, HBase and Sqoop.
  • Worked on installing cluster, commissioning & decommissioning of Data Node, NameNode recovery, capacity planning, and JVM tuning, map and slots configuration.
  • Extensively involved in Installation and configuration of Cloudera distributionHadoop2, NameNode, Secondary NameNode, Job Tracker, Task Tracker and Data Node.
  • Involved inHadoopcluster task like Adding and Removing Nodes without any effect to running jobs and data.
  • Load log data into HDFS using Flume, worked extensively in creating MapReduce jobs to power data for search and aggregation.
  • Followed agile methodology.
  • Developed Pig Latin scripts to extract the data from the web server output files to load into HDFS.
  • Developed workflow in Oozie to automate the tasks of loading the data into HDFS and pre-processing with Pig.
  • Created HBase tables to store variable data formats of PII data coming from different portfolios.
  • Experience in running AWS.
  • Worked on Hive for exposing data for further analysis and for generating transforming files from different analytical formats to text files.
  • Helped in troubleshooting Hive Problems while working with Micro Strategy to produce illustrative reports and dashboards along with ad-hoc analysis.
  • Extracted the data from Teradata into HDFS using the Sqoop, exported the patterns analyzed back to Teradata using Sqoop.
  • Installed Oozie workflow engine to run multiple Hive and Pig jobs, which run independently with time and data availability.
  • Created HBase tables to store various data formats coming from different portfolios, worked on NoSQL databases including HBase, MongoDB, and Cassandra.

Environment: HDFS, Hadoop, Pig, Hive, Sqoop, Flume, Map Reduce, Oozie, Java 6/7, Oracle 10g, Sub Version, Toad, YARN, UNIX Shell Scripting, SOAP, REST services, Oracle 10g, Agile Methodology, JIRA, Auto Sys.

Confidential - Detroit, MI

Hadoop Developer

Responsibilities:

  • Processed data into HDFS by developing solutions, analyzed the data using MapReduce, Pig, Hive and produce summary results fromHadoopto downstream systems.
  • InstalledHadoop, Map Reduce, HDFS, and AWS and developed multiple MapReduce jobs in PIG and Hive for data cleaning and pre-processing.
  • Expertise in Unix/Linux Shell Scripting.
  • Responsible for SDLC Technical Writing/Requirements Gathering and Documentations.
  • Expertise in Agile/Scrum methodologies and creation SSIS jobs and stored procedures.
  • Developed and created SOAP and RESTful service framework for data warehouse team to extract master reference data (Post information, operating hours, and mission information.
  • Expert in Hbase modeling/development supporting customer behavior/life cycle analysis.
  • Design and deployment of Storm cluster integration with Kafka and HBase.
  • Experience in Oozie and workflow scheduler to manageHadoopjobs by Direct Acyclic Graph (DAG) of actions with control flows.
  • Used JUnit, Easy Mock and MRUnit testing frameworks to develop Unit test cases.
  • Incrementally loaded data from Hbase NoSQL database.
  • Created and Implemented highly scalable and reliable highly scalable and reliable distributed data design using NoSQL HBase.
  • Fine-tuning and enhance performance MapReduce jobs. Well Versed in noSQL concepts and good at writing quaries.
  • Worked extensively with Data migration, Data cleansing, Data profiling, and ETL Processes features for data warehouses.
  • Expertise on No-SQL data base like HBase, MapR and Cassandra integration with Solr.
  • Performed data analytics using PIG, Impala, Hive, and Language R for Data Scientists within the team to improve Business and future Strategy development.

Environment: Hadoop, HDFS, Map Reduce, Sqoop, Oozie, Pig, Hive, Flume, LINUX, Java, Eclipse, Cassandra.

Confidential

Java Developer

Responsibilities:

  • Worked in SDLC Analysis, Design and Development using combination of Agile Methodologies.
  • To accelerate CSP rollout with greater efficiency and reduced deployment times for increased ARPU and high quality KPIs.
  • Adapting B/OSS systems is characterized by complex and lengthy development, making it burdensome to rapidly modify product portfolios in order to meet quickly evolving environments.
  • Reviewed specifications for Concept wave Order Management, Product Catalog, Order Negotiation, Service Registry, and Order Analytics.
  • Developed various UI (User Interface) components using Struts (MVC), JSP, and HTML.
  • Developed user access module (Presentation layer) using Spring Framework.
  • Alert Order Management Specialist to changes or deficiencies in vendor process, routes, communication, and overall relationship.
  • Using AngularJS, HTML5 and CSS3. All HTML and DHTML is accomplished through AngularJS directives.
  • UI development using Angular JS (strong preference) or similar UI frameworks (Spring MVC or STRUTS) by using the Web Storm 9 tool and Node.js.
  • Used spring dependency on access module and data access module.
  • Developed the spring AOP programming to configure logging for the application.
  • Developed the Servlets for processing the data on the server.
  • Worked on Sun Jersey REST framework to create web services.
  • Loading claims into Facets using Kron Shell Scripting and Perl stored in Sybase database.
  • Unit tested the application before deployment.
  • Used Subversion for software version control.
  • Developing Perl APIs, PERL/CGI Scripts, Remedy Workflows.
  • Created test plans and JUnit test cases and test suite for testing the application.
  • Certain schedule process such as notifications and certain data validations PERL scripts with GoLang programs for better performance and handling of requests.
  • Worked in Agile environment with active scrum participation.
  • Developed API using Hibernate to interact with the Oracle database.
  • Deployed the application on to Glassfish application server.
  • Design and Development using Web Service using Apache Axis 2 on Apache Server.
  • Developed the application using Struts Framework which is based on the MVC design pattern.
  • Developed persistence layer with Hibernate, jQuery.
  • Used containers like Array and Map.
  • Database handling, Multithreading, Synchronization, Communication.
  • Worked in Trouble Shooting and Customer Support.

Environment: Java, Servlets, JSP, Struts, Spring, AngularJS, Hibernate, XML, CSS, AJAX, HTML5, Rational Clear Case, Microsoft Visio, WebSphere Application Server, Glassfish Server,JavaScript, REST Web Services, Jersey, Apache CXF, JQuery, AJAX, Oracle, CRUD, SQL, UML, JUNIT, MAVEN, UML, Netbeans, ANT, Agile Methodology.

Confidential

Oracle PL/SQL Developer

Responsibilities:

  • Developed packages, procedures and functions in PL/SQL for data loading and data processing.
  • Involved in designing the Primary & Foreign Key for the objects in the schema.
  • Writing SQL*Loader scripts and UNIX scripts to format, load data from text files to database.
  • Created constraints on the tables and the relations between the tables to meet the requirements.
  • Modifying and developing database triggers, cursors, procedures, functions and packages to meet business requirements.
  • Developed SQL Queries to fetch complex data from different tables in remote databases using joins, database links and formatted the results into reports and kept logs
  • Responsible for Unit Testing and Integration testing of PL/SQL Packages, Procedures, Functions and Database Triggers.
  • Debugged and analyzed problems and implemented solutions to them.
  • Coded, tested and provided Quality Assurance support for very complex Oracle procedures.
  • Development of Views for users.
  • Investigation of production problems and bug fixing.
  • Worked on production support and resolved the issues occurred with the jobs.

Environment: Oracle 8i/9i, PRO*C, UNIX Shell Scripts, Toad, Sun Solaris, Edit Plus.

We'd love your feedback!