We provide IT Staff Augmentation Services!

Big Datahadoop Developer Resume

0/5 (Submit Your Rating)

Denver, CO

SUMMARY

  • 11+ years of experience in Application analysis, Design, Development, Maintenance and Supporting web, Client - server based applications in Java/J2EE technologies which include 4 years of experience with Big Data.
  • Hands-on experience in Big Data/Hadoop and ecosystem.
  • Excellent experience in Hadoop, MapReduce, Spark, Hive, pig, Hbase, Kafka, storm, Flume, Scala and Sqoop.
  • Experience in multiple Hadoop distributions like Cloudera, Horton works and AWS.
  • Familiarity with NoSQL databases in Hbase, Cassandra and MongoDB.
  • Experienced with AWS S3 and EMR.
  • Expertise in Data ingestion using SQOOP, Apache Kafka, Spark Streaming.
  • Experienced in data analysis using Hadoop and extensive experience in writing map reduce jobs in java.
  • Implemented custom business logic and performed join optimization, secondary sorting, custom sorting using Map Reduce programs
  • Having experience in Airflow and OOZIE workflows.
  • Experience with Oozie Workflow and Airflow Engine to automate and parallelize Hadoop, Map Reduce, hive and pig.
  • Extensive experience with wiring SQL queries using HiveQL to perform analytics on structured data.
  • Experience in performing data validation using HIVE dynamic partitioning and bucketing.
  • Worked on Cassandra database and related web services for storing structured data.
  • Experience in implementing algorithms for analyzing using spark.
  • Experience in implementing Spark using Python and SparkSQL for faster processing of data.
  • Familiarity on real time streaming data with Spark, Storm and Kafka.
  • Expert knowledge over J2EE Design Patterns like MVC Architecture, Singleton, Factory Pattern, Front Controller, Session Facade, Business Delegate and Data Access Object for building J2EE Applications.
  • Excellent experience in java core Design Patterns.
  • Expertise with Application servers and web servers like Oracle WebLogic, IBM WebSphere, Apache Tomcat, JBOSS and VMware.
  • Having experience in SOA, Web Services and RESTFul.
  • Strong experience in EJB.
  • Excellent experience in Spring, Hibernet, Struts,JMS, Portal, JQuery, Hibernate and JSF.
  • Having experience in Oracle and PL/SQL.
  • Expertise in using JDBC, Servlets and JSP for developing most of the applications.
  • Experienced in developing the unit test cases using MRUnit, JUnit and Jenkins.
  • Knowledge on Build tool Jenkins.
  • Experience in using Maven and ANT for build automation.
  • Experience in using version control and configuration management tools like SVN, CVS.
  • Experience working in environments using Agile (SCRUM) and Waterfall methodologies.
  • Experience in designing applications using UML Diagrams like Class Diagram, Component Diagram, Sequence Diagrams, and Deployment Diagram using MS Visio, Rational Rose.
  • Expertise in database modeling, administration and development usingSQL and PL/SQL in Oracle (8i, 9i and 10g), My SQL, Teradata and SQL Server environments.
  • Defining Test Cases, analyzing bugs, interaction with team members in fixing errors, Unit testing and User Acceptance Testing (UAT).
  • Experience in creating and maintaining the requirements definition documents that included Business requirements and Functional requirements.
  • Exceptional problem solving skills and ability to quickly adapt to new challenges.
  • Good understanding of Object Oriented Programming (OOPs).

TECHNICAL SKILLS

Hadoop Ecosystems: Hadoop, MapReduce, Hive, impala, Spark, Strom, Kafka, Oozie, Airflow and Sqoop

Cloud Services: AWS S3, AWS EMR and AWS EC2.

No SQL DB: Hbase, Cassandra and MongoDB.

Sun Technologies: Core Java, Servlets, JSP and JDBC.

Distributed Technologies: SOA, Web Services, EJB, JMS and Portal.

Web Services: WSDL, AXIS, SOAP and RESTFUL.

Web Technologies: HTML, XML, AJAX, JQuery and Java Script.

Servers: Tomcat, and Websphere Application Server.

Databases: Oracle and MySQL.

Operating Systems: UNIX, Linux and Windows.

Languages: JAVA, PYTHON and SCALA

Frame work: Spring, Hibernet, Struts, Node.js, D3js and JSF.

XML: XML, XSL, XSLT-FO, XSD and XPath.

Xml Parsers: SAX and DOM.

API/Tools: Rational Application Development and Rational Software architecture

Integration Developer: BPEL Programming.

PROFESSIONAL EXPERIENCE

Confidential, Denver, CO

Big DataHadoop Developer

Responsibilities:

  • Designed a pipeline to collect, clean, and prepare data for analysis using Map reduce, Spark, Hive, Impala and sqoop and reporting using Tableau.
  • UsedSparkAPI over to perform analytics on data in Hive.
  • Worked on Kafka cluster to get the data from an external server and load the data in HBase.
  • Used parquet and Avro file formats and snappy compressions while storing data in HDFS.
  • Developed spark to interact with the data and analyzing computing data.
  • Worked on EMR and S3 in AWS and ImplementedAmazonS3to store the user data.
  • Implemented applications built and using Scala/Java.
  • Pivoting table to store in HBase.
  • Developed workflows in Oozie.
  • Developed and created of Metastore tables & views in Hive.
  • Worked on HBase tables to store variable data formats coming from different portfolios.
  • Perform a simple text search use the Lucene query syntax, and use the full JSON-based Elasticsearch Query.
  • Data Visualizationsusing by Kibana.
  • Created Hive internal and external Tables, Partitions, Bucket for further Analysis using Hive.

Confidential, Portland, OR

Sr. Big DataHadoop Developer

Responsibilities:

  • Designed a pipeline to collect, clean, and prepare data for analysis using Map reduce, Spark, Pig, Hive and sqoop and reporting using Tableau.
  • Created Hive internal and external Tables, Partitions, Bucket for further Analysis using Hive.
  • Designed a data warehouse using Hive. Analyzed the data by performing Hive queries.
  • Worked on EMR and S3 in AWS and ImplementedAmazonS3to store the user data.
  • Developed spark to interact with the data and analyzing computing data.
  • Developed Data ingestion into HDFS using Sqoop.
  • Performed Sqoop imports of data from Data warehouse platform to HDFS and built hive tables on top of the datasets.
  • Used parquet and Avro file formats and snappy compressions while storing data in S3 and HDFS.
  • Designed and developed load data to HIVE using Spark and SparkSQL.
  • DevelopedSparkcode using python andSpark-SQL/Streaming for faster testing and processing of data.
  • Coding and developing spark by using PySpark.
  • Tested and implemented applications built using Python.
  • UsedSparkAPI over to perform analytics on data in Hive.
  • Performance optimization dealing with large datasets using Partitions,Sparkin Memory capabilities, Broadcasts inSpark, Effective & efficient Joins, Transformations and other heavy lifting during ingestion process itself.
  • Designed and developed load data using Airflow workflows with Sqoop for importing data from RDMS to HDFS.
  • Developed workflows of schedule job by using Airflow.

Environment: AWS S3, EMR, Python, pyspark, Scala, Hadoop, MapReduce, Hive, impala, Sqoop, Spark SQL, Spark Stream, Airflow, Jenkin, git, Bitbucket, Stach, R Language and tableau.

Confidential, Menlo Park, CA

Sr. Big DataHadoop Developer

Responsibilities:

  • Created Hive internal and external Tables, Partitions, Bucket for further Analysis using Hive.
  • Designed a data warehouse using Hive. Analyzed the data by performing Hive queries.
  • Worked on Kafka cluster to get the data from an external server and load the data in Cassandra.
  • Built real-time Big Data solutions using Cassandra handling billions of records
  • Populated HDFS huge amounts of data using Kafka and Storm steam.
  • Worked in S3, EMR, Data Pipeline and ImplementedAmazonS3to store the user data.
  • Developed spark Scala to interact with the data and analyzing computing data.
  • Developed Data ingestion into HDFS and AWS s3 using Sqoop.
  • Designed and developed load data to HIVE using Spark SQL.
  • Used parquet and Avro file formats and snappy compressions while storing data in S3 and HDFS.
  • Pivoting table to store in HBase and indexing using Solr.
  • Developed workflows in Oozie.
  • Involved in build applications usingMavenand integrated with CI servers likeJenkinsto build jobs.
  • Created initial website prototype from a Django skeleton system, building out, page views, templates, and CSS layouts for the complete site within the Django framework.
  • Involved inAgilemethodologies, daily scrum meetings,springplanning.
  • CreatedHivetables and working on them usingHive QL.

Environment: Java, Hadoop, Hive, HBase, Sqoop, Spark SQL, Spark Stream, Scala, Strom, Kafka, Flume, Cassandra, Oozie, Horton Works, node js, D3js, solr, R Language and tableau.

Confidential, Georgia, Alpharetta

Sr. Big DataHadoop Developer

Responsibilities:

  • Responsible for preparing action plans to analyze the data.
  • Mentored an intern working on recommendation engine on big data.
  • Importing and exporting data into HDFS and Hive using Sqoop.
  • Built real-time Big Data solutions using MongoDB handling billions of records
  • Working to demonstrate to read and process with Spark and storing in Cassandra.
  • Map reduce programs were written to do Sales Compensation calculation, grouping items and extending the promos to store level.
  • Developed suit of Unit Test Cases for Mapper, Reducer using MR Testing library

Environment: Java, Hadoop, MapReduce, HIVE, Sqoop, MongoDB and Cloudera.

Confidential, Georgia, Alpharetta

Big DataHadoop Developer

Responsibilities:

  • Mentored an intern working on recommendation engine on big data.
  • Importing and exporting data into HDFS and Hive using Sqoop.
  • Developed and created of metastore tables & views in Hive.
  • Worked on HBase tables to store variable data formats coming from different portfolios.
  • Good experience in file storage concepts of HDFS and optimization.
  • Developed suit of Unit Test Cases for Mapper, Reducer and Driver classes using MR Testing library

Environment: Java, Hadoop, MapReduce, HIVE, Hbase, Sqoop and Cloudera, Hibernate, Spring and Rest Full Web Service

Confidential

Senior J2ee Developer

Responsibilities:

  • Involved in Use case analysis and designing.
  • Done the coding for UI, WAS and WPS.
  • Involved in Design & Development
  • Development, Unit testing, Integration testing and Delivery Check.
  • Application issue analysis & providing solution.
  • Integrating entire modules and testing for the functionality.
  • Developed modules based on the Design documents

Environment: JSF/JSR 168, Portlet, Hibernate, Spring, EJB,JQuery Oracle 9i and BPEL.

Confidential, New York

Senior J2ee Developer

Responsibilities:

  • Involved in the Understanding of the Requirements and Design of the Application.
  • Involved in Coding Web Services Axis and RestFull.
  • Involved in Coding Generate PDF using XML, XSLT-FO, FOP and ITEXT.
  • Involved in Coding Generating Excel using JXL.
  • Developing web pages using JSP and establishing communication between various pages in application using TSF Framework.
  • Involved in Coding Action classes.
  • Auto updating Data Base every month using Batch Process(Unix Shell Scripts)
  • Involved in Coded Data Base procedures using JDBC.

Environment: java, Web Services, RESTful, TSF Framework, java, JDBC, XML SAX and DOM Parsing, XSLT and XSL-FO, UNIX Shell Scripts, PL/SQL and JSP

Confidential, New York

Java Developer

Responsibilities:

  • Involved in the Understanding of the Requirements and Design of the Application.
  • Involved in Coding Web Services.
  • Involved in Coding Generate PDF using XML, XSLT-FO, FOP and ITEXT.
  • Involved in Coding Generating Excel using JXL.
  • Developing web pages using JSP and establishing communication between various pages in application using TSF Framework.
  • Involved in Coding Action classes.
  • Auto updating Data Base every month using Batch Process(Unix Shell Scripts)
  • Involved in Coded Data Base procedures using JDBC.
  • Auto email periodic service performance to suppliers using Batch Process (UNIX Shell Scripts)

Environment: java, Web Services, TSF Framework, java, JDBC, XML SAX and DOM Parsing, XSLT and XSL-FO, UNIX Shell Scripts, PL/SQL and JSP

Confidential, New York

Java Developer

Responsibilities:

  • Involved in development and testing.
  • Involved in coding for Industrial Direct POs and Indirect POs using Web Services.
  • Involved in coding Generate PDF using XML, XSLT-FO and FOP.
  • Involved in coding server pages using JSP and Action Classes.

Environment: java, Web Services, SOAP, XML, SAX, DOM Parsing, XSLT, XSL-FO, TSF Framework, UNIX Scripts, PL/SQL and JSP

Confidential, New York

Java Developer

Responsibilities:

  • Involved in the Understanding of the Requirements and Design of the Application.
  • Involved in Coding Web Services and SOAP messages.
  • Involved in Coding Generate PDF using XML, XSLT-FO, FOP and ITEXT.
  • Involved in Coding Generating Excel using JXL.
  • Developing web pages using JSP and establishing communication between various pages in application using TSF Framework.
  • Involved in Coding Action classes.
  • Auto updating Data Base every month using Batch Process(Unix Shell Scripts)
  • Involved in Coded Data Base procedures using JDBC.
  • Auto email periodic service performance to suppliers using Batch Process, (Unix Shell Scripts).

Environment: Java, TSF Framework, java, JDBC, AWT, XML SAX/DOM Parsing, XSLT and XSL-FO, UNIX Shell Scripts, PL/SQL, Web Services and JSP.

Confidential, New York

Java Developer

Responsibilities:

  • Business Logic implemented EJB and JMS.
  • Developing JSP and Action Servlet.
  • Developing multi-threading for parallel processing
  • Developing Coding Database classes.

Environment: Java, JSP, WASD, JDBC, Oracle, EJB and Struts.

We'd love your feedback!