Big Datahadoop Developer Resume
Denver, CO
SUMMARY
- 11+ years of experience in Application analysis, Design, Development, Maintenance and Supporting web, Client - server based applications in Java/J2EE technologies which include 4 years of experience with Big Data.
- Hands-on experience in Big Data/Hadoop and ecosystem.
- Excellent experience in Hadoop, MapReduce, Spark, Hive, pig, Hbase, Kafka, storm, Flume, Scala and Sqoop.
- Experience in multiple Hadoop distributions like Cloudera, Horton works and AWS.
- Familiarity with NoSQL databases in Hbase, Cassandra and MongoDB.
- Experienced with AWS S3 and EMR.
- Expertise in Data ingestion using SQOOP, Apache Kafka, Spark Streaming.
- Experienced in data analysis using Hadoop and extensive experience in writing map reduce jobs in java.
- Implemented custom business logic and performed join optimization, secondary sorting, custom sorting using Map Reduce programs
- Having experience in Airflow and OOZIE workflows.
- Experience with Oozie Workflow and Airflow Engine to automate and parallelize Hadoop, Map Reduce, hive and pig.
- Extensive experience with wiring SQL queries using HiveQL to perform analytics on structured data.
- Experience in performing data validation using HIVE dynamic partitioning and bucketing.
- Worked on Cassandra database and related web services for storing structured data.
- Experience in implementing algorithms for analyzing using spark.
- Experience in implementing Spark using Python and SparkSQL for faster processing of data.
- Familiarity on real time streaming data with Spark, Storm and Kafka.
- Expert knowledge over J2EE Design Patterns like MVC Architecture, Singleton, Factory Pattern, Front Controller, Session Facade, Business Delegate and Data Access Object for building J2EE Applications.
- Excellent experience in java core Design Patterns.
- Expertise with Application servers and web servers like Oracle WebLogic, IBM WebSphere, Apache Tomcat, JBOSS and VMware.
- Having experience in SOA, Web Services and RESTFul.
- Strong experience in EJB.
- Excellent experience in Spring, Hibernet, Struts,JMS, Portal, JQuery, Hibernate and JSF.
- Having experience in Oracle and PL/SQL.
- Expertise in using JDBC, Servlets and JSP for developing most of the applications.
- Experienced in developing the unit test cases using MRUnit, JUnit and Jenkins.
- Knowledge on Build tool Jenkins.
- Experience in using Maven and ANT for build automation.
- Experience in using version control and configuration management tools like SVN, CVS.
- Experience working in environments using Agile (SCRUM) and Waterfall methodologies.
- Experience in designing applications using UML Diagrams like Class Diagram, Component Diagram, Sequence Diagrams, and Deployment Diagram using MS Visio, Rational Rose.
- Expertise in database modeling, administration and development usingSQL and PL/SQL in Oracle (8i, 9i and 10g), My SQL, Teradata and SQL Server environments.
- Defining Test Cases, analyzing bugs, interaction with team members in fixing errors, Unit testing and User Acceptance Testing (UAT).
- Experience in creating and maintaining the requirements definition documents that included Business requirements and Functional requirements.
- Exceptional problem solving skills and ability to quickly adapt to new challenges.
- Good understanding of Object Oriented Programming (OOPs).
TECHNICAL SKILLS
Hadoop Ecosystems: Hadoop, MapReduce, Hive, impala, Spark, Strom, Kafka, Oozie, Airflow and Sqoop
Cloud Services: AWS S3, AWS EMR and AWS EC2.
No SQL DB: Hbase, Cassandra and MongoDB.
Sun Technologies: Core Java, Servlets, JSP and JDBC.
Distributed Technologies: SOA, Web Services, EJB, JMS and Portal.
Web Services: WSDL, AXIS, SOAP and RESTFUL.
Web Technologies: HTML, XML, AJAX, JQuery and Java Script.
Servers: Tomcat, and Websphere Application Server.
Databases: Oracle and MySQL.
Operating Systems: UNIX, Linux and Windows.
Languages: JAVA, PYTHON and SCALA
Frame work: Spring, Hibernet, Struts, Node.js, D3js and JSF.
XML: XML, XSL, XSLT-FO, XSD and XPath.
Xml Parsers: SAX and DOM.
API/Tools: Rational Application Development and Rational Software architecture
Integration Developer: BPEL Programming.
PROFESSIONAL EXPERIENCE
Confidential, Denver, CO
Big DataHadoop Developer
Responsibilities:
- Designed a pipeline to collect, clean, and prepare data for analysis using Map reduce, Spark, Hive, Impala and sqoop and reporting using Tableau.
- UsedSparkAPI over to perform analytics on data in Hive.
- Worked on Kafka cluster to get the data from an external server and load the data in HBase.
- Used parquet and Avro file formats and snappy compressions while storing data in HDFS.
- Developed spark to interact with the data and analyzing computing data.
- Worked on EMR and S3 in AWS and ImplementedAmazonS3to store the user data.
- Implemented applications built and using Scala/Java.
- Pivoting table to store in HBase.
- Developed workflows in Oozie.
- Developed and created of Metastore tables & views in Hive.
- Worked on HBase tables to store variable data formats coming from different portfolios.
- Perform a simple text search use the Lucene query syntax, and use the full JSON-based Elasticsearch Query.
- Data Visualizationsusing by Kibana.
- Created Hive internal and external Tables, Partitions, Bucket for further Analysis using Hive.
Confidential, Portland, OR
Sr. Big DataHadoop Developer
Responsibilities:
- Designed a pipeline to collect, clean, and prepare data for analysis using Map reduce, Spark, Pig, Hive and sqoop and reporting using Tableau.
- Created Hive internal and external Tables, Partitions, Bucket for further Analysis using Hive.
- Designed a data warehouse using Hive. Analyzed the data by performing Hive queries.
- Worked on EMR and S3 in AWS and ImplementedAmazonS3to store the user data.
- Developed spark to interact with the data and analyzing computing data.
- Developed Data ingestion into HDFS using Sqoop.
- Performed Sqoop imports of data from Data warehouse platform to HDFS and built hive tables on top of the datasets.
- Used parquet and Avro file formats and snappy compressions while storing data in S3 and HDFS.
- Designed and developed load data to HIVE using Spark and SparkSQL.
- DevelopedSparkcode using python andSpark-SQL/Streaming for faster testing and processing of data.
- Coding and developing spark by using PySpark.
- Tested and implemented applications built using Python.
- UsedSparkAPI over to perform analytics on data in Hive.
- Performance optimization dealing with large datasets using Partitions,Sparkin Memory capabilities, Broadcasts inSpark, Effective & efficient Joins, Transformations and other heavy lifting during ingestion process itself.
- Designed and developed load data using Airflow workflows with Sqoop for importing data from RDMS to HDFS.
- Developed workflows of schedule job by using Airflow.
Environment: AWS S3, EMR, Python, pyspark, Scala, Hadoop, MapReduce, Hive, impala, Sqoop, Spark SQL, Spark Stream, Airflow, Jenkin, git, Bitbucket, Stach, R Language and tableau.
Confidential, Menlo Park, CA
Sr. Big DataHadoop Developer
Responsibilities:
- Created Hive internal and external Tables, Partitions, Bucket for further Analysis using Hive.
- Designed a data warehouse using Hive. Analyzed the data by performing Hive queries.
- Worked on Kafka cluster to get the data from an external server and load the data in Cassandra.
- Built real-time Big Data solutions using Cassandra handling billions of records
- Populated HDFS huge amounts of data using Kafka and Storm steam.
- Worked in S3, EMR, Data Pipeline and ImplementedAmazonS3to store the user data.
- Developed spark Scala to interact with the data and analyzing computing data.
- Developed Data ingestion into HDFS and AWS s3 using Sqoop.
- Designed and developed load data to HIVE using Spark SQL.
- Used parquet and Avro file formats and snappy compressions while storing data in S3 and HDFS.
- Pivoting table to store in HBase and indexing using Solr.
- Developed workflows in Oozie.
- Involved in build applications usingMavenand integrated with CI servers likeJenkinsto build jobs.
- Created initial website prototype from a Django skeleton system, building out, page views, templates, and CSS layouts for the complete site within the Django framework.
- Involved inAgilemethodologies, daily scrum meetings,springplanning.
- CreatedHivetables and working on them usingHive QL.
Environment: Java, Hadoop, Hive, HBase, Sqoop, Spark SQL, Spark Stream, Scala, Strom, Kafka, Flume, Cassandra, Oozie, Horton Works, node js, D3js, solr, R Language and tableau.
Confidential, Georgia, Alpharetta
Sr. Big DataHadoop Developer
Responsibilities:
- Responsible for preparing action plans to analyze the data.
- Mentored an intern working on recommendation engine on big data.
- Importing and exporting data into HDFS and Hive using Sqoop.
- Built real-time Big Data solutions using MongoDB handling billions of records
- Working to demonstrate to read and process with Spark and storing in Cassandra.
- Map reduce programs were written to do Sales Compensation calculation, grouping items and extending the promos to store level.
- Developed suit of Unit Test Cases for Mapper, Reducer using MR Testing library
Environment: Java, Hadoop, MapReduce, HIVE, Sqoop, MongoDB and Cloudera.
Confidential, Georgia, Alpharetta
Big DataHadoop Developer
Responsibilities:
- Mentored an intern working on recommendation engine on big data.
- Importing and exporting data into HDFS and Hive using Sqoop.
- Developed and created of metastore tables & views in Hive.
- Worked on HBase tables to store variable data formats coming from different portfolios.
- Good experience in file storage concepts of HDFS and optimization.
- Developed suit of Unit Test Cases for Mapper, Reducer and Driver classes using MR Testing library
Environment: Java, Hadoop, MapReduce, HIVE, Hbase, Sqoop and Cloudera, Hibernate, Spring and Rest Full Web Service
Confidential
Senior J2ee Developer
Responsibilities:
- Involved in Use case analysis and designing.
- Done the coding for UI, WAS and WPS.
- Involved in Design & Development
- Development, Unit testing, Integration testing and Delivery Check.
- Application issue analysis & providing solution.
- Integrating entire modules and testing for the functionality.
- Developed modules based on the Design documents
Environment: JSF/JSR 168, Portlet, Hibernate, Spring, EJB,JQuery Oracle 9i and BPEL.
Confidential, New York
Senior J2ee Developer
Responsibilities:
- Involved in the Understanding of the Requirements and Design of the Application.
- Involved in Coding Web Services Axis and RestFull.
- Involved in Coding Generate PDF using XML, XSLT-FO, FOP and ITEXT.
- Involved in Coding Generating Excel using JXL.
- Developing web pages using JSP and establishing communication between various pages in application using TSF Framework.
- Involved in Coding Action classes.
- Auto updating Data Base every month using Batch Process(Unix Shell Scripts)
- Involved in Coded Data Base procedures using JDBC.
Environment: java, Web Services, RESTful, TSF Framework, java, JDBC, XML SAX and DOM Parsing, XSLT and XSL-FO, UNIX Shell Scripts, PL/SQL and JSP
Confidential, New York
Java Developer
Responsibilities:
- Involved in the Understanding of the Requirements and Design of the Application.
- Involved in Coding Web Services.
- Involved in Coding Generate PDF using XML, XSLT-FO, FOP and ITEXT.
- Involved in Coding Generating Excel using JXL.
- Developing web pages using JSP and establishing communication between various pages in application using TSF Framework.
- Involved in Coding Action classes.
- Auto updating Data Base every month using Batch Process(Unix Shell Scripts)
- Involved in Coded Data Base procedures using JDBC.
- Auto email periodic service performance to suppliers using Batch Process (UNIX Shell Scripts)
Environment: java, Web Services, TSF Framework, java, JDBC, XML SAX and DOM Parsing, XSLT and XSL-FO, UNIX Shell Scripts, PL/SQL and JSP
Confidential, New York
Java Developer
Responsibilities:
- Involved in development and testing.
- Involved in coding for Industrial Direct POs and Indirect POs using Web Services.
- Involved in coding Generate PDF using XML, XSLT-FO and FOP.
- Involved in coding server pages using JSP and Action Classes.
Environment: java, Web Services, SOAP, XML, SAX, DOM Parsing, XSLT, XSL-FO, TSF Framework, UNIX Scripts, PL/SQL and JSP
Confidential, New York
Java Developer
Responsibilities:
- Involved in the Understanding of the Requirements and Design of the Application.
- Involved in Coding Web Services and SOAP messages.
- Involved in Coding Generate PDF using XML, XSLT-FO, FOP and ITEXT.
- Involved in Coding Generating Excel using JXL.
- Developing web pages using JSP and establishing communication between various pages in application using TSF Framework.
- Involved in Coding Action classes.
- Auto updating Data Base every month using Batch Process(Unix Shell Scripts)
- Involved in Coded Data Base procedures using JDBC.
- Auto email periodic service performance to suppliers using Batch Process, (Unix Shell Scripts).
Environment: Java, TSF Framework, java, JDBC, AWT, XML SAX/DOM Parsing, XSLT and XSL-FO, UNIX Shell Scripts, PL/SQL, Web Services and JSP.
Confidential, New York
Java Developer
Responsibilities:
- Business Logic implemented EJB and JMS.
- Developing JSP and Action Servlet.
- Developing multi-threading for parallel processing
- Developing Coding Database classes.
Environment: Java, JSP, WASD, JDBC, Oracle, EJB and Struts.
