We provide IT Staff Augmentation Services!

Big Data/hadoop Developer Resume

2.00/5 (Submit Your Rating)

Charlotte, NC

SUMMARY

  • 8 +Years of experience in the field of Information Technology and TEMPhas good working experience as a Lead Java Developer, Lead ETL Developer and recently a Hadoop Developer.
  • Gained extensive knowledge and working experience in the Retail and Banking & Financial Services business units in the USA market.
  • Expertized in IT industry wif strong emphasis Object Oriented Analysis, Design, Development and Implementation, Testing and Deployment of Data warehouse and Big data Software Applications and Web enabled applications.
  • Around 2 years of experience wif Hadoop, HDFS, Map Reduce (MRV1 & MRV2 YARN) and Hadoop Ecosystem (Pig, Hive, Hbase, Sqoop, Zookeeper, Oozie).
  • Experience writing Map Reduce Jobs, HIVEQL.
  • Good experience in optimizing MapReduce algorithm using combiners and partitioners to deliver the best results.
  • Good Experience in data loading from RDBS system to HDFS system using Sqoop and Flume.
  • Performed data analytics using PIG and Hive.
  • Experience in designing Big Data solutions for traditional enterprise businesses.
  • Experience in Setting up Hadoop in various modes and integrating Hadoop Ecosystem wif Hadoop.
  • Experience in working wif Amazon Web Services for installing and maintain the Hadoop cluster.
  • Good experience in writing Map Reduce jobs using Java native code, Pig, Hive for various business use cases.
  • Built complex algorithms that implement state of the art analytics on Hadoop
  • Built large distributed systems that scale well
  • Experience in debugging the platform issues that arise wif the open source software being used and fix them
  • Diving deep into specific Hadoop and non - Hadoop technologies and presenting those research activities to the team
  • Ability to work in a fast changing environment and learn new technologies effortlessly
  • Work wif QA to develop test plans, test scripts and test environments and to understand and resolve defects.
  • Participate in code reviews, software design sessions, and architectural reviews
  • Design and implement map reduce jobs to support distributed processing using java, hive and pig.
  • Build libraries, user defined functions, and frameworks around Hadoop.
  • Research, evaluate and utilize new technologies/tools/frameworks around Hadoop eco system
  • Developed user defined functions to provide custom hive and pig capabilities
  • Mentor junior developers in the team
  • Defined and build data acquisitions and consumption strategies
  • Defined and developed best practices in Hadoop
  • Experience in developing J2EE applications wif EJB, Struts, JSF, spring, Hibernate & IBatis Frameworks.
  • Experience in developing Java applications wif the halp of Core Java, XML & XSD.
  • Experience in using Oracle 11i, MS SQL Server 2005.
  • Strong understanding of Data warehouse concepts, ETL, Star Schema, Snowflake, data modeling experience using Normalization, Business Process Analysis, Reengineering, Dimensional Data modeling, FACT& dimensions tables, physical & logical data modeling.
  • Proficiency in programming wif different Java IDE's like Eclipse, IntelliJ, IBM RAD 6.x/7.x, WSAD and Net Beans.

TECHNICAL SKILLS

Operating Systems: Windows, Linux (Ubuntu, Redhat)

Big Data Platform: Cloudera Hadoop CDH3/4, Java MapReduce (MRV1, MRV2 YARN), Pig, Hive, Hbase Sqoop, Zookeeper, Oozie, Flume on Linux.

ETL/BI Tools: Informatica Power Center 9.1, Power Exchange 9.1, DataStage 7.5, TOAD for Oracle 11i, Terradata SQL Assistant 12.0, Query Surge, Autosys, IBM Cognos Query Studio/Analyzer, OBIEE 11g Reports, SSIS, SSAS, SSRS, SQL Loader

Web Services: SOAP, WSDL, JAXB, XML

Programming Skills: C++, Core Java

Web Technologies: JSP, Servlets, JSF, HTML, CSS, Ajax, jQuery

Application & Web Servers: IBM Websphere, Weblogic.

Database/Tools: IBM DB2 V9.1, SQL Server, Oracle 11g, Rapid SQL Analyzer 7.2, NoSQL.

Frameworks: Struts, Spring, Hibernate

Other Tools: Maven, JUNIT, LOG 4j, Eclipse IDE

PROFESSIONAL EXPERIENCE

Confidential, Charlotte, NC

Big Data/Hadoop Developer

Responsibilities:

  • Developed and Supported Map Reduce Programs those are running on the cluster.
  • Gatheird the business requirements from the Business Partners and Subject Matter Experts.
  • Created Hive tables and working on them using Hive QL.
  • Involved in installing Hadoop Ecosystem components.
  • Involved in working wif Amazon Web Services for installing and maintain the Hadoop cluster.
  • Validated Namenode, Data node status in a HDFS cluster.
  • Handled 2 TB of data volume and implemented the same in Production.
  • Weekly meetings wif technical collaborators and active participation in code review sessions wif senior and junior developers.
  • Used to manage and review the Hadoop log files.
  • Responsible to manage data coming from different sources.
  • Supported Map Reduce Programs those are running on the cluster.
  • Involved in HDFS maintenance and loading of structured and unstructured data.
  • Wrote Map Reduce job using Java API.
  • Wrote Hive queries for data analysis to meet the business requirements.
  • Installed and configured Pig and also written PigLatin scripts.
  • Developed UDFs for Pig Data Analysis
  • Involved in managing and reviewing Hadoop log files.
  • Developed Scripts and Batch Job to schedule various Hadoop Program.
  • Utilized Agile Scrum Methodology to halp manage and organize a team of 4 developers wif regular code review sessions.
  • Used JUnit for unit testing and Continuum for integration testing.
  • Worked hands on wif ETL process.
  • Upgrading the Hadoop Cluster from CDH3 to CDH4 and setup High availability Cluster Integrate the HIVE wif existing applications
  • Configured Ethernet bonding for all Nodes to double the network bandwidth
  • Handled importing of data from various data sources, performed transformations using Hive, MapReduce,
  • Analyzed the data by performing Hive queries and running Pig scripts to know user behavior.
  • Continuous monitoring and managing the Hadoop cluster through Cloudera Manager.
  • Installed Oozie workflow engine to run multiple Hive and Pig jobs.
  • Developed Hive queries to process the data and generate the data cubes for visualizing.
  • Imported Source/Target tables from the respective SAP R3 and BW systems and created reusable transformations (Joiner, Routers, Lookups, Rank, Filter, Expression and Aggregator) inside a Mapplets and created new mappings using Designer module to implement the business logic and to load the customer healthcare data incrementally and full.
  • Created Complex mappings using Unconnected Lookup, and Aggregate and Router transformations for populating target table in efficient manner.
  • Optimized the mappings using various optimization techniques and also debugged some existing mappings using the Debugger to test and fix the mappings.
  • Update maps, sessions and workflows as a part of ETL change.
  • Modifications to existing ETL Code and document the changes.

Confidential, Fishers, Indiana

Lead Java Developer

Responsibilities:

  • Importing and exporting data into HDFS and Hive using Sqoop.
  • Involved in defining job flows, managing and reviewing log files.
  • Extracted files from Mainframe DB, Oracle, and SQL Server through Sqoop and placed in HDFS and processed.
  • Load and transform large sets of structured, semi structured and unstructured data.
  • Responsible to manage data coming from different sources.
  • Supported Map Reduce Programs those are running on the cluster.
  • Involved in loading data from UNIX file system to HDFS.
  • Installed and configured Hive and also written Hive UDFs.
  • Involved in creating Hive tables, loading wif data and writing hive queries which will run internally in Map Reduce way.
  • Gained very good business knowledge on health insurance, claim processing, fraud suspect identification, appeals process etc.
  • Responsible and active in the analysis, design, implementation and deployment of full Software Development Lifecycle (SDLC) of the project.
  • Designed and developed user interface using JSP, HTML and JavaScript.
  • Defined the search criteria and pulled out the record of the customer from the database. Make the required Changes and save the updated record back to the database.
  • Validated the fields of user registration screen and login screen by writing JavaScript validations.
  • Worked on ETL for the Extraction, Transformation and Loading from various sources to the enterprise data warehouse Developed and tested extraction, transformation, and load (ETL) processes Involved in change data capture (CDC) ETL process Created sessions and workflows for the source to staging data flow and staging to Target loading Involved in Designing, Developing, Bug fixing, documenting and unit testing the application.
  • Involved in the development of GUI screens using JSP, XML/XSLT, HTML and JavaScript.
  • Analyzed and developed the application using Spring MVC framework.
  • Used AJAX for client-to-server communication.
  • Used spring framework in the development of a business bean and to interact wif the Hibernate ORM tool.
  • Used Web services to get the data from the central system.

Confidential, Bentonville, AR

Lead Java Developer & ETL Lead

Responsibilities:

  • Involved in deploying the application wif Spring Framework and Hibernate
  • Involved in gathering business requirements, analyzing the project and created UML diagrams such as Use Cases, Class Diagrams, Sequence Diagrams and flowcharts for the Optimization module using Microsoft Visio.
  • Implemented the AJAX, JSPs, and Servlets, in the MVC Struts Framework to effectively handle the workflow of the application.
  • Developed Action classes to handle HTTP client requests by using HTTP Servlet Request, HTTP Servlet Response, and Action Mapping and Action Form objects.
  • Worked wif Core Spring Framework for Dependency Injection, Spring Context to provide message sources
  • Developed Spring Configuration file to define data source, beans and Hibernate properties
  • Designed and developed the User Interface using JSP, JSF, HTML, CSS and JavaScript
  • Various JSFwere used to implement asynchronous requests to web container
  • Worked wif Spring web flow to represent UI flow
  • Implemented Design Patterns like MVC, Session Facade and Data Transfer Objects
  • Used Hibernate XDoclet tags to generate hbm.xml files
  • Worked wif Hibernate for developing Persistence classes to interact wif the database
  • Implemented WSDL XML document to located and describe the web services
  • Developed Ant scripts to deploy EAR, WAR files for deployment into server
  • Successfully executed all the test cases and fixed any bugs/issues identified during the test cycles
  • Used Eclipse IDE and Web Sphere application server in development.
  • Worked wif Log4J for logging purpose in the project
  • Experience in developing and updating SSIS and DTS packages and converting DTS packages to SSIS.
  • Experience in defining data warehouse solution, multidimensional model, logical and physical models design, data types, staging process and its benefits, and different data warehouse design approaches (top down, bottom-up) and schemas (Star, Snow Flakes, etc.)
  • Proficient wif SQL language
  • Identify the OLAP models

Confidential

Java Developer

Responsibilities:

  • Had developed Business Object, POJO and halper classes to access database.
  • Designed and Developed UI's using Nexaweb Studio and Platform.
  • Involved in coding JSP and configuring spring framework.
  • Used Spring Framework for Dependency injection and integrated wif Mybatis.
  • Developed applications using Mybatis, developed persistent classes.
  • GUI was developed using JSP and JavaScript.
  • Involved in the Development of Spring Framework Controllers.
  • Developed Mybatis in Data Access Layer to access and update information in the database.
  • Used RapidSQL 7.6.3 for checking the Database.
  • Was involved in Regression testing and Integrating testing wif external systems.
  • Involved in bug fixing for the code in production and was developed the code for next release.
  • Resource bundle halper for client side internationalization.
  • The project was developed on Eclipse and the version Controller was Starteam.
  • The project was deployed to test on local Environment on Apache Tomcat 5.5 and it was deployed on WebLogic in Production.
  • Used Log4J to print the logging, debugging, warning, info on the server console.

We'd love your feedback!