We provide IT Staff Augmentation Services!

Big Data/hadoop Developer Resume

0/5 (Submit Your Rating)

Charlotte, NC

SUMMARY

  • Over 8 Years of experience in the field of Information Technology and has good working experience as a Core Java Developer, Lead ETL Developer and recently a Hadoop Developer. Giri has gained extensive knowledge and working experience in the Telecom, Retail and Banking & Financial Services business units in the USA market.
  • Over 7+ years of experience in IT industry with strong emphasis on Object Oriented Analysis, ETL Design, Development and Implementation, Testing and Deployment of Data warehouse and Big data Software Applications and Web enabled applications.
  • Around 1.5 years of experience with Hadoop and Hadoop Ecosystems such as HDFS, MapReduce (MRV1 and understanding of YARN) and Hadoop Ecosystem (Pig, Hive, Hbase, Sqoop, Zookeeper, Oozie).
  • Excellent Hands on Experience in developing Hadoop Architecture within the project in Windows and Linux platforms.
  • Good technical Skills in Oracle 11i, SQL Server, ETL Development using Informatica tool.
  • Good Scripting Skills in Pig and Hive Systems.
  • Experience writing Java Map Reduce Jobs, HIVEQL for Data Architects, Data Scientists.
  • Good experience in optimizing MapReduce algorithms using Mappers, Reducers, combiners and partitioners to deliver the best results for the large datasets.
  • Good Experience in data loading from Oracle and MYSQL databases to HDFS system using Sqoop (Structure Data) and Flume (Log Files & XML).
  • Performed data analytics using PIG and Hive for Data Architects and Data Scientists within the team.
  • Have supported Hadoop Admin folks in setting up Hadoop in various modes (Pseudo Distributed and Fully Distributed Mode) and integrating Hadoop Ecosystem with Hadoop.
  • Good experience in writing Map Reduce jobs using Java native code, Pig, Hive for various business use cases.
  • Diving deep into specific Hadoop technologies and presenting those research activities to the team.
  • Ability to work in a fast changing environment and learn new technologies effortlessly
  • Work with Hadoop QA team to develop test plans, test scripts and test environments and to understand and resolve defects.
  • Participate in code reviews, software design sessions, and architectural reviews of Hadoop Ecosystems
  • Design and implement map reduce jobs to support distributed processing using java, hive and pig.
  • Build libraries, user defined functions, and frameworks around Hadoop Ecosystems.
  • Research, evaluate and utilize new technologies/tools/frameworks around Hadoop eco system
  • Developed user defined functions to provide custom hive and pig capabilities
  • Mentor junior developers in the team
  • Defined and developed best practices in Hadoop.
  • Experience in developing Java applications with the help of Core Java, XML & XSD.
  • Experience in using Configuration Management tool VSS.
  • Experience in using Oracle 11i, MS SQL Server 2005.
  • Strong understanding of Data warehouse concepts, ETL, Star Schema, Snowflake, data modeling experience using Normalization, Business Process Analysis, Reengineering, Dimensional Data modeling, FACT& dimensions tables, physical & logical data modeling.
  • Proficiency in programming with different Java IDE's like Eclipse, IntelliJ, IBM RAD 6.x/7.x, WSAD and Net Beans.

TECHNICAL SKILLS

Operating Systems: Windows,Linux (Ubuntu, Redhat)

Big Data Platform: Cloudera Hadoop CDH3/4, Java MapReduce (MRV1, MRV2 YARN), Pig, Hive, Hbase Sqoop, Zookeeper, Oozie, Flume on Windows and Linux.

ETL/BI Tools: Informatica Power Center 9.1, Power Exchange 9.1, DataStage 7.5, TOAD for Oracle 11i, Terradata SQL Assistant 12.0, Query Surge, Autosys, IBM Cognos Query Studio/Analyzer, OBIEE 11g Reports, SSIS, SSAS, SSRS, SQL Loader.

Web Services: SOAP, WSDL, JAXB, XML, XSLT

Programming Skills: C, C++, Core Java

Web Technologies: JSP, HTML, CSS, Ajax, jQuery

Application & Web Servers: IBM Websphere, Weblogic.

Database/Tools: IBM DB2 V9.1, SQL Server, Oracle 11i, Rapid SQL Analyzer 7.2, NoSQL.

Frameworks: Struts, Spring, Hibernate

Other Tools: Maven, JUNIT, LOG 4j, Eclipse IDE

PROFESSIONAL EXPERIENCE

Confidential - Charlotte, NC

Big Data/Hadoop Developer

Responsibilities:

  • Developed and Supported Map Reduce Programs those are running on the cluster.
  • Gathered the business requirements from the Business Partners and Subject Matter Experts.
  • Created Hive tables and working on them using Hive QL.
  • Involved in installing Hadoop Ecosystem components.
  • Validated Namenode, Datanode status in a HDFS cluster.
  • Handled 2 TB of data volume and implemented the same in Production.
  • Weekly meetings with technical collaborators and active participation in code review sessions with senior and junior developers.
  • Used to manage and review the Hadoop log files.
  • Responsible to manage data coming from different sources.
  • Supporting Hbase Architecture Design with the Hadoop Architect team to develop a Database Design in HDFS.
  • Supported Map Reduce Programs those are running on the cluster.
  • Involved in HDFS maintenance and loading of structured and unstructured data.
  • Wrote MapReduce jobs using Java API.
  • Wrote Hive queries for data analysis to meet the business requirements.
  • Installed and configured Pig and also written PigLatin scripts.
  • Developed UDFs for Pig Data Analysis.
  • Involved in managing and reviewing Hadoop log files.
  • Developed Scripts and Batch Job to schedule various Hadoop Program.
  • Utilized Agile Scrum Methodology to help manage and organize a team of 4 developers with regular code review sessions.
  • Used JUnit for unit testing and Continuum for integration testing.
  • Worked hands on with ETL process.
  • Upgrading the Hadoop Cluster from CDH3 to CDH4 and setup High availability Cluster Integrate the HIVE with existing applications
  • Handled importing of data from various data sources, performed transformations using Hive, MapReduce,
  • Analyzed the data by performing Hive queries and running Pig scripts to know user behavior.
  • Continuous monitoring and managing the Hadoop cluster through Cloudera Manager.
  • Installed Oozie workflow engine to run multiple Hive and Pig jobs.
  • Developed Hive queries to process the data and generate the data cubes for visualizing.
  • Imported Source/Target tables from the respective Business Warehouse systems and created reusable transformations (Joiner, Routers, Lookups, Rank, Filter, Expression and Aggregator) inside a Mapplets and created new mappings using Designer module of Informatica Power Center to implement the business logic and to load the customer healthcare data incrementally and full.
  • Created Complex mappings using Unconnected Lookup, and Aggregate and Router transformations for populating target table in efficient manner.
  • Optimized the mappings using various optimization techniques and also debugged some existing mappings using the Debugger to test and fix the mappings.
  • Update maps, sessions and workflows as a part of ETL change.
  • Modifications to existing ETL Code and document the changes.

Environment: Java, Hadoop, MapReduce, HDFS, Hive, Pig, Linux, XML, Eclipse, Cloudera, CDH3/4 Distribution, Informatica 9.1, SQL Server, Oracle 11i, MySQL

Confidential - Wilkes Barre, PA

ETL Developer & Hadoop Developer

Responsibilities:

  • Extracted files from Mainframe DB, Oracle, and SQL Server through Sqoop and placed in HDFS and processed.
  • Moved 1TB of Student Loan Volumes into HDFS and did analysis for finding the Delinquent Loan Students in the last 10 Years.
  • Involved in defining job flows, managing and reviewing log files.
  • Developed Mapreduce Programs to research the HDFS data and moved them into Flat Files in Linux.
  • Load and transform large sets of structured, semi structured and unstructured data.
  • Supported Map Reduce Programs those are running on the cluster.
  • Developed HiveQL scripts to manipulate the data in HDFS.
  • Worked on the Hbase architecture design for the Loan Volumes in HDFS.
  • Installed and configured Hive and also written Hive UDFs.
  • Involved in creating Hive tables, loading with data and writing hive queries which will run internally in Map Reduce way.
  • Responsible and active in the analysis, design, implementation and deployment of full Software Development Lifecycle (SDLC) of the project.
  • Designed and developed user interface using JSP, HTML and JavaScript.
  • Developed Struts action classes, action forms and performed action mapping using Struts framework and performed data validation in form beans and action classes.
  • Extensively used Struts framework as the controller to handle subsequent client requests and invoke the model based upon user requests.
  • Defined the search criteria and pulled out the record of the customer from the database. Make the required Changes and save the updated record back to the database.
  • Validated the fields of user registration screen and login screen by writing JavaScript validations.
  • Worked in Informatica for the Extraction, Transformation and Loading from various sources to the enterprise data warehouse Developed and tested extraction, transformation, and load (ETL) processes Involved in change data capture (CDC) ETL process Created sessions and workflows for the source to staging data flow and staging to Target loading Involved in Designing, Developing, Bug fixing, documenting and unit testing the application.
  • Written the JUNIT test cases for unit testing. Used Log4j for application debugging. Used Maven scripts for build process.

Environment: Web logic Application Server 9.2,Java 1.5, JSP, SQL/PL SQL, Java script, Java, Hadoop, MapReduce, HDFS, Hive, Pig, Linux, XML, MySQL, Eclipse, Cloudera CDH3 Distribution.

Confidential

Java Developer

Responsibilities:

  • Involved in deploying the application with Spring Framework and Hibernate
  • Involved in gathering business requirements, analyzing the project and created UML diagrams such as Use Cases, Class Diagrams, Sequence Diagrams and flowcharts for the Optimization module using Microsoft Visio.
  • Implemented the AJAX, JSPs, and Servlets, in the MVC Struts Framework to effectively handle the workflow of the application.
  • Developed Action classes to handle HTTP client requests by using HTTP Servlet Request, HTTP Servlet Response, and Action Mapping and Action Form objects.
  • Worked with Core Spring Framework for Dependency Injection, Spring Context to provide message sources
  • Developed Spring Configuration file to define data source, beans and Hibernate properties
  • Designed and developed the User Interface using JSP, JSF, HTML, CSS and JavaScript
  • Various JSFwere used to implement asynchronous requests to web container
  • Worked with Spring web flow to represent UI flow
  • Implemented Design Patterns like MVC, Session Facade and Data Transfer Objects
  • Used Hibernate XDoclet tags to generate hbm. xml files
  • Worked with Hibernate for developing Persistence classes to interact with the database
  • Implemented WSDL XML document to located and describe the web services
  • Developed Ant scripts to deploy EAR, WAR files for deployment into server
  • Successfully executed all the test cases and fixed any bugs/issues identified during the test cycles
  • Used Eclipse IDE and Web Sphere application server in development.
  • Worked with Log4J for logging purpose in the project
  • Involved in building and deploying scripts using Maven to generate WAR, EAR and JAR files

Environment: Web logic Application Server 9.2,Java 1.5, JSP, SQL/PL SQL, Java script, Java, Hadoop, MapReduce, HDFS, Hive, Pig, Linux, XML, MySQL, Eclipse, Cloudera CDH3 Distribution.

Confidential

Java Developer

Responsibilities:

  • Had developed Business Object, POJO and helper classes to access database.
  • Designed and Developed UI's using Nexaweb Studio and Platform.
  • Involved in coding JSP and configuring spring framework.
  • Used Spring Framework for Dependency injection and integrated with Mybatis.
  • Developed applications using Mybatis, developed persistent classes.
  • GUI was developed using JSP and JavaScript.
  • Involved in the Development of Spring Framework Controllers.
  • Developed Mybatis in Data Access Layer to access and update information in the database.
  • Used RapidSQL 7.6.3 for checking the Database.
  • Was involved in Regression testing and Integrating testing with external systems.
  • Involved in bug fixing for the code in production and was developed the code for next release.
  • Resource bundle helper for client side internationalization.
  • The project was developed on Eclipse and the version Controller was Starteam.
  • The project was deployed to test on local Environment on Apache Tomcat 5.5 and it was deployed on WebLogic in Production.
  • Used Log4J to print the logging, debugging, warning, info on the server console.

Environment: Java1.6, Nexaweb Platform 4.5.47, Nexaweb Studio 5.0, Spring MVC Framework, JSP, Servlets, Log4J, HTML, JavaScript, XML/XSLT, Sybase 15, Web Logic 11.x, Apache Tomcat 5.5, RapidSQL 7.6.3.

Confidential

ETL Developer & Java Developer

Responsibilities:

  • Involved in Designing, Developing, Documenting and Unit Testing the application.
  • Involved in the development of GUI screens using JSP and JavaScript.
  • Involved in gathering business requirements, analysing the project and created UML diagrams such as
  • Use Cases, Class Diagrams, Sequence Diagrams and flowcharts for the Optimization module using Microsoft Visio
  • Analysed and implemented the Struts2 framework
  • Used MyEclipse IDE and JBoss 5.1 and Apache Tomcat 7.0 application server in development.
  • Used TOAD FOR ORACLE 11.5 for connecting to database and look at the tables and make necessary modifications in the tables
  • Involved in mapping data base tables with Business objects using Hibernate (.hbm.xml files)
  • Developed unit test cases using JUnit.
  • Used log4j for Displaying messages

Environment: Struts2, Hibernate, MyEclipse IDE, Apache Tomcat Application Server 7.0, TOAD FOR ORACLE 11.5 Freeware, Java 1.6, JSP, Java script, JUnit 4.0, log4j, Informatica.

Confidential

Java Developer

Responsibilities:

  • Preparation of Use cases and Test cases.
  • Using JSP/HTML/Struts developed UI screens.
  • Always used the best practices of Java/J2EE, continuous re-factoring of code, minimize database calls, optimized queries to get better performance of application.
  • Developed code for handling exceptions and converting them into Action Messages.
  • Used JavaScript for validations and other checking functionality for the UI screens.
  • Involved in Struts Based Validation
  • Involved in rmation module.
  • Designed and developed the user interface layer using JSP, Java Script, Ajax, HTML, CSS and DHTML.
  • Used DHTML to control the display, position HTML elements and to handle events in the user interface.
  • Used JavaScript objects to handle events on text boxes, forms to call business logic.
  • Analyzed and implemented the Spring MVC framework
  • Used AJAX for client-to-server communication
  • Involved in resolving business technical issues.
  • Involved in writing code to invoke Web services in other applications based on the WSDL files
  • Used Hibernate ORM to interact with the oracle database to retrieve, insert and update the data.
  • Written the JUNIT test cases for the functionalities.
  • Developed and tuned the database SQL queries.
  • Used Eclipse IDE and Tomcat 5.5 web application server in development.
  • Used CVS version control and Clear Quest in bug tracking.

Environment: J2EE, Struts, Tomcat, Windows 2000, MySQL, Eclipse

Confidential

Java Developer

Responsibilities:

  • Involved in the development of GUI (Graphical User Interface) components like JSP and HTML.
  • The Web-Tier layer is managed using Struts, JSP's, Struts Tag Lib and Java Script.
  • The Business-Tier layer designed with Business Delegate design pattern for lookup and access details of the EJB architecture.
  • Developed State-full session beans for maintaining state.
  • Used BEA WebLogic application server to deploy the applications locally and tested the application remotely.
  • Prepared JUnit test classes for the application.
  • Involved in Unit Testing and Integration of the Modules.
  • Participated in System Testing and Environment Testing
  • Regression Testing is also the part of the Project which involves in solving the problems in the earlier versions
  • Developed JSP custom tags (library).
  • Java Beans were used to handle business logic as a Model and Servlets to control the flow of application as Controller.
  • Front end validations are written using JavaScript.
  • Performed Unit Testing using JUnit.
  • Provided a User Manual and User on the new system to ease them into the new system.

Environment: Core Java, Struts, JBoss, Oracle 10g, Servlets, JSP, JavaScript, HTML.

We'd love your feedback!