We provide IT Staff Augmentation Services!

Hadoop Developer & Team Lead Resume

5.00/5 (Submit Your Rating)

SUMMARY:

  • Over  9+ years of strong experience with Hadoop Ecosystem and Java/J2EE technologies
  • Sun Certified Java Programmer with good understanding of Object Oriented concepts
  • 3+ years of experience with Big Data technologies like HDFS, Map Reduce(yarn), Apache Pig, Hive, Sqoop, HBase, and Oozie
  • Good understanding/knowledge of Hadoop architecture and its various components.
  • 6 years of experience with Java/J2EE technologies like JSP, Servlets, Java Scripts, Struts, JSTL, Spring Framework
  • Developed Proof of concepts for enterprise applications using Scala
  • Data Warehouse experience using Informatica Power Center as ETL tool
  • Proficient with both Waterfall and Agile software development methodologies
  • Worked exceptionally well with the functional users and client management for requirements analysis, problem definition and solutions development
  • Ability to quickly master new concepts and applications.
  • Extensive working experience in JAVA.
  • Excellent communications skills. Adept at building strong working relationships with coworkers and management.
  • Currently Working on Big Data Hadoop projects using MapReduce, YARN, PIG, HIVE, Sqoop, Oozie, HBase, Zookeeper, Cloudera CDH 4, and MRUnit for unit testing.
  • Excellent communications skills. Adept at building strong working relationships with coworkers and management.
  • Excellent client - facing, negotiation & conflict resolution skills; a highly motivated self-starter and team-player interacting effectively with stakeholders to translate business requirements into IT deliverable.
  • Strong problem solving skills, good communication and good team player.
  • Practiced in clarifying business requirements, performing gap analysis between goals and existing procedures/skill sets, and designing process and system improvements to increase productivity and reduce costs.

TECHNICAL SKILLS:

Hadoop/ Big Data: HDFS, Map Reduce, PIG, HIVE, HBASE, OOZIE, SQOOP,HBASE, SPARK-Scala,

Java/ J2EE: Java, JavaScript, JSP, SQL, HTML, J2EE, Spring MVC, SOAP and RESTFUL Web Services

Job Schedulers: Redwood

ETL Technologies: Informatica

Software: Eclipse, Clear Case, Toad, IBM Rational Performance Tester, NetBeans, SQL Developer, Clear Quest, BuildFarm

Databases: IBM DB2, Oracle

OS: Windows, UNIX/LINUX

Servers: Weblogic, Tomcat

Visualization Tools: Hyperion, OBIEE

PROFESSIONAL EXPERIENCE:

Confidential

Hadoop developer & Team lead

Responsibilities:

  • Analyze or transform stored data by writing MapReduce based on business requirements
  • Good experience in using SQOOP for handling data transfer from RDBMS to Hadoop and Vice-versa
  • Analyzing/Transforming data with Hive and Pig
  • Involved in loading data from LINUX file system to HDFS.
  • Experience working on processing unstructured data using Pig
  • Involved in developing Hive DDLs to create, alter and drop tables
  • Developed Pig Latin Scripts for users for regular analysis of industrial data
  • Developed Hive scripts for end user / analyst requirements to perform ad hoc analysis
  • Very good understanding of Partitions, Bucketing concepts in Hive and designed both Managed and External tables in Hive to optimize performance
  • Developed Oozie workflow and coordinators for scheduling and orchestrating the Apache Hadoop Jobs in the ETL process of the application
  • Managed and created tables in HBASE - NoSQL database
  • Involved in coding UNIX shell scripting for transmitting the files from client system to Unix server
  • Loading from disparate data sets, and high-speed querying
  • Created internal and external tables with properly defined static and dynamic partitions for efficiency
  • Experienced in defining job flows.
  • Involved in managing and reviewing Hadoop log files
  • Developed Custom UDFs in PIG
  • Prepared shell scripts for executing Hadoop commands for single execution
  • Enabled speedy reviews and first mover advantages by using Oozie to automate data loading into the Hadoop Distributed File System and PIG to pre-process the data
  • Collaborated with the infrastructure, network, database, application and BI teams to ensure data quality and availability
  • Used Zookeeper for various types of centralized configurations.
  • Tested the data coming from the source before processing.
  • Tested and solved the critical problem faced into project.
  • Managing data from various file system to HDFS using Unix command line utilities

Environment: Java, shell scripting, Hadoop, MapReduce, HIVE, Sqoop, Oracle, Eclipse, WinSCP, Putty, Jira, PIG, HDFS, Oozie, Zookeeper, UNIX, Apache Hadoop, Shell Scripting.

Confidential

J2EE & Informatica Developer

Responsibilities:

  • Created mappings and sessions to implement technical enhancements for data warehouse by extracting data from sources like DB2 and Delimited Flat files
  • Effectively used Informatica parameter files for defining mapping variables, workflow variables, FTP connections and relational connections
  • Junit Test case preparation and execution
  • Development of core functionalities in Java for different reports in application
  • Consume Restful web services using Spring Integration techniques
  • Integration of application with Spring MVC Framework for layered architecture
  • Development of Java code to integrate application with Toyota security services
  • Creation of UML diagrams like Class and Sequence diagram for modules
  • Conducting Brainstorming session among developers and validating the design and approach
  • Designing of DB2 tables and procedures for new requirements
  • Implemented Log4j for logging mechanism
  • Development of UNIX shell scripts to extract data from database on periodical basis using Redwood scheduler.
  • Supporting the application for all production issues and helping the business users to complete their process on time
  • Participating in all business discussions and decision making
  • Responsible for Web Services configuration and Testing
  • Developed SQL statements to improve back-end communications
  • Worked in writing commands using UNIX,Shell scripting.
  • Involved in developing other subsystems' server-side components
  • Developed user interfaces using JSP, HTML, XML and JavaScript.
  • Generated XML Schemas and used XML Beans to parse XML files
  • Created Use case, Sequence diagrams, functional specifications and User Interface diagrams using Star UML.
  • Involved in complete requirement analysis, design, coding and testing phases of the project.

Environment: Java/J2EE, Spring Framework, Eclipse, JavaScript, DB2, UNIX, FileZilla, Squirrel and Restful Web Services, Informatica, Log4j, SQL, JSP, HTML, XML and JavaScript.

Confidential

Java Developer

Responsibilities:

  • Requirement analysis and preparation of Requirement Traceability Matrix.
  • Impact Analysis and Effort estimation.
  • Detailed Design of application and database and creating Application Design Document.
  • Coding the complex module in the application and Unit Testing.
  • Coordinating with all module developers and helping in integration as a lead.
  • Defect Prevention Controller
  • Code Review and logging the comments in the defect tracker.
  • Coordinating with testing team for their smooth testing and defect logging
  • Worked in writing commands using UNIX,Shell scripting.
  • Involved in developing other subsystems' server-side components
  • Developed user interfaces using JSP, HTML, XML and JavaScript

Environment: Java/J2EE, Spring Framework, Eclipse, JavaScript, Oracle, UNIX, FileZilla, JSON, FLEX and TOAD, JSP, HTML, XML and JavaScript.

Confidential

Java Developer

Responsibilities:

  • Managing Defect Prevention Analysis for the entire project.
  • Detailed Database and application design.
  • Analyze the support tasks which were filed by the customer and provide a solution for the same by fixing it.
  • Carry out Root Cause Analysis for the escalated bugs.
  • Perform unit testing of all the defects being fixed and support tasks.
  • Experience leading teams, serving as technical and project lead, contributing to project planning and estimation, conducting design and code reviews, mentoring Configuration Controller
  • Created Use case, Sequence diagrams, functional specifications and User Interface diagrams using Star UML.
  • Involved in complete requirement analysis, design, coding and testing phases of the project

Environment: Java/J2EE, Spring Framework, Eclipse, JavaScript, Oracle, UNIX, FileZilla and TOAD,

Confidential

Java Developer

Responsibilities:

  • Addressing the issue raised during testing and fixing the same.
  • Designing the format and the layout for Interface
  • Detailed Database and application design
  • Defect Prevention Controller
  • Manage the tasks and Coding the application according to the design
  • Unit and Integration test case preparation and execution

Environment: Java/J2EE, Spring Framework, Eclipse, JavaScript, Oracle, UNIX, FileZilla and TOAD.

We'd love your feedback!