Hadoop Developer & Team Lead Resume
SUMMARY:
- Over 9+ years of strong experience with Hadoop Ecosystem and Java/J2EE technologies
- Sun Certified Java Programmer with good understanding of Object Oriented concepts
- 3+ years of experience with Big Data technologies like HDFS, Map Reduce(yarn), Apache Pig, Hive, Sqoop, HBase, and Oozie
- Good understanding/knowledge of Hadoop architecture and its various components.
- 6 years of experience with Java/J2EE technologies like JSP, Servlets, Java Scripts, Struts, JSTL, Spring Framework
- Developed Proof of concepts for enterprise applications using Scala
- Data Warehouse experience using Informatica Power Center as ETL tool
- Proficient with both Waterfall and Agile software development methodologies
- Worked exceptionally well with the functional users and client management for requirements analysis, problem definition and solutions development
- Ability to quickly master new concepts and applications.
- Extensive working experience in JAVA.
- Excellent communications skills. Adept at building strong working relationships with coworkers and management.
- Currently Working on Big Data Hadoop projects using MapReduce, YARN, PIG, HIVE, Sqoop, Oozie, HBase, Zookeeper, Cloudera CDH 4, and MRUnit for unit testing.
- Excellent communications skills. Adept at building strong working relationships with coworkers and management.
- Excellent client - facing, negotiation & conflict resolution skills; a highly motivated self-starter and team-player interacting effectively with stakeholders to translate business requirements into IT deliverable.
- Strong problem solving skills, good communication and good team player.
- Practiced in clarifying business requirements, performing gap analysis between goals and existing procedures/skill sets, and designing process and system improvements to increase productivity and reduce costs.
TECHNICAL SKILLS:
Hadoop/ Big Data: HDFS, Map Reduce, PIG, HIVE, HBASE, OOZIE, SQOOP,HBASE, SPARK-Scala,
Java/ J2EE: Java, JavaScript, JSP, SQL, HTML, J2EE, Spring MVC, SOAP and RESTFUL Web Services
Job Schedulers: Redwood
ETL Technologies: Informatica
Software: Eclipse, Clear Case, Toad, IBM Rational Performance Tester, NetBeans, SQL Developer, Clear Quest, BuildFarm
Databases: IBM DB2, Oracle
OS: Windows, UNIX/LINUX
Servers: Weblogic, Tomcat
Visualization Tools: Hyperion, OBIEE
PROFESSIONAL EXPERIENCE:
Confidential
Hadoop developer & Team lead
Responsibilities:
- Analyze or transform stored data by writing MapReduce based on business requirements
- Good experience in using SQOOP for handling data transfer from RDBMS to Hadoop and Vice-versa
- Analyzing/Transforming data with Hive and Pig
- Involved in loading data from LINUX file system to HDFS.
- Experience working on processing unstructured data using Pig
- Involved in developing Hive DDLs to create, alter and drop tables
- Developed Pig Latin Scripts for users for regular analysis of industrial data
- Developed Hive scripts for end user / analyst requirements to perform ad hoc analysis
- Very good understanding of Partitions, Bucketing concepts in Hive and designed both Managed and External tables in Hive to optimize performance
- Developed Oozie workflow and coordinators for scheduling and orchestrating the Apache Hadoop Jobs in the ETL process of the application
- Managed and created tables in HBASE - NoSQL database
- Involved in coding UNIX shell scripting for transmitting the files from client system to Unix server
- Loading from disparate data sets, and high-speed querying
- Created internal and external tables with properly defined static and dynamic partitions for efficiency
- Experienced in defining job flows.
- Involved in managing and reviewing Hadoop log files
- Developed Custom UDFs in PIG
- Prepared shell scripts for executing Hadoop commands for single execution
- Enabled speedy reviews and first mover advantages by using Oozie to automate data loading into the Hadoop Distributed File System and PIG to pre-process the data
- Collaborated with the infrastructure, network, database, application and BI teams to ensure data quality and availability
- Used Zookeeper for various types of centralized configurations.
- Tested the data coming from the source before processing.
- Tested and solved the critical problem faced into project.
- Managing data from various file system to HDFS using Unix command line utilities
Environment: Java, shell scripting, Hadoop, MapReduce, HIVE, Sqoop, Oracle, Eclipse, WinSCP, Putty, Jira, PIG, HDFS, Oozie, Zookeeper, UNIX, Apache Hadoop, Shell Scripting.
Confidential
J2EE & Informatica Developer
Responsibilities:
- Created mappings and sessions to implement technical enhancements for data warehouse by extracting data from sources like DB2 and Delimited Flat files
- Effectively used Informatica parameter files for defining mapping variables, workflow variables, FTP connections and relational connections
- Junit Test case preparation and execution
- Development of core functionalities in Java for different reports in application
- Consume Restful web services using Spring Integration techniques
- Integration of application with Spring MVC Framework for layered architecture
- Development of Java code to integrate application with Toyota security services
- Creation of UML diagrams like Class and Sequence diagram for modules
- Conducting Brainstorming session among developers and validating the design and approach
- Designing of DB2 tables and procedures for new requirements
- Implemented Log4j for logging mechanism
- Development of UNIX shell scripts to extract data from database on periodical basis using Redwood scheduler.
- Supporting the application for all production issues and helping the business users to complete their process on time
- Participating in all business discussions and decision making
- Responsible for Web Services configuration and Testing
- Developed SQL statements to improve back-end communications
- Worked in writing commands using UNIX,Shell scripting.
- Involved in developing other subsystems' server-side components
- Developed user interfaces using JSP, HTML, XML and JavaScript.
- Generated XML Schemas and used XML Beans to parse XML files
- Created Use case, Sequence diagrams, functional specifications and User Interface diagrams using Star UML.
- Involved in complete requirement analysis, design, coding and testing phases of the project.
Environment: Java/J2EE, Spring Framework, Eclipse, JavaScript, DB2, UNIX, FileZilla, Squirrel and Restful Web Services, Informatica, Log4j, SQL, JSP, HTML, XML and JavaScript.
Confidential
Java Developer
Responsibilities:
- Requirement analysis and preparation of Requirement Traceability Matrix.
- Impact Analysis and Effort estimation.
- Detailed Design of application and database and creating Application Design Document.
- Coding the complex module in the application and Unit Testing.
- Coordinating with all module developers and helping in integration as a lead.
- Defect Prevention Controller
- Code Review and logging the comments in the defect tracker.
- Coordinating with testing team for their smooth testing and defect logging
- Worked in writing commands using UNIX,Shell scripting.
- Involved in developing other subsystems' server-side components
- Developed user interfaces using JSP, HTML, XML and JavaScript
Environment: Java/J2EE, Spring Framework, Eclipse, JavaScript, Oracle, UNIX, FileZilla, JSON, FLEX and TOAD, JSP, HTML, XML and JavaScript.
Confidential
Java Developer
Responsibilities:
- Managing Defect Prevention Analysis for the entire project.
- Detailed Database and application design.
- Analyze the support tasks which were filed by the customer and provide a solution for the same by fixing it.
- Carry out Root Cause Analysis for the escalated bugs.
- Perform unit testing of all the defects being fixed and support tasks.
- Experience leading teams, serving as technical and project lead, contributing to project planning and estimation, conducting design and code reviews, mentoring Configuration Controller
- Created Use case, Sequence diagrams, functional specifications and User Interface diagrams using Star UML.
- Involved in complete requirement analysis, design, coding and testing phases of the project
Environment: Java/J2EE, Spring Framework, Eclipse, JavaScript, Oracle, UNIX, FileZilla and TOAD,
Confidential
Java Developer
Responsibilities:
- Addressing the issue raised during testing and fixing the same.
- Designing the format and the layout for Interface
- Detailed Database and application design
- Defect Prevention Controller
- Manage the tasks and Coding the application according to the design
- Unit and Integration test case preparation and execution
Environment: Java/J2EE, Spring Framework, Eclipse, JavaScript, Oracle, UNIX, FileZilla and TOAD.
