We provide IT Staff Augmentation Services!

Hadoop Developer/tech Lead Resume

0/5 (Submit Your Rating)

Montvale New, JerseY

SUMMARY

  • Over 10 years of experience in Java/J2EE technologies and worked in all phases of Software Development Life Cycle.
  • Experience on BigData Analytics with hands on experience on writing MapReducejobs on Hadoop Ecosystem including Hive and Pig.
  • Experience with distributed systems, large scale non - relational data stores, mapreduce systems, data modeling, and big data systems.
  • Very good understanding on NOSQL databases like mongoDB and HBase.
  • About 1 year of work experience on Big Data Analytics.
  • Have hands on experience in writing MapReduce jobs on Hadoop Ecosystem including Hive and Pig.
  • Hands on experience in installing, configuring and using ecosystem components like Hadoop MapReduce, HDFS, Pig, Hive, Sqoop.
  • Handling and further processing schema oriented and non-schema oriented data using Pig.
  • Read, processed and stored desperate data in parallel using Pig.
  • About 6 years of work experience as a Java/J2EE programmer developing applications using Servlets, JSP, JSTL, RMI, EJB, Struts, Spring, JSF, Java Beans, JDBC, JMS, Hibernate and MVC architecture.
  • Experience in implementation of Open-Source frameworks like Struts, Spring, Hibernate, Web Services etc.
  • Good knowledge of database connectivity (JDBC) for databases like Oracle, DB2, SQL Server, MySql, MS Access.
  • Experience in deploying applications in heterogeneous Application Servers TOMCAT, Web Logic and Oracle Application Server.
  • Worked primarily in the domain of Banking & Financial Services. Have been involved with Development, Reengineering, Maintenance and Testing type of projects.
  • Diverse experience in utilizing Java frameworks in business, web and client-server environments including Java EE, Spring (IOC & AOP), Hibernate/iBatis, Struts2.0/1.2, Ant, Maven, Log4j, Servlets, JSP, Spring MVC, Custom Tags and Java Database Connectivity (JDBC) technologies.
  • Expertise in XML, SOAP, WSDL, and developing J2EE Web Services based on JAXWS, JAXRPC & Restful.
  • Extensive experience in developing GUI using Java Script, JQuery, JSON and AJAX.
  • Experience in implementing Core Java & J2EE design patterns like Factory Pattern, MVC, DAO, Front Controller, Business Delegate, Service Locator,Singleton and etc.
  • Experience in configuration and deployment of multi-tier applications in servers like WebSphere Application Server (WAS), Web logic, JBoss and Tomcat.
  • Skilled in different tools like Eclipse, RAD, SVN/CVS, RTC, ClearCase, SOAP UI, TOAD, Putty, MS Visio, Rational Rose.
  • Experience in Standard Build, Deployment & Release strategy in DEV, QA, PROD using Ant.
  • Experience in Core Java concepts such as Multi-threading, IO, Exceptions, and Collections and Sun Certified Java Programmer (SCJP).
  • Strong database development experience with Oracle & DB2 databases. Knowledge of SQL data types, indexes, Joins, Views, Sequences, transactions, Large Objects, System tables, Stored Procedures andPerformance Tuning. Possessing IBM Certified Programmer on DB2 9 Fundamentals.
  • Worked on distributed schedule setup, maintenance, developing scripts to automate setup process, issue triaging in Tivoli Workload Scheduler(TWS) and Autosys Job Management Tools.
  • Fluid understanding of multiple programming languages including Java, SQL, PL/SQL, HTML, XML.
  • In-depth understanding of Data Structures and Algorithms.
  • Excellent analytical, problem solving, communication and inter-personal skills with ability to interact with individuals at ease.

TECHNICAL SKILLS

Programming Languages: JAVA, J2EE, C, SQL, PL/SQL, and JIL.

Frameworks & APIs: Struts2.0,Servlets & JSP, Spring3.0, Log4j/SLF4J, XMLParsers (SAX, DOM, JAXB & STAX),JDBC, JUnit 4.0Web Technologies JQuery, AJAX, JSON, Adobe Flex, HTML, CSS, Java Script, JQuery, JSP, Java Web services& SpringMVC.

ORM: Hibernate, iBatis & JPA.

Design & Modeling: UML, Design Patterns, Agile SCRUM, Rational Rose 3.0 & MS Visio.

Databases & File System: DB2, Oracle, SQL Server, MySQL.

Tools: /IDEs: MasterCraft, RAD 7.5, Net Beans and Eclipse.

Build Tools: ANT, Maven.

Version Control Systems: CVS, SVN, RTC, ClearCase.

Web/Application Servers: Tomcat 5.0,Websphere7.0,Weblogic8.0 and JBoss 4.5

Big Data Technologies: Hadoop, MapReduce, HDFS,Hive, Pig, Sqoop, Flume, Oozie, Zookeeper,NoSQL, Cassandra & HBase

PROFESSIONAL EXPERIENCE

Confidential, Montvale, New Jersey

Hadoop Developer/Tech Lead

Responsibilities:

  • Installed and configured Hadoop MapReduce, HDFS, developed multiple MapReduce jobs in Java for data cleaning and preprocessing.
  • Good understanding and related experience with Hadoop stack - internals, Hive, Pig and Map/Reduce
  • Wrote MapReduce jobs to discover trends in data usage by users.
  • Involved in defining job flows
  • Involved in managing and reviewing Hadoop log files
  • Involved in running Hadoop streaming jobs to process terabytes of text data
  • Load and transform large sets of structured, semi structured and unstructured data
  • Responsible to manage data coming from different sources
  • Supported Map Reduce Programs those are running on the cluster
  • Involved in loading data from UNIX file system to HDFS.
  • Installed and configured Hive and also written Hive QL scripts.
  • Responsible to manage data coming from different sources
  • Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way
  • Implemented Partitioning, Dynamic Partitions, Buckets in HIVE.
  • Monitor System health and logs and respond accordingly to any warning or failure conditions.
  • Used Clearcase for version control.
  • Used JUnit for unit testing and Continuum for integration testing.
  • Extensive usage of Struts, HTML, CSS, JSP, JQuery, AJAXand JavaScript for interactive pages.
  • Assisting the team in their development & deployment activities.
  • Instrumental in preparing TDD &developing JavaWebServices for WU applications for many of the money transfer functionalities.
  • Used Web services concepts like SOAP, WSDL, JAXB, and JAXP to interact with other project with in Supreme Court for sharing information.
  • Involved in developing Database access components using Spring DAO integrated with Hibernate for accessing the data.
  • Involved in writing HQL queries, Criteria queries and SQL queries for the Data access layer
  • Involved in managing deployments using xml scripts.
  • Testing - Unit testing through JUNIT & Integration testing in staging environment
  • Followed Agile SCRUM principles in developing the project.
  • Involved in development of SQL Server Stored Procedures and SSIS DTSX Packages to automate regular mundane tasks as per business needs.
  • Coordinating with offshore/onshore, collaboration and arranging the weekly meeting to discuss and track the development progress.
  • Involvement & coordinating for Unit Testing, Quality Assurance, User Acceptance Testing and Bug Fixing.
  • Coordination with team, peer reviews and collaborative System level testing.

Environment: Hadoop, MapReduce, HDFS, Hive, Java (jdk1.6), Hadoop distribution of HortonWorks, Cloudera, MapR, Flat files, Java, HTML, JavaScript, XML, XSLT, JQuery, AJAX, Web Services, JNDI, SQL Server, Struts2.0, Hibernate, Servlets, JSP, Intel (x86 64), HP-UX/Linux, RAD 7.5, JUnit, Apache Tomcat5.0, CMS, BIRT Reporting, FTP, WebSphere 7.0, SVN, SSIS, ANT/Maven, Quality Center 11, SCRUM, Spring, UML, CVS/SVN.

Confidential, Addison, Texas

Senior Hadoop Developer

Responsibilities:

  • Worked on the proof-of-concept for Apache Hadoop framework initiation.
  • Worked on Installed and configured Hadoop 0.22.0 MapReduce, HDFS, developed multiple MapReduce jobs in java for data cleaning and preprocessing.
  • Importing and exporting data into HDFS and HIVE using Sqoop
  • Responsible to manage data coming from different sources
  • Monitoring the running MapReduce programs on the cluster.
  • Responsible for loading data from UNIX file systems to HDFS.
  • Installed and configured Hive and also written Hive UDFs.
  • Involved in creating Hive Tables, loading with data and writing Hive queries which will invoke and run MapReduce jobs in the backend.
  • Involved in defining job flows
  • Involved in managing and reviewing Hadoop log files
  • Involved in running Hadoop streaming jobs to process terabytes of text data
  • Load and transform large sets of structured, semi structured and unstructured data
  • Responsible to manage data coming from different sources
  • Supported Map Reduce Programs those are running on the cluster
  • Involved in loading data from UNIX file system to HDFS.
  • Installed and configured Hive and also written Hive QL scripts.
  • Responsible to manage data coming from different sources
  • Implemented the workflows using Apache Oozie framework to automate tasks.
  • Developed scripts and automated data management from end to end and sync up b/w all the clusters.
  • Coordinating with client to understand the Functional Requirement Document and preparing the Technical Design Specification accordingly.
  • Preparation of HLD and LLDs based on change requests.
  • Used Web services concepts like SOAP, WSDL, to interact with other project with in Ease Producer for sharing information.
  • Extensively used the Struts2.0 Framework to configure the presentation layer for the application. Usedbusiness delegate, service locator, transfer Object, and MVC design patterns.
  • Elaborated Use Cases based on business requirements and was responsible for creation of Class Diagrams, Sequence Diagrams, and Data Model.
  • Extensively used Core Java concepts covering Collections, Exceptions, I/O.
  • Participating in SCRUM meetings, keeping tracking of backlogs and impediments.
  • Involved in development of SQL queries as per business needs and integrating the invocation from the data layer.
  • Deployed the application on Web sphere application server in different testing environments
  • Tested the code changes and business implementations and released to QA and UAT
  • Used Web services concepts like SOAP, WSDL, JAXB, and JAXP to interact with other project with in Supreme Court for sharing information.
  • Coordinating with offshore/onshore, collaboration and arranging the weekly meeting to discuss and track the development progress.
  • Preparation and execution of test scripts and validating them with JUnit and Log4J and eliminating the maximum bugs before passing over to the SIT team.

Environment: Apache Hadoop, Java (jdk1.6), DataStax, Flat files, HTML, AJAX, JavaScript, XML, Web Services, SQL, Struts2.0, Hibernate, Servlets, JSP, Intel (x86 64), HP-UX/Linux, RAD 7.5, WebSphere 7.0, RTC, Maven, Quality Center 11, SCRUM, UML.

Confidential, Addison, Texas

Technical Analyst - Java Team Lead

Responsibilities:

  • Organizing turnover calls between offshore & onshore. Acted as coordinator, involve in client discussions, deliver the work to offshore & get it done within the defined timelines.
  • Created the system to register, track and resolve tickets/bugs to maximize end user experience and reporting failed scripts/jobs in Quality Center.
  • Lead software engineer role for performing distributed environment build, schedule setup, maintenance and triaging the issues that comes as part of regression testing in integrated releases for UAT/QA environments.
  • Extensively used Spring AOP and Dependency injection during various modules of project.
  • Mapping POJOs to relational database using hibernate ORM.
  • Followed Agile Methodology working in sprints in one of the scrum teams.
  • Instrumental in developing environmental build transform tool which helped in minimizing manual efforts by 70%.
  • Participated in project meetings, suggest for improvements in coding/QC techniques.
  • Scheduling, monitoring workflows and restarting, killing, checking dependencies of Autosys and TWS batches in UNIX/Linux environments as per the requests. We uses IXP graphical user interface.
  • Writing shell scripts to automate tasks as per business requirement.
  • Dealing with Autosys/TWS system/batch failures and tracking them to the closure.
  • Perform Code Development, code migration.
  • Staging and deploying the code. Code review.
  • Program analysis for problem diagnosis and change impact analysis.
  • Resolve environment related defects and provide Bug fixes.
  • Follow up on all the open defects in preparation of attending daily release status calls; ensuring components are up to date and informative.

Environment: Intel x 86, HP-UX, GNU-Linux, Autosys, Tivoli Workload Scheduler (TWS), Mainframe, FileAid/FileManager, Shell Script, Perl, AWK, Stream Editor(Sed), RTC, Quality Center 11, Eclipse, WebSphere, Java, JIL, HTML, JavaScript, XML.

Confidential, San Francisco, CA

Java Developer

Responsibilities:

  • Analyzed Business Requirements and Identified mapping documents required for system and functional testing efforts for all test scenarios.
  • Performed Requirement Gathering & Analysis by actively soliciting, analyzing and negotiating customer requirements and prepared the requirements specification document for the application using Microsoft Word.
  • Developed Use Case diagrams, business flow diagrams, Activity/State diagrams.
  • Adopted J2EE design patterns like Service Locator, Session Facade and Singleton.
  • Configuration of application using spring, Hibernate, DAO’s, Actions Classes, Java Server Pages.
  • Configuring Hibernate and Tiles related XML files.
  • Developed presentation layer using JavaServer Faces (JSF) MVC framework.
  • UsedJSP, HTML and CSS, JQueryas view components in MVC.
  • Extensively used Spring IOC for Dependency Injection and worked on Custom MVC Frameworks loosely based on Struts.
  • Developed Servlets and Java Server Pages (JSP), to route the submittals to the EJB components and render-retrieved information using Session Facade, Service Locator (design pattern).
  • Developed J2EE components on Eclipse IDE.
  • Used JDBC to invoke Stored Procedures and also used JDBC for database connectivity to SQL.
  • Deployed the applications on WebsphereApplication Server
  • Developed Web services using Restful and JSON.
  • Used Oracle11g database for tables creation and involved in writing SQL queries using Joins and Stored Procedures.
  • Used Toad database tool to develop oracle quires.
  • Writing complex SQL queries and reviewing SQL queries for the other team members.
  • Developed JUnit Test Cases for Code unit test.
  • Worked with configuration management groups for providing various deployment environments set up including System Integration testing, Quality Control testing etc

Environment: J2EE,Hibernate,RAD, RSA, SQL Developer, Oracle 8i, Rational Clear Case, Rational Clear Quest, Rational Requisite Pro, UML, Ms Visio, Ms Office

Confidential

Junior Java Developer - Team Member

Responsibilities:

  • Analyzing the Business Requirements and System Specifications to understand the application.
  • Created the technical specifications for Announcement Capture Module, which captures the announcements from all vendors & check for the reliability of the source & information.
  • Involved in analysis, designing, developing, deploying & testing activities in the re-engineering of announcement module.
  • Used design patterns like Singleton, Factory, Session Façade, MVC.
  • System test plan creation based on the requirement and design document
  • Involved in presenting induction to the new joiners in the project.
  • Wrote PL/SQL Stored procedures, views, cursors, triggers for custom requirements.
  • Involved in Creation and review of test Scenario and test Case based on requirement and design document
  • Understanding the programs through extraction of business rules, entity relationship models and process models by using the tool MASTERCRAFT.
  • Writing LLDs for Entitlement Processing Module
  • Involved in writing Criteria queries and SQL queries and removing JOINS for performance tuning.
  • Involved in Unit Testing, User Acceptance Testing and Bug Fixing.
  • Design and Development of Struts Action classes, DAO, Views using Struts custom tags.
  • Involved in developing Batch Programs
  • Developing UI Screens in JSP using XGen

Environment: Intel Pentium, IBM Mainframe, JAVA,SQL, HTML, XML, Struts Action Classes, Validator forms, MVC-1, Design Patterns, XML, Java Script, CSS, Tomcat, CVS, ANT, RAD 6.0, ClearCase, Master Craft, ChangeMan, Xgen, Struts, iBatis, Servlets, JSP,DB2/Oracle.

Confidential

Java Developer

Responsibilities:

  • Instrumental in designing and development of NUWS dashboard, which simplifies the navigation of entire system, makes the system user friendly by providing the critical & mandatory information in the dashboard.
  • Designed and developed components under J2EE architecture using Servlets, JSP’s and EJB
  • Developed front-end screens using JSP, Custom tags, Java Script and Tag Libraries
  • Modeling and generation of code snippets for whole project using MasterCraft & Rational Rose.
  • Involved in detailed business analysis, flowcharts, preparation technical specifications, development, Unit testing to delivery of Batch Reports module.
  • Prepared the Technical design document of the project.
  • Integration testing in coordination with system testing team.
  • Handling the Back End Transaction management
  • Analysis of change requests and test related activities
  • Deployment of application for the users
  • Process Underwriting Distributions at DTC
  • Capture comprehensive Security Information as part of Underwriting.
  • Make a Security Eligible at DTC
  • Receive Security positions & Certificates (for New Offering) into DTC
  • Credit Underwriters their positions in the Underwriting process (this will initiate trading and other activities)

Environment: IBM Mainframe, Intel Pentium, JAVA, HTML, XML, SQL, Java Script, CSS, JSPs, Servlets, Rational Rose, Mastercraft, MVC, PVCS, RAD 6.0, Master Craft, Struts, IBatis, CSS, Java Script, HTML, Eclipse, Oracle 8.1, Tomcat 5.0, Websphere6.0.

We'd love your feedback!