Sr. Hadoop Developer Resume
WA
SUMMARY
- Solution Architect and Sun certified JAVA Professional with 11+ years of experience in IT industry primarily on Java, J2EE, Angular JS and Hadoop technologies.
- Project Lead experience with proven abilities in leading teams during different project phases and ensuring timely delivery as per client’s expectation.
- Highly Proficient in all phases of SDLC which includes, Business Analysis / Modeling, Design / Architect, Development, Planning & Management of Builds, Configuration, Code Management, Production / Customer Support, Maintenance, Enhancement, Quality Control, Testing, Implementation and Documentation along with Customer Coordination.
- Expert level experience in data architecture including data ingestion, pipeline design, Hadoop information architecture, data modeling, data mining, machine learning and advanced data processing.
- Experienced in installing, configuring and testing Hadoop ecosystem components including Standalone, pseudo and distributed modes.
- In depth knowledge in Hadoop components such as HDFS, Name Node, Job Tracker, Data Node, Task Tracker.
- Skilled in processing large data sets of structured, semi - structured and unstructured data and supporting systems application architecture.
- Well versed in Developing Map-Reduce programs to perform Data Transformations.
- Experienced in working with NoSQL databases like HBase and Cassandra.
- Performed importing and exporting data from different databases like Mysql, Oracle into HDFS and Hive using Sqoop.
- Hands-on experience in writing Pig Latin scripts, working with grunt shells and job scheduling with Oozie.
- Expertise in advanced client side framework AngularJS and Java/J2EE technologies such as Core Java, JDBC (with MySQL & Oracle), Servlet, JSP, EJB, Hibernate, Spring.
- Expertise in Web technologies such as HTML, CSS, JavaScript, AJAX and deploying applications in heterogeneous Web / Application servers Apache Tomcat and Glassfish, JBOSS.
- Profound knowledge in Service oriented architecture (SOA) and web services like XML, XSD, XSDL, SOAP.
- Proficient in object oriented analysis and design (OOAD), unified modeling language (UML) and design patterns.
TECHNICAL SKILLS
Big Data Ecosystem: Hadoop, MapReduce, HDFS, HBase, Zoo Keeper, Hive, Pig, Sqoop, Cassandra, Oozie, Flume, Azkaban, Apache Solr
Web Technologies: HTML, CSS, JavaScript, AJAX, Angular JS, XML, XSL, XSLT, XPath, DOM
Java/J2EE: Java, JSP, Servlets, EJB, JDBC, Log4j
Frameworks: Struts, Hibernate, Spring
Database: Oracle 10g, PL/SQL, MySQL
Web / Application Server: Apache Tomcat, GlassFish, JBOSS
IDE: NetBeans, Eclipse
Version Control: SVN, IBM-RTC
Build Frameworks: ANT, Maven
Continuous Integration Tools: Bamboo, Jenkins
Scripts: AutoIt, HiveQL, Shell Scripting
Testing API: JUNIT
Methodologies: Agile, UML, Design Patterns
PROFESSIONAL EXPERIENCE
Confidential, WA
Sr. Hadoop Developer
Responsibilities:
- Designed proof-of-concept for Apache Hadoop framework initiation.
- Provided solution for data cleaning and preprocessing - Installed and configured Hadoop MapReduce, HDFS, developed multiple MapReduce jobs in java.
- Import and export data into HDFS and HIVE using Sqoop.
- Authority to manage data coming from different sources.
- Monitored the running MapReduce programs on the cluster.
- Complete Responsible for loading data from RDBMS into HDFS using Sqoop queries.
- Installed and configured Hive and also written Hive UDFs.
- Involved in loading data from LINUX file system to HDFS
- Associated in creating Hive Tables, loading with data and writing Hive queries which will invoke and run MapReduce jobs in the backend.
- Implemented the workflows using Apache Oozie framework to automate tasks.
- Promoted scripts and automated data management from end to end and sync up b/w all the clusters.
- Involved in migration of Java Map Reduce jobs to Scala.
Environment: Apache Hadoop, Java (jdk1.7), Spark, Scala, Flat files, Oracle 11g/10g, mySQL, Toad 9.6, Sqoop, Hive, Oozie, Solr, Bash Scripts, Cloudera
Confidential, Farmington Hills, MI
Hadoop Developer
Responsibilities:
- Analyze the business needs and functional specifications, map those to develop and design.
- MapReduce programs and algorithms.
- Authority for building scalable distributed data solutions using Hadoop.
- Associated in loading data from RDBMS into HDFS using Sqoop queries.
- Provided solution in Delta processing or incremental updates using hive and processed the data in hive tables.
- Execution of Hadoop ecosystem and Applications through Apache HUE.
- Optimize Hadoop MapReduce code, Hive/Pig scripts for extracting data from source system, data processing, better scalability, reliability and performance.
- Involved in loading data from LINUX file system to HDFS
- Developed the OOZIE workflows for the Application execution.
- Involved in creating Hive Tables, loading with data and writing Hive queries which will invoke and run MapReduce jobs in the backend.
- Advanced java Map reduce XML PARSER programs to process XML files using XSD's and XSLT's as per the clients requirement and used to process the data into Hive tables.
- Implemented Hive tables and HQL Queries for the reports. Written and used complex data type in Hive.
- Storing and retrieved data using HQL in Hive. Developed Hive queries to analyze reducer output data.
- Promoted Scripts and automated data management from end to end and sync up between all the clusters.
- Highly involved in designing the next generation data architecture for the unstructured data.
- Extensively used the Hue browser for interacting with Hadoop components.
- Feasibility Analysis (For the deliverables) - Evaluating the feasibility of the requirements against complexity and time lines.
- Documented the systems processes and procedures for future references.
- Involved in story-driven agile development methodology and actively participated in daily scrum meetings.
Environment: HDFS, Map Reduce, Java, Hive, Oozie, PIG, Shell Scripting, HUE, Sqoop, Flume, Oracle 11gHorton Works 2.2
Confidential - Farmington Hills, MI
Associate Architect
Responsibilities:
- Led the team along with other Development teams, System managers and web master and developed good working environment.
- Complete responsibility of the product right from the designing till solution perspective and handled from customer location.
- Reviewed and guided the application architects with Object Oriented Design using Rational Unified Process (RUP).
- Provided solution in System Analysis and Design methodology as well as Object Oriented Design and Development using OOAD methodology to capture and model business requirements.
- Provided Object Oriented Design using UML-Rational Rose.
- Materialized the web-based application, following the MVC II architecture using Spring Framework.
- Broadly introduced Angular JS tags to separate presentation from application logic.
- Authoritative for creation and consumption of Web services using SOAP and WSDL.
- Designed, developed using JSP and deployed them on JBOSS Server.
- Used Hibernate for mapping the Object oriented model of Java with Oracle.
- Involved in writing Oracle Stored procedure and PLSQL for back end. Used Views and Functions at the Oracle Database end. Developed the PL/SQL scripts for rebuilding the application Oracle Database.
- Developed the application using HTML and Angular JS.
- Used Maven for compilation and building JAR, WAR and EAR files.
- Automated test cases written using JUNIT.
Environment: JSP, HTML, CSS, XML, AngularJS, AJAX, Hibernate, Spring, Web Services (SOAP), JBOSS Server, Oracle 10g, JUNIT, JDBC, PL/SQL, Eclipse, Jenkins, Maven
Confidential - Farmington Hills - MI
Associate Architect
Responsibilities:
- Played a vital role starting from Requirements analysis, designing the Presentation templates and CTDs based on the business expectations.
- Designed the UI pages using JSP and Servlets.
- Enhanced and optimized the functionality of Web UI using AJAX, CSS, HTML and JavaScript.
- Generated the pages in the form of XML’s and rendered them into live pages.
- Sole responsible for entire project right from analysis phase to the implementation and handled from customer location.
- Followed the story-driven Agile Development Methodology and conducted daily scrum meetings.
- Coordinated User Acceptance Testing of the application.
- Used RADAR for defect tracking and IBM RTC as a version control tool for maintaining the code artifacts, change request tracking, scope change request tracking and baseline tracking.
- Used Jenkins / Maven for compilation and building JAR and WAR files.
- Automated test cases written using JUNIT.
Environment: Java, HTML, CSS, Java Script, Servlets, JSP, XML, Oracle 10g, Eclipse, JBOSS, Jenkins, Maven
Confidential
Sr. Java Developer
Responsibilities:
- Provided solution using Java Script for the Application front end and client side data validation.
- Advanced Java Server Pages with creation of custom tags and java beans.
- JSP Standard Tag Library (JSTL) and Custom Tag Libraries were also developed for efficient, flexible and easily maintainable of JSP pages.
- Developed different modules using standard J2EE architecture. This includes Servlets, JSP, and JDBC.
- Developed JSP for the new modules with applied business logic using Struts2 and Tiles built on the design paradigm like Business delegate and MVC.
- Used RADAR for defect tracking and JIRA change request tracking, scope change request tracking and baseline tracking.
- Used Jenkins / Maven for compilation and building JAR and WAR files.
- SVN repository used as a version control system tool for maintaining the code artifacts.
- Automated test cases written using JUNIT.
Environment: Java, JSP, Servlet, Struts, JDBC, Java Script, Eclipse, Oracle 10g, AJAX, XML, Jenkins, Maven
Confidential
Sr. Java Developer
Responsibilities:
- Analyzed the business requirements, Functional Specifications and transformed the detailed design documents.
- Extensive client interaction for gathering requirements, design, UI approvals and User acceptance testing.
- Involved in Analysis, Design, Coding, and unit testing of the project.
- Enhanced and optimized the functionality of Web UI using AJAX, CSS, HTML and JavaScript.
- Extensively used Java Collection Framework(ArrayList, HashMap) and StringBuilder.
- Implemented JMS for sending messages between clients. Implemented both point-to-point, publish and subscribe models.
- Used JDBC for database connectivity, queries, updates and deletes.
- Created Oracle database tables, stored procedures and triggers and Retrieved objects from the Oracle database using MySql query language.
- Development code for XML parsing using SAX & DOM parsers.
- Written ANT Scripts to deploy the application into Web Logic application server for Dev, QA, UAT and production environment.
- Used JIRA and RADAR as a source control and used as defect tracking, change request tracking, scope change request tracking, baseline tracking and deployment tool.
- Developed Manual and Automated test scripts using JUNIT.
- Used SVN as a version control tool for maintaining the files.
- Implemented Web Services for communication between applications.
Environment: Java, JSP, Servlets, EJB (JMS), JNDI, XML, AJAX, HTML, JavaScript, Eclipse, Oracle, Bamboo, ANT, SVN, JUNIT
Confidential
Java Developer
Responsibilities:
- Involved in designing and implementing the User Interface for the General Information pages and Administrator functionality.
- Designed front end using JSP and business logic in Servlets.
- Used Struts Framework for the application based on the MVC-II Architecture and implemented validator Framework.
- Mapping of the servlet in the Deployment Descriptor (XML).
- Used HTML, JSP, JSP Tag Libraries, and Struts Tiles to develop presentation tier.
- Deployed application on Jboss Application Server and also configured database connection pooling.
- Involved in writing JavaScript functions for front-end validations.
- Developed stored procedures and Triggers for business rules.
- Performed unit tests and integration tests of the application.
- Used CVS as a documentation repository and version controlling tool.
Environment: Java, J2EE, JDBC, Servlets, JSP, Struts, HTML, CSS,JavaScript, UML, Jboss Application Server 4.2, MySQL
Confidential
Java Developer
Responsibilities:
- Involved in Design, Development and Support phases of Software Development Life Cycle (SDLC).
- Involved in developing the complete front end development using Java Script and CSS.
- Designed the UI pages using JSP and Servlet.
- Author for Functional, Design and Test Specifications.
- Analyzed, designed and developed the component.
- Used JDBC for database access.
- Unit testing and integration testing of the whole application.
- Written and executed the Test Scripts using JUNIT.
- Actively involved in the system testing.
- Used the tool(tool base) for regression testing.
- Prepared the Installation, Customer guide and Configuration document which were delivered to the customer along with the product.
Environment: Java, JDBC, JSP, Servlets, JavaScript, JavaBeans, XML, Oracle, Eclipse, HTML, CSS, Bamboo, ANT
