We provide IT Staff Augmentation Services!

Hadoop-kafka Developer Resume

2.00/5 (Submit Your Rating)

Dallas, TX

SUMMARY

  • Around 7+ years of IT experience in the areas of Analysis, Design, Development and Testing of web based and client server multi - tier applications using Java/J2EE/Hadoop technologies.
  • Over 2+ years of extensive experience in BigData and excellent understanding/knowledge of Hadooparchitecture and various components such as Hadoop MapReduce, HDFS, Hive, HBase, Flume, Pig, Sqoop, Cassandra etc.
  • Having Sound Knowledge on Big Data, Hadoop Architecture and Hadoop File System (HDFS), Map Reduce, YARN, Hive, Sqoop, Oozie, Flume, HBase, Pig and Cassandra, MongoDB, CouchDB NOSQL databases.
  • Experience in full software development life cycle (SDLC).
  • Excellent understanding and knowledge of NOSQL databases like CouchDB, Cassandra.
  • Involved in writing and reviewing Unit Test using JUNIT and Mockito.
  • Expertise in using Version Management Tools CVS, SVN, Sub-version.
  • Worked on deployment, installation, configuration and issues with Application servers like Apache JBoss, Apache Tomcat and Web sphere
  • Experience with J2EE design patterns such as Intercepting Filter, Front Controller, Business Delegate, and Data Access Object
  • Core expertise lies in Web Application Development using Core Java, REST web services, Swings, JavaScript, DOJO, JQuery, JSON, Angular JS, HTML, DHTML, CSS, XML, JDBC.
  • Solid knowledge in working with OO Java Script and functional Java Script
  • Experience with UML in design structure, behavior and interaction diagrams.
  • Proficiency in deploying applications on J2EE Application servers like Tomcat, JBOSS, Web Logic.
  • Strong knowledge in Object Oriented Concepts, Object Oriented Design (OOD), Object Oriented Analysis (OOA), Programming and its implementation.
  • Working knowledge on configuration of ANT and Maven built automation tools.
  • Worked with source revision control tools like "Tortoise SVN", "Git" "Stash" "Bit Bucket".
  • Strong working knowledge in using XML (SAX and DOM), XSL, XSTL, HTML, DHTML,
  • Very good implementation experience of Object Oriented concepts and Java/J2EE design patterns.
  • Expert level experience with various RDBMS/ Database servers like Microsoft SQL Server 2000/2005.
  • Strong experience in developing Web applications using all J2EE related technologies like Servlets, Struts, spring, JSF, JDBC and JNDI etc.
  • Strong programming skills in Core Java Such as Multithreading, I/O Streams, Collection
  • Implemented the persistence layer using Hibernate-ORM.
  • Expertise in OOAD, developing UML diagrams like Use Case diagrams, sequence diagrams, class diagrams and Activity Diagrams Using MS Visio, Rational Rose and Umbrello tools.
  • Experience with databases such as Oracle8i/9i/10g & My SQL.
  • Excellent experience in developing Back-end applications using Web Services (Apache Axis2, Spring-WS, JAX-WS) and Spring-REST, JSON, REST-based APIs.
  • Extensive Development experience in various open source frameworks (STRUTS, Log4j, ANT, HIBERNATE, SPRING & AJAX).
  • Used MAVEN scripts to fetch, build, and deploy application to development environment.
  • Experience in different Operating Systems/ platforms like Windows, Linux and UNIX.
  • Experience with IDEs such as RAD, Eclipse and Net Beans.
  • Worked on build tools: ANT, MAVEN.
  • Excellent work experience on Core Java, J2EE, Servlets, JSP, Node JS, XML, XSLT, Apache Ant, Tag Libraries, MVC frameworks such as Struts, Struts Validation Framework and Struts Tiles Framework.
  • Experienced in Development and Deployment on IBM Web Sphere 7.1, BEA Web Logic 9, and Tomcat 5.x/6.0
  • Having experience with ETL tools and understanding of Datawarehouse, Big Data and BI Analytics concepts.
  • Strong experience in SQL, PL/SQL, Informatica & Tableau.
  • Experience working with huge volumes of data, analyzing record sets for data quality and data validation.
  • Experience in working in both Waterfall and Agile software development methodologies.
  • Experience in managing an enterprise testing platform and proven ability to setup a platform from the scratch.
  • Involved in writing and reviewing Unit Test using JUNIT, MR Unit and Mockito.

TECHNICAL SKILLS

Languages: Java, J2EE, JSP, Servlets, Struts, Spring MVC, SQL & PL/SQL

Databases: Oracle8i/9i/10g, Teradata, MS SQL Server and MS Access, NoSQL Databases (Cassandra, MongoDB, CouchDB, HBase).

GUIs: Eclipse, NetBeans, MyEclipse, Tomcat 6.0. Jboss.

IDE Tools: Microsoft Visual Source Safe, Team Foundation Server

Web Server: IIS 7.0/6.0

Hadoop Ecosystems: Hadoop Architecture, HDFS, Map Reduce, YARN, PIG, HIVE, HBase, Flume, Zookeeper, Oozie and Sqoop.

Web Technologies: HTML5, XML, XSL,EJB, JavaScript, CSS3, AJAX, Angular JS, Node JS, Struts 1.x,Struts Tiles Framework, SAX & DOM Parser, Junit, Log4j

Scripting Languages: Java Script, JQuery, ExtJs, JSF

Application Servers: Jakarta Tomcat Server, JBOSS, BEA WebLogic, IBM WebSphere

Defect Management: Jira, HP Quality Center

Web Tools: Rational Rose (Clear Quest, Clear Case) Dream weaver

Operating Systems: Windows 7, Vista, XP/2000/NT/98/95, UNIX, LINUX

PROFESSIONAL EXPERIENCE

Confidential, Dallas, TX

Hadoop-Kafka Developer

Responsibilities:

  • Involved in revamping the legacy system with latest technology stack using Hadoop, Cassandra & Kafka
  • Preformed trade-off analysis on technologies from backend to frontend to narrow down on chosen framework stack
  • Designed UML diagrams (mainly Class, Sequence, and Collaboration Diagrams) for the re-designed workflows
  • Reverse engineered the application to analyze and design the application workflow with Kafka topics (both publish and consume messages)
  • Configured a 5 node local Apache Kafka cluster for development environment
  • Defined various topics pertaining to each workflow and configured message partitions and other parameters.
  • Migrated JMS message queues from Oracle GlassFish Server to Apache Kafka topics
  • Unit tested published messages to Apache Kafka topics
  • Configured at-production scale data stream from upstream to ingest data to Cassandra using Apache Kafka
  • Involved in migrating Coherence Cache framework to Cassandra
  • Written REST services layer to access data from Cassandra by other components
  • Performed legacy code analysis and enhanced code quality as per set project level standards
  • Developed build script with required artifacts using Maven and configured local repository
  • Written Junit test cases and debugged and resolved existing production issues

Environment: Java, Spring, REST, Hadoop, Oracle GlassFish Server, Tomcat, JMS, Apache Kafka, Coherence Cache, Cassandra, Maven, Git-Stash, Jira, Agile Methodology, Eclipse Mars and Kepler

Confidential, Arden Hills, MN

Hadoop Developer

Responsibilities:

  • Designed and developed system models specifying interactions between multiple systems.
  • Involved in the analysis specification, design, implementation and testing phases of Software Development Life Cycle (SDLC) and the project was developed using Rational Unified Process (RUP).
  • Developed Map Reduce jobs and Hive Script for various use cases.
  • Migrated output from MR jobs & Hive scripts to column families in HBase tables.
  • Written workflows in Oozie for scheduling MR jobs and Hive scripts
  • Validation of pre-Hadoop processing of metadata and data integrity validations.
  • Created User defined types to store specialized data structures in Cassandra.
  • Implemented a distributed messaging queue to integrate with Cassandra using Apache Kafka and ZooKeeper.
  • Validation of data from different source systems and loading into HDFS using Sqoop.
  • Experience in building scalable and fault tolerant Cassandra production database system
  • Experience in integrating Cassandra with Apache Solr search and Hadoop.
  • Implemented advanced procedures like text analytics and processing using the in-memory computing capabilities like Spark.
  • Data redundancy in output file during Pausing/Stopping/Re-execute due to MapReduce job failure
  • Perform Map Reduce operations involve in processing the input files and applying map and reduce operations to get desired output.
  • Involved in creation of Hive(HQL) scripts, execution of Hive scripts
  • Involved in creation of Pig scripts, Execution of Pig scripts
  • Tested the ETL Informatica mappings and other ETL Processes.
  • Validation of transformation rules are applied correctly.
  • Validation of reports after ETL/transformation work flows are executed for all source systems.
  • Data Storage validation is done to ensure dat the data is correct and is of good quality.
  • Validation of non-functional testing like performance and failover testing plays a key role to ensure the whole process is scalable and is happening within specified SLA.
  • Debugging of failed scripts and jobs, reporting to development team.
  • Executed Complex SQL Queries
  • Used HTML5 and XML (XPath, XSLT, and XSD) related technologies to develop software applications.
  • Developed code using Angular JS to make good UI modules and also involved in the integration of Angular JS with Spring REST services.
  • Written MR unit test classes using MapDriver, ReduceDriver & MapReduceDriver

Environment: Java 7, IBM WAS 7.X, Angular JS, CSS 3, Oracle 11g, RUP, SQL Developer, Spring, IBM RAD 6.X. Spring DAO, REST, Hibernate, Teradata, Cassandra, Solr, CDH4, HDFS, Map Reduce, MR Unit, Hive, HBase, Sqoop & Oozie.

Confidential, Cary, NC

Hadoop Consultant

Responsibilities:

  • Worked with Scope Anywhere integration with PeopleSoft. Z/Scope will be used as terminal emulation software for the screen integration between PeopleSoft and Legacy applications.
  • Developed ETL mappings in Hive to load the data from various sources using different transformations like Source Qualifier, Expression, Aggregator, Update Strategy, Rank, Joiner, Filter,.
  • Developed Complex HiveQL Queries to get counts and aggregate functions.
  • Document Big Data high level test strategy, testing release cycles, testing types, volume of data processed by Hadoop and third party tools required.
  • Developed UDF’s in Hive for notifications module.
  • Performed importing data from various sources to the Cassandra cluster using Java/Python APIs.
  • Experience in storage model in Cassandra and implemented various optimal configuration to meet storage requirements.
  • Written MR unit test classes using MapDriver, ReduceDriver & MapReduceDriver
  • Perform smoke test on the environment by processing Map Reduce, Pig/Hive jobs
  • Core expertise lies in Web Application Development using Core Java, REST web services, Swings, JavaScript, JQuery, JSON,AngularJS, HTML5, DHTML, CSS3, XML, JDBC.Developed GUI using JSP, Struts, HTML3, CSS3, XHTML, Swing and JavaScript to simplify the complexities of the application.
  • Used Angular JS extensively in developing the front-end modules.
  • Used XML Web Services using SOAP to transfer the information and fetch the risk score information from autantic business stream.
  • Design and implementation of Restful Web services.
  • Designed and developed various Screens using JSP, DOJO, JavaScript, HTML, CSS.
  • Using Application Engine for performing background SQL processing against the database.
  • Has involved in testing of code changes and deployment of all the bug fixes with z/Scope Anywhere.
  • Worked extensively on People Code, Application designer objects - fields, records, pages, components, menus, Application Engine, Application Messaging, File Layouts etc., PS Security, PL/SQL.
  • Using Applications to modify the existing records and menus.
  • Developing custom HTML5 elements using directives Angular JS.
  • Design and developed user interface using Spring, Bootstrap JSP, HTML and JavaScript.
  • Developed controllers, view/partials and directives for application.
  • Widely resolved angular scope issues.
  • Worked on development of Java Web Services.
  • Developing rich internet applications for major enterprise technology companies withNode JS
  • Using Eclipse Juno, SVN, Angular debugger and ng-inspector tools
  • Developed Maven scripts for various tasks to automate the build process and for the deployment of the application in JBoss 7 server.
  • Developed user interface using JSP, JSP Tag libraries, and Java Script to simplify the complexities of the application.

Environment: JSP, Servlets, Agile, JavaScript, Java 7, People Tools 8.53, Oracle, SQL, Web Sphere 6, AngularJS, web services, JQlite, HTML 5, CSS 3, Eclipse, SVN, Hadoop, HDFS, HortonWorks, Map Reduce, MR unit, Cassandra, Hive, Sqoop.

Confidential, Chicago, IL

Java Developer

Responsibilities:

  • Worked as JavaScript Developer using Ext JS framework and Object Oriented JavaScript (OOJS) to develop user interface for ECOS application for Customer Returns and Inventory application.
  • Designed and developed Liferay portal applications for internal (non-customer facing) usage with JSPs, JavaScript, JQuery, Java, PL/SQL, and MySQL.
  • Implemented various functionalities as per the business requirements. Which involves creation of views, controller elements and model classes which used to store data for views.
  • Worked on custom events firing, attaching listeners and coding for operation need to perform when event is getting triggered.
  • Developed code for drag and drop functionality for Filters, Where the data is dragged from the Ext Tree, and dropped in droppable area on filters on cross tab grid for filtering on data.
  • Installed and configured 6.0/6.1 version of Web Sphere Application Server, IHS and plug-in in development, staging and production environments.
  • Exposure on Git Hub.
  • Used Ext JS ui components to implement various functionalities, Coded for Various windows, panels, form andtree components, adding custom event on components and implementing their listeners for operation to be performed.
  • Worked on integration of Ext.ux tree search component with existing system to provide dynamic search in available dimension from dimension tree.
  • Fixed several outstanding css issues with IE6.0, JS Defects.
  • Used AJAX and JSON processing against RESTful web services in JavaScript.
  • Used HTML5 and XML (XPath, XSLT, and XSD) related technologies to develop software applications.
  • Developed on demand, combo and compression server using Node.js
  • Used Servlets and JSP's in developing the web application on Websphere Application Server 7.
  • Experience with DB2 and Java Persistence.
  • Used Rational Application Developer (RAD 8) as IDE.
  • Used CVS as version control system for the source code and project documents.

Environment: JavaScript, ExtJS 3.4, Angular.js, Liferay 6.2, Node.js, TomCat7.x, AJAX, JSON, Java, HTML5, CSS3, XML, XPath, XSD, Servlets, RAD 8, CVS.

Confidential, Niskayuna, NY

Java Developer

Responsibilities:

  • Developed JSP, Java Script, HTML5, and CSS3 for UI & business logic.
  • Designed and developed the application using Java Server Faces (JSF) framework
  • Experience with Java WebServices used SOAP and REST.
  • Worked on OpenLayers JavaScript library for displaying map data in the web browsers with no server side dependencies.
  • Used Open Layers 2.12 version, implemented JavaScript API for building geographic applications.
  • Used Eclipse as the IDE and used Apache Tomcat.
  • Used Apache Camel and involved in Enterprise Integrations.
  • Involving Work Flow Management for different business functions.
  • Enforcement of business rules along with provision for human decision making wherever necessary.
  • Generation of MIS reports & other MIS data.
  • Used Visual Studio, and SQL Server for the analysis and development of online systems
  • Used JSON (JavaScript Object Notation) to read the java script object.
  • Used DOJO toolkit to construct Ajax requests and build ynmaic web pages using JSP's, DHTML and Java scripts
  • Extensively used Jquery in web based applications
  • Used OpenLayers APIs, Map APIs such as Bing, Google, and Map Quest.
  • Wrote AngularJS controllers, views and services for new map features.
  • Used SVN as version control system for the source code and project documents.

Environment: JavaScript, JSF, JQuery, DOJO Toolkit, Java, J2EE, AJAX, HTML5, CSS, XML, REST, SOAP, Eclipse, OpenLayers 2.12, SVN, Tomcat.

Confidential

Java Developer

Responsibilities:

  • Involved in requirement gathering, design and development, handling deliverables, tracking status phases of Software Development Life Cycle (SDLC) in the application.
  • Designed the application using Test Driven Development (TDD) approach
  • Generated the Use Case Diagrams, Class Diagrams and Sequence Diagrams to represent the detailed design phase using UML in Rational Rose.
  • Used struts framework to develop Action Servlets, Action Form bean and configured the struts-config.xml file.
  • Extensively used core java for dis application, we has implemented the threading mechanism in Admin
  • Cache application.
  • Used Servlets and JSP's in developing the web application on Websphere.
  • Extensively used Jquery in web based applications
  • Extensively used JSF framework.
  • Worked on WPS and WAS Production installation both with and without down time.
  • Developed custom inversion of control framework for JSP/JSF portlets on Liferay Portal Server.
  • Involved in using all core Java Concepts into the application for the reusability of the code.
  • Experience in using the Collections in java E.g. Hash Map, Tree Map etc
  • Developed Maven scripts for various tasks to automate the build process and for the deployment of the application in JBoss 7 server.
  • Developed JUnit tests and functional test cases for the services and documented the services developed.
  • Used the Struts validation and Tiles Framework in the presentation layer.
  • Developed Action Forms and Action Classes for Struts based presentation layer.
  • Used DOJO toolkit to construct Ajax requests and build dynmaic web pages using JSP's, DHTML and Javascripts.
  • Used Spring to develop light weight business component and Core Spring framework for Dependency injection.
  • Used Java/J2EE Design Patterns such as Business Delegate, Session Facade, singleton in the project extensively, which facilitates clean distribution of roles and responsibilities across various layers of processing.
  • Implemented Declarative transaction using Spring Framework.
  • Implemented WEB Service Layer for exposing order services to other platform independent applications.

Environment: Core Java1.5, JSP2.1, JQuery, JavaScript, DOJO Toolkit, AJAX, HTML5, CSS3, XML, WSDL2.0, SOAP, JAX-WS, Struts 2.0 Springs Framework, Struts Tiles, Spring2.5, Hibernate, SOA, EJB 2.0, MDB, JMS, RAD, WSAD 6.1, DB2, Ivy, UML, Rational Rose, UNIX, Log4j, JUnit, Ant, JSF.

Confidential

Java Developer (Intern)

Responsibilities:

  • Struts framework is used for building the Front-End.
  • Utilized the various enter Design patterns to develop the Business modules based on the required functionality.
  • Developed view and controller components.
  • Interacted with business analysts and other end users to resolve user requirements issues.
  • Developed user interface (view component of MVC architecture) with JSP, Struts Custom Tag libraries, HTML5 and JavaScript.
  • Used DOJO toolkit to construct Ajax requests and build dynmaic web pages using JSP's, DHTML and Javascripts
  • Extensively used Jquery in web based applications
  • Developed the controller component with Servlets and action classes.
  • Business Components are developed (model components) using Enterprise Java Beans (EJB).
  • Experience in using Ext JS for the presentation tier and developer the screens of the application.
  • Developed Session Façade with Stateless Session bean to provide a uniform coarse-grained service access layer to clients.
  • Developed DAO'S for getting data and passing data to the database
  • JavaScript is used for client side validation and to control some dynamic data.
  • Extensively worked with Oracle Application servers, Apache Tomcat, JBoss 4.2.3 and Service Mix Server.
  • Used MAVEN scripts to fetch, build, and deploy application to development environment.
  • Wrote SQL queries and PL/SQL procedures for JDBC.
  • Prepared the REST and SOAP based service calls depending on the data passing to the web service.
  • Clear Case is used for version control.
  • Used MQ series to create, send, receive and read messages.
  • Used software development methodologies such as waterfall.
  • Used Eclipse Helios as Integrated Development Environment (IDE).
  • Prepared technical and Java API documentation.

Environment: JBoss 4.2.3, JDK 1.5, JDBC, JNDI, Ajax, EJB, JSP, jquery, Servlets, Apache Tomcat, Maven, Struts 1.2, HTML5, XML, JavaScript, CSS, DOJO Toolkit, UNIX/Linux, ExtJS, Oracle 9i, Toad, Clear Case, MQ Series, Eclipse Helios.

We'd love your feedback!