Hadoop Developer Resume
Reston, VA
SUMMARY:
- Around 8+ years of experience in IT as aDeveloper, Designer & Database Administrator with cross platform integration experience inHadoop, Java/J2EE and SOA.
- Around 3 years of experience working on BIG DATA ECOSSYSTEM using HADOOP framework tools such as Map/Reduce, HBASE, HIVE, PIG, FLUME, YARN, TEZ, AMBARI, KAFKA, SPARK, OOZIE, SQOOP, and ZOOKEEPER
- Experience in using Cloudera Manager for installation and management of single - node and multi-node Hadoop cluster (CDH 5.4 & CDH 4)
- Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems and vice-versa.
- Good experience in handling different file formats like text files, Sequence files and ORC data files using different SerDe’s in Hive.
- Experience in working with the Columnar NoSQL Databases like HBase, Cassandra to manage extremely large datasets.
- Extending Hive and Pig core functionality by writing custom UDFs .
- Experience in developing e-commerce applications, highly distributed applications using Java, J2EE, Servlets, JSP, Struts, Spring, JDBC, Apache Tomcat Server, JavaScript, HTML, XML, XSL, SQL, Oracle 11g,9i/8i/7.x under Unix and Windows NT/XP. Distributed Object Oriented Component analysis and Design according to industry leading J2EE platforms.
- Highly experienced in Server side development using Java/J2EE Technologies and ORM tools such as Hibernate 3.0, spring 2.5, Struts 1.x/Tiles Frameworks.
- Highly Working experience with multiple Web/Application Servers like WebSphere 6.0/5.1, WebLogic 10g/8.1/6.1, Oracle App Server 10, Tomcat 4.X.
- Experience of writing client side web technologies including using XML 1.0, XSL,HTML, DHTML, CSS and JavaScript, JQuery. Experienced in parsing (DOM and SAX) XML using JAXB 2.0 API
- Good Experience in SOA development using JAX-WS Web services.
- Highly proficient in developing SQL, PL/SQLs.
- Design and deployment in Web Technologies with JSP, HTML, XML, JavaScript, AJAX, Active Widgets.
- Experience in GUI design and application development using RAD 7, Eclipse 3.x, and MyEclipse 6.5.
- An excellent team player and self-starter with good communication skills and proven abilities to finish tasks before target deadlines.
- Participated in an Agile SDLC to deliver new cloud platform services and components
- Exceptional ability to learn new technologies and to deliver outputs in short deadlines.
- Having Experience on UNIX commands and Deployment of Applications in Server.
- Architected, Designed and maintained high performing ELT/ETL Processes from multiple sources.
- Good work experience on JAVA, JDBC, Servlets, JSP
SKILLS:
Big Data: Hadoop 2.6.2, Map/Reduce, PIG 0.13.0, Hive 1.2.1, Hbase 0.94, Sqoop 1.4.4, Zoopkeeper 3.4.5, Spark,Sqoop,,Kafka,Oozie
Java Technologies: Java, J2EE, JSTL, JDBC 3.0/2.1, JSP 1.2/1.1, Java Servlets, JMS, JUNIT,Log4j
Frameworks: Struts 1.2, Spring 3.0, Hibernate 3.2
Programming Languages: Java, Unix Shell Scripts, R, Python, Scala, Spark
Scripting Languages: Java Script, CSS, HTML5, XHTML, JQUERY
Web services: XML, SOAP, WSDL, SOA, JAX- WS, DOM, SAX, XPATH, XSLT, UDDI, JAX-RPC, REST, and JAXB 2.0, AWS EC2.
Databases: Oracle9i/10g/11g, MySQL, SQL/PL SQL
Web/Application Servers: Apache Tomcat 5.x, BEA Weblogic 8.x, IBM Websphere 6.0/5.1.1
IDE Development Tools: Eclipse 3.5, Net Beans, My Eclipse, Oracle JDeveloper 10.1.3, SOAP UI, Ant, Maven, RAD, SQL Server Management
DB Tools: TOAD, MySQL, MYSQL developer, NOSQL ( HBASE, MONGODB,CASSANDRA), Teradata
Operating systems: WINDOWS, RHEL, UNIX
PROFESSIONAL EXPERIENCE:
Confidential, Reston, VA
Hadoop Developer
Responsibilities:
- Installed, configured and fine-tuned Cloudera Hadoop (CDH4&CDH5) and other tools in the Hadoop ecosystem such as Flume, Sqoop, Zookeeper, Pig, Hive, Hbase, YARN, Tez, Ambari
- Implemented automated local user provisioning instances created in AWScloud.
- Installed and configured Spark ecosystem components (Spark SQL, Spark Streaming, Mainframe Spark Architecture)
- Wrote applications in Scala for large scale data processing.
- Extract, Transform and Load operations on large sets of structured, semi structured and unstructured data.
- Importing and exporting data into HDFS and Hive using Sqoop.
- Involved in loading data from UNIX file system to HDFS.
- Developed Mapreduce jobs using Java API.
- Migrated leagacy system designed in C/Oracle database and migrated it to an opensource NoSQL Database (Cassandra)
- Installed and configured Hive and also wrote Hive UDF’s.
- Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way.
- Developed Hive queries to pre-process the data for analysis by imposing read only structure on the stream data.
- Handled different file formats like text files,Sequence files and ORC data files using different SerDe’s in Hive.
- Created workflows for automation using Oozie.
- Automated all jobs for pulling data from FTP server to load data into Hive tables using Oozie workflow.
- Designed and developed the framework to consume the web services hosted by Amazon EC2 instances.
- Supported MapReduce programs that were running on the cluster.
Environment: Hadoop Framework, MapReduce, Hive, Sqoop, Flume, Oozie, Java(JDK1.7), Amazon EC2, UNIX Shell Scripting, Oracle 11g, IBM Datastage 8.1, Cassandra
Confidential, Atlanta, GA
Hadoop Developer
Responsibilities:
- Involved in the installation of Hadoop cluster installation, configuration and monitoring
- Exported data from DB2 to HDFS using Sqoop
- Generating Scala and java classes from the respective APIs so that they can be incorporated in the overall application
- Installed and configured Pig and also wrote Pig Latin scripts
- Wrote Map Reduce jobs using Pig Latin
- Wrote KafkaAPIs in python to queue lot of streaming data coming from multiple sources inside to spark by applying producer and consumer paradigm.
- Importing and exporting data into HDFS and Hive using Sqoop.
- Involved in loading data from UNIX file system to HDFS.
- Installed and configured Hive and also wrote Hive UDF’s.
- Developed workflow using Oozie for running Map Reduce jobs and Hive Queries
- Worked on Cluster coordination services through Zookeeper
- Worked on loading log data directly into HDFS using Flume
Environment: Hadoop framework, MapReduce, HDFS, Scala, Pig, Hive, Kafka, HBase, Sqoop, Flume, Oozie, Java (J2EE), XML, DB2, LOG4J, ANT and Linux.
Confidential, Kansas City, MO
Java/J2EE Developer
Responsibilities:
- Involved in Presentation Tier Development using JSF Framework and ICE Faces tag Libraries.
- Implemented J2EE standards, MVC2 architecture using JSF Framework.
- Implementing Servlets, JSP and Ajax to design the user interface.
- Extensive experience in building GUI (Graphical User Interface) using JSF and ICE Faces
- Experience using ICE Faces Tag Libraries to develop user interface components.
- Used JSF, JSP, Java Script, HTML, and CSS for manipulating, validating, customizing, error messages to the User Interface.
- Extensively used EJBs (Session beans) to implement the business logic, JMS for communication for sending updates to various other applications and MDB for routing priority requests.
- All the business logic in all the modules is written in core Java.
- Wrote Web Services using SOAP for sending and getting data from the external interface.
- Developed a web-based reporting for monitoring system with HTML and Tiles using Struts framework
- Middleware Services layer is implemented using EJB (Enterprise Java Bean - stateless) in WebSphere environment.
- Used Design patterns such as Business delegate, Service locator, Model View Controller, Session façade, DAO.
- Funds Transfers are sent to another application using JMS technology asynchronously.
- Involved in implementing the JMS (Java messaging service) for asynchronous communication.
- Involved in writing JMS Publishers to post messages.
- Involved in writing MDB (Message Driven Beans) as subscribers.
- Created Stored procedures using PL-SQL for data modification (Using DML insert, update, delete) in Oracle
- Interaction with Oracle database is implemented using Hibernate.
Environment: J2EE, EJB, JSF, ICE Faces, EJB, Web Services, XML, XSD, Agile, Microsoft Visio, Clear Case, Oracle 9.i/10.g, Weblogic8.1/10.3,RAD, LOG4j, Servlets, JSP, Unix.
Confidential, Reston, VA
Java/J2EE Developer
Responsibilities:
- Involved in resolving high priority production issues processing XML files using JAXB parsers and transformations using XSLT.
- Developed web based application and integrating the application using open source frameworks in Spring, Struts 2.0 and Java Messaging Service API.
- Used JSP for developing screens for creating and updating credit line set for application customer.
- Developed Ant build file to automate the build process.
- Wrote action and service classes and defined action mappings in struts.xml and application-context.xml file.
- Involved in preparation of design documents for all the impacted methods and for new functionality.
- Implemented DAO layer using Entity Bean and wrote queries for persisting cards related information.
- End to end design and development exposure.
- Involved in defect fixing activity and ensuring on time Delivery by the Team.
Environment: Java 1.5, JDBC 2.0, JavaScript, JMS 1.1, Servlet 2.0, XML, CSS, HTML, XHTML, Ant, Spring Framework 2.0 and Struts 2.0., Oracle 10g.
Confidential, Bloomington, IL
Java/J2EE Developer
Responsibilities:
- Involved in designing the application and prepared Use case diagrams, class diagrams, sequence diagrams.
- Developed Servlets and JSP based on MVC pattern using Struts Action framework.
- Used Tiles for setting the header, footer and navigation and Apache Validator Framework for Form validation.
- Using Resource and Properties files for i18n support.
- Involved in writing Hibernate queries and Hibernate specific configuration and mapping files.
- Used Log4J logging framework to write Log messages with various levels.
- Involved in fixing bugs and minor enhancements for the front-end modules.
- Used JUnit framework for writing Test Classes.
- Used Ant for starting up the application server in various modes.
- Used Clear Case for version control.
- Used SDLC Life Cycle
Environment: Java JDK1.4, EJB2.x, Hibernate 2.x, Jakarta Struts 1.2, JSP, Servlet, JavaScript, MS SQL Server 7.0, Eclipse3.x, Websphere 6, Ant, Windows XP, Unix, Excel Macro Development.
Confidential, San Francisco, CA
Java/J2EE Developer
Responsibilities:
- Elaborated Use Cases based on business requirements and was responsible for creation of Class Diagrams, Sequence Diagrams.
- Developed user interfaces using JSPs, HTML, XHTML, DHTML, CSS, Java Script, JSP Custom Tags.
- Developed JSPs and managed beans using JSF1.2 implementation.
- Developed Service layer using spring framework and injected the Spring beans into JSF managed bean.
- Developed web pages using JSF UI Components.
- Developed Asynchronous means of retrieval of data from the Server and Database using AJAX features as well JavaScript.
- Developed Java classes for implementation of persistence of objects and caching of Data using Hibernate.
- Extensively used Core Java such as Multi Threading, Exceptions, and Collections.
- Designed WSDL's and elaborated type definitions schemas based on corporate standards, integration and security specifications
- Implemented the Web Services and associated business modules integration.
- Tested JSPs in FireFox and Internet Explorer browsers. Identified and fixed browser related issues.
- Used ANT script to compile and build the WAR.
- Configured the WebLogic handler for the Apache Web Server to serve static files (js, html, images and css).
- Developed SQL Statements as well as PL/SQL Stored Procedures for searching contractors depending on Selection Criteria.
- Developed Servlets for Document Upload, Image Streaming and Caching the data.
- Development and Integration of the Application using Eclipse IDE and used StarTeam as Version Control Tool.
- Involved in the full system life cycle and responsible for Developing, Testing, Implementing.
- Involved in Unit Testing, Integration Testing, and System Testing etc.
- Developed JavaScript validation for client side validations.
- Performed Code reviews and code fixes.
- Used Log4J to store log messages.
Environment: Java 1.5, J2EE, Spring, JSP, Hibernate, JSF, Struts 2.0, LDAP, AJAX, HTML, CSS, JDBC, Eclipse, Weblogic 10.x, Web Services, WSDL, Oracle, ANT, Windows, SOA, Design patterns, Firebug, IETester, jQuery, AJAX, JavaScript, HTML, CSS.
Confidential
Java/J2EE Developer
Responsibilities:
- Involved in requirement gathering, analysis, design and development of the application.
- Developed the web application using Struts Framework.
- Developed application on STRUTS framework and configured struts-config.xml, web.xml.
- Created tile definitions, struts-config files and resource bundles using Struts framework.
- Implemented validation framework for creation of validation.xml and used validation-rules.xml.
- Interaction with Oracle database is implemented using Hibernate.
- Developed Classes in Eclipse for Java, using the Class Specification provided in Rational Rose.
- Design and developed SQL Queries, Views and procedures.
- Designed, developed and deployed necessary stored procedures, Functions using SQL, PL/SQL.
- Created Unit Test cases for developed functionality and performed Unit testing.
- Point of contact for the onsite team.
- Used to make the necessary changes to the wireframe after contacting the onsite team.
- Divide the work into modules and assign the same to the team mates with deadlines.
- Involved in integrating and building the code.
- Writing the test cases and performing all the tests on all the scenarios.
- Debugging using Fire Bug (Mozilla Firefox) and Developer Tools (IE).
- Point of contact for the testing team and would explain them the flow when in doubt.
- Modifying and developing the website according to the buyers.
Environment: Java/JDK 1.5, Struts, Eclipse, J2EE, JBoss Application server and Oracle, JSP, RDBMS, SQL, PL/SQL, JavaScript, JQuery, JDBC, Servlet, Unified Modeling Language, Toad, JUnit, Core Java, Struts.
