SUMMARY:

• Over Eight years of experience with emphasis on Big Data Technologies, Development and Design of Java based enterprise applications.
• Proficiency and knowledge in understanding the architectural components of Hadoop like HDFS, Job Tracker, Task Tracker, Name Node, Data Node and MapReduce concepts.
• Experience with Hive, Pig, MapReduce, Sqoop, Spark, Kafka, Yarn, Oozie and Zookeeper.
• Configured hive in MapR environment both in production cluster and staging cluster.
• Hands - on experience in the management of single-node and multi-node Hadoop clusters (CDH3, CDH4, CDH5) including installation, performance tuning and troubleshooting of the system.
• Experienced in data analysis using Hadoop and extensive experience in writing map reduce jobs in java and hive UDFs.
• Experience in using columnar (non-relational) data warehousing techniques like Cassandra and HBase.
• Worked on Apache Spark streaming API on Big Data distributions in the active cluster environment.
• Experience using Service Oriented Architecture (SOA) like Apache Axis Web Services and on using SOAP/ REST, WSDL, JAX-WS.
• Strong background and experience with Java/ J2EE and applications using JSP, Servlets, Spring, Struts, Hibernate, EJBs, JDBC and JNDI.
• Hands-on experience working on packaging and deploying J2EE applications like ANT, MAVEN, WebLogic, WebSphere and JBoss.
• Experienced in complete Software Development Life Cycle; from inception of idea, requirement gathering, system design, document reviews, coding, code reviews, unit testing, system testing, product delivery and Product maintenance on varying computer architectures including Storage domain.
• Defining Test Cases, analyzing bugs, interaction with team members in fixing errors, Unit testing and User Acceptance Testing (UAT).
• Exceptional problem solving skills and ability to quickly adapt to new challenges.
• Document and explain implemented processes and configurations in upgrades.
• Support development, testing, and operations teams during new system deployments.
• Worked on debugging tools such as Dtrace, Truss and Top. Expert in setting up SSH, SCP, SFTP connectivity between UNIX hosts.
• An excellent team player and self-starter with good communication skills and proven abilities to finish tasks before target deadlines.

TECHNICAL SKILLS:

BigData Ecosystem: Hadoop, MapReduce(MR1 and MR2), HDFS, Hive, HIVE on Spark, Pig, Sqoop, Oozie scheduler, Flume, Scala, STORM, KAFKA, HBase, impala, and Zookeeper.

Languages: Core JAVA/ J2EE, Spring IOC 3.0, Spring MVC3.0, Hibernate 4.0, JPA,Struts2, JSP, JSF, Java script, JQuery, XSLT, XML, HTML, and Rational Rose, Python, R.

Scripting Languages: JavaScript, Shell Scripts

Conceptual Knowledge: Polymorphism, Threads and Multi-Threading, Operator/Function Overloading, Design Patterns.

Operating System: UNIX, Windows.

Data Base: Oracle, Mongo DB, MySQL

Identity Management: Sun-Identity Manager 5.x, 6.x I, Kerberos authentication.

PROFESSIONAL EXPERIENCE:

Confidential, Fort Mill, SC

Hadoop Developer

Responsibilities:

• Loaded customer data from the existing RDMS (SQL server) over to HDFS using Sqoop.
• Performed queries using Hive and Pig scripts using Oozie workflows and sub-workflows.
• Extensively used Hive for data cleansing for various data formats.
• Used Flume for streaming the data to HDFS.
• Worked on Hive and Hive on Spark to creating tables, loading TB of historical data and creating ETL process for daily update in java map reduce jobs.
• Used Pig for ETL purposes and performed operations using Pig functions before loading the data into HDFS.
• Used NoSql databases like Cassandra and HBase and have hands-on experience in integrating them with Hadoop cluster.
• Used data partitioning in Hive and analyzed the data partitions for the purpose of data reporting.
• Developed map reduce functions for filtering and date-time assignment of the input data for data segregation.
• Handled data coming from various sources and analyzed the data using Hive queries.
• Hands on experience in reviewing and managing Hadoop log files.
• Created technical documentation for the execution of Hive and Pig scripts.
• Research on HBase, flume, Yarn and Hive on spark for different project requirement.
• Involved in schema design for the application using Hive and HBase.
• Architected and executed the Migration plan from CDH5 to MapR cluster.

Environment: Hadoop, MR1, MR2, CDH4, CDH5, MapR, Hue, hive, hive on spark, pig, sqoop, oozie, impala, column oriented database Cassandra, HBase, NoSQL, Solr, STORM, KAFKA, Scala, Yarn, core java, Maven, distributions like cloudera( CDH4, CDH5), MapR, SVN, Eclipse, Spot fire.

Hadoop / Java Developer

Responsibilities:

• Performed sqoop imports of data from Data warehouse platform to HDFS and built hive tables on top of the datasets.
• Developed pig UDFs for functions that are not directly available from Apache Pig.
• Used HUE to create oozie workflows to perform different kinds of actions such as hive, java & Mapreduce.
• Involved in loaded TB of data in both structured and unstructured formats.
• Used sequence and avro file formats and snappy compressions while storing data in HDFS.
• Performed streaming job operations on Hadoop using Flume and processed TB of data.
• Worked on Flume for Hadoop log file storage and stored data that was used for further analysis.
• Worked on features like reading a hive table from Mapreduce and making it available for all data nodes by keeping in distributed cache.
• Accessed the metadata of Hive tables using HCATALOG using MapReduce or Pig code.
• Participated in building CDH4 test cluster for implementing Kerberos authentication.
• Created workflow using Oozie to perform various jobs at a regular basis independent of time for Hive and Pig.
• Developed a data pipeline using Flume and Pig to extract various weblogs, transferred and stored the data in HDFS.
• Developed shell scripts for the execution of the scripts of Hive, Pig and moving the data in and out of the HDFS.
• Pivoting table to store in HBase and indexing using solr.
• Created the documentation for project summary, maintenance and worked in an Agile environment.
• Tools like Rally have been used for task tracking. Followed Test driven development and used Junit testing.

Environment: Hadoop, CDH4, Hue, Mapreduce, hive, pig, sqoop, oozie, impala, column oriented database Cassandra, HBase, NoSQL, Solr, STORM, KAFKA, Scala, Yarn, Spring MVC3.0, core java/J2EE, JSON, Netezza, Maven, SVN, Eclipse, Agile.

Java Developer

Responsibilities:

• Excellent JAVA, J2EE application development skills with strong experience in Object Oriented Analysis, Extensively involved throughout Software Development Life Cycle (SDLC).
• Implemented various J2EE standards and MVC framework involving the usage of Struts, JSP, AJAX and servlets for UI design.
• Used SOAP/ REST for the data exchange between the backend and user interface.
• Utilized Java and MySQL from day to day to debug and fix issues with client processes.
• Developed, tested, and implemented financial-services application to bring multiple clients into standard database format.
• Assisted in designing, building, and maintaining database to analyze life cycle of checking and debit transactions.
• Created web service components using SOAP, XML and WSDL to receive XML messages and for the application of business logic.
• Used ICE Faces libraries for the data collection/ retrieval pages and presentation pages for the users.
• Hands on experience using JBOSS for the purpose of EJB and JTA, and for caching and clustering purposes.
• Strong experience of J2SE, XML, Web Services, WSDL, SOAP, UDDI, TCP, IP.
• Strong experience of software and system development using JSP, Servlet, Java Server Face, EJB, JDBC, JNDI, Struts, Maven, Trac, Subversion, JUnit, SQL language.
• Rich experience of database design and hands-on experience of large database systems: Oracle 8i and Oracle 9i, DB2, PL/ SQL.
• Involved in analysing system failures, identifying root causes and recommended course of actions.
• Implemented JUnit and JAD for debugging and to develop test cases for all the modules.
• Hands-on experience of Sun One Application Server, Web logic Application Server, Web Sphere Application Server, Web Sphere Portal Server, and J2EE application deployment technology.

Environment: Java multithreading, JDBC, JNDI, JBoss, PL/ SQL, WebSphere,Hibernate, Struts, Collections, Maven, Trac, Subversion, JUnit, SQL language, Struts, JSP, SOAP, Servlets, Spring, Hibernate, Junit, Oracle, XML, AltovaXmlSpy, Putty and Eclipse.

Java/ JEE Developer

Responsibilities:

• Developed Web based front end applications in a three-tier architecture using Java, J2EE, HTML, XHTML, JSP, Servlets, JSF, JavaBeans, and Java Swing.
• Built an end to end vertical slice for a JEE based billing application using popular frameworks like Spring, Hibernate, JSF, Facelets, XHTML, Maven2, and Ajax by applying OO design concepts, JEE & GoF design patterns, and best practices.
• Worked on the J2EE design patterns like Singleton, DAO, Session and Delegate.
• Integrated other sub-systems like loans application, equity markets online application system, and documentation system with the structured products application through JMS, Web Sphere MQ, SOAP based Web services, and XML.
• Employed the use of Hibernate for the purpose of handling database transactions.
• Designed the logical and physical data model, generated DDL scripts, and wrote DML scripts for Oracle 9i database.
• Configured struts framework and implemented the MVC design patterns using the configuration.
• Gathered business requirements and wrote functional specifications and detailed design documents.
• Worked on ORM mapping relations using XML for the purpose and mapping the java classes with the database.
• Improved the build process by performing migration from Ant to Maven2 and developed scripts for compiling and deployment.
• Hands-on experience using the WebLogic server with the entire project being deployed on WebLogic server.
• Built and deployed Java applications into multiple Unix based environments and produced both unit and functional test results along with release notes.

Environment: Java 1.5, JSF Sun RI, Facelets, Ajax4JSF, Richfaces, Spring, XML, XSL, XSD, XHTML, Hibernate, Oracle 9i, PL/SQL, MINA, Spring-ws, SOAP Web service, WebLogic, Oracle, JMX, ANT, Maven2, Continuum, JUnit, SVN, TDD, and XP.

Java/J2EE developer

Responsibilities:

• Designed and developed Struts like MVC 2 Web framework using the front-controller design pattern, which is used successfully in a number of production systems.
• Worked on Java Mail API. Involved in the development of Utility class to consume messages from the message queue and send the emails to customers.
• Normalized Oracle database, conforming to design concepts and best practices.
• Used JUnit framework for unit testing and Log4j to capture runtime exception logs.
• Performed Dependency Injection using Spring framework and integrated with Hibernate and Struts frameworks.
• Hands on experience creating shell and perl scripts for project maintenance and software migration. Custom tags were developed to simplify JSP applications.
• Hands-on experience using CVS and WebLogic. Version control was performed using CVS and WebLogic was used as the application server.
• Applied design patterns and OO design concepts to improve the existing Java/JEE based code base.
• Identified and fixed transactional issues due to incorrect exception handling and concurrency issues due to unsynchronized block of code.

Environment: Java 1.2/1.3, Swing, Spring, Hibernate, Applet, Servlet, JSP, custom tags, JNDI, JMS, JDBC, XML, XSL, DTD, HTML, CSS, Java Script, Oracle, DB2, PL/SQL, Web logic, JUnit, Log4J and CVS.