SUMMARY:

• Over seven years of professional IT experience in all phases of Software Development Life Cycle which includes hands on experience in Java/J2EE technologies and Big Data Analytics.
• Hands on experience in different phases of big data applications like data ingestion, data analytics and data visualization.
• Hands on experience in installing, configuring and using ecosystem components like Hadoop Map Reduce, HDFS, HBase, Zoo Keeper, Hive,Oozie, Sqoop, Pig, Flume,Kafka,Storm, Spark,, Scala, Cassandra with Cloudera and Horton Works.
• Good Understanding of Hadoop Gen1/Gen2 architecture and Hands - on experience with Hadoop components such as Job Tracker, Task Tracker, Name Node, Data Node, Map Reduce concepts and YARN architecture.
• Experienced with different distributions like Cloudera, Horton works and Apache open source distribution.
• Experience in building, maintaining multiple Hadoop clusters of different sizes and configuration and setting up the rack topology for large clusters.
• Hands on experience in big data ingestion tools like Flume and Sqoop.
• Experienced in transferring Streaming data, data from different data sources into HDFS, No SQL databases using Apache Flume and Apache Kafka.
• Well versed with Developing and Implementing Map Reduce programs using Hadoop to work with Semi and Unstructured data.
• Experienced in implementing different analytical algorithms using map reduce programs with the help of map reduce design patterns.
• Experienced to interact with data scientists to implement ad-hoc queries using Hive QL, Partitioning, bucketing and Hive Custom UDF's.
• Experienced in optimizing hive queries, optimized joins and using different data files with Custom SerDe's.
• Analyzed large amounts of data sets and migrate ETL operations using Pig Latin scripts, operations and UDF's.
• Experienced in performing real time analytics to visualize data to dash boards using HBase.
• Experience in implementing a distributed messaging queue to integrate with Cassandra using Apache Kafka and Zookeeper.
• Exposure with Apache Storm architecture to integrate with Kafka to perform streaming operations.
• Experience in using different file formats like Sequence, AVRO, RC files and CSV using different compression Techniques.
• Worked onData profiling,Data Modeling &Data Quality features fordata warehouse (OLAP) & Enterprise application transactional databases (OLTP).
• Expert in implementing advanced procedures like text analytics and processing using the in-memory computing capabilities like Apache Spark written in Scala.
• Good knowledge of NoSQLdatabases like HBase and Cassandra.
• Experience in using UNIX scripting and Oozie schedulers to implement Cron jobs that execute different kind of Hadoop actions.
• Experience testing Map Reduce programs using MRUnit, Junit and Easy Mock.
• Good Experience in Developing JAVA and J2EE technologies using JSP, JDBC, EJB and open source like Struts, Spring, Hibernate and Junit.
• Working knowledge of Web/Application Servers like Jboss, Apache Tomcat, IBM Web Sphere and Oracle Web Logic.
• Experience in Database design, Entity relationships, Database analysis, Programming SQL, Functions, Stored procedure's PL/ SQL, Packages and Triggers in Oracle and SQL Server on Windows and LINUX.
• Familiar with RDBMS concepts and worked on Oracle 8i/9i, SQLServer 7.0., DB2 8.x/7.x.
• Good understanding and experience with Software Development methodologies like Agile and Waterfall.
• Excellent communication, analytical skills and flexible to learn new technologies in the IT industry towards company’s success.

TECHNICAL SKILLS:

Big Data Technologies: Hadoop, HDFS, Hive, Map Reduce, Pig, Sqoop, Flume, Oozie, Puppet.

Big Data Pipeline: Spark, Storm, Kafka, Zookeeper.

Scripting Languages: Python, Perl, Shell.

Programming Languages: C, C++, Java.

Web Technologies: HTML, J2EE, CSS, JavaScript, AJAX, Servlets, JSP, DOM, XML, XSLT, XPATH.

Java Frameworks: Struts, Spring, Hibernate.

Application Server: Websphere, Weblogic Server, Apache Tomcat.

DB Languages: SQL, PL/SQL.

Databases /ETL: Oracle 9i/10g/11g, MySQL 5.2, DB2, Informatica v 8.x.

NoSQL Databases: Hbase, Cassandra, Mango DB.

Operating Systems: Linux, UNIX, Windows 2003 Server.

IDE/Testing Tools: NetBeans, Eclipse.

PROFESSIONAL EXPERIENCE:

Confidential -Montgomery,AL

Hadoop Developer

Responsibilities:

• Responsible for Build/develop/testing shared components that will be used across many modules.
• Conducted data model reviews with project team members.
• Captured technical metadata through data modeling tools.
• Hive scripts to convert EBCIDIC data to Avro format.
• Imported all the Customer specific personal data to Hadoopusing SQOOP component of Hadoop.
• Experience in usingAvro, Parquet, RCFile and JSON file formats and developed UDFs using Hive and Pig.
• Created tasks for incremental load into staging tables, and schedule them to run.
• Used Apache Kafka as messaging system to load log data, data from UI applications into HDFS system.
• Written Map Reduce code that will take input as customer related flat file and parse the same data to extract the meaningful (domain specific) information for further processing.
• Created Hive External tables with partitioning to store the processed data from Map Reduce.
• Implemented Different analytical algorithms using map reduce programs to apply on top of HDFS data.
• Implemented Hive optimized joins to gather data from different sources and run ad-hoc queries on top of them.
• Wrote Hive Generic UDF's to perform business logic operations at record level.
• Implemented Data classification algorithms using map reduce design patterns.
• Extensively worked on creating combiners, Partitioning, Distributed cache to improve the performance of Map Reduce jobs.
• Experienced in migrating map reduce jobs into RDD(Resilient data distributions) and create Spark jobs for better performance.
• Developed workflow in Oozie to automate the tasks of loading the data into HDFS and pre-processing with Pig.
• Involved in loading data from LINUX file system to HDFS.
• Used Pig to do data transformations, event joins, filter and some pre-aggregations before storing the data onto HDFS.
• Experienced in implementing test cases and writing test classes using MRUnit and mocking frameworks.
• Implemented test scripts to support test driven development and continuous integration.
• Analyzed large amounts of data sets to determine optimal way to aggregate and report on it.

Environment: Cloudera, Hadoop, MapReduce, HDFS, Hive, Pig, Oozie, Sqoop, ApacheKafka, Linux, Junit, MRUnit.

Confidential - Pittsburgh,PA

Hadoop Developer

Responsibilities:

• Installed and configured Hadoop, Map reduce, HDFS, Developed multiple Map Reduce jobs in java for data cleaning and preprocessing.
• Wrote Map Reduce bulk operations to move data from map reduce into HBase for real time insights on data.
• Developed integrated dash board to perform CRUD operations on HBase data using Thrift API.
• Implemented error notification module to support team using HBase co-processors (Observers).
• Configured, integrated flume sources, channels, destinations to analyze log data into HDFS.
• Implemented flume custom interceptors to perform cleansing operations before move into HDFS.
• Experienced in transferring data from multiple data sources using Map Reduce programs with the help of Generic writable.
• Implemented Composite key, Custom writable and secondary sorting to implement top-k results.
• Experienced in using Avro, Xml files in Hive tables with configuring, implementing custom SedDe' properties.
• Experienced in optimizing Hive Queries, Joins to get better results for Hive ad-hoc queries.
• Worked on debugging, performance tuning of Hive & Pig Jobs.
• Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way.
• Assisted in Cluster maintenance, cluster monitoring, adding and removing cluster nodes and Troubleshooting.
• Setup and benchmarked Hadoop clusters for internal use.

Environment: Horton works, Hadoop, Map Reduce, HDFS, Hive, HBase,Flume, Java, Pig, MySQL, Java 6, Eclipse, PL/SQL, SQL connector, Sub Version.

Confidential -Plano,TX

Hadoop developer

Responsibilities:

• Launching and Setup ofHADOOP/ HBASE Cluster which includes configuring different components ofHADOOPand HBASE Cluster.
• Wrote the Map Reduce jobs to parse the web logs which are stored in HDFS.
• Experienced in designing data model for variable schema using Cassandra data model.
• Experienced in performing enhancements to time series data using Cassandra Time series data queries.
• Implemented predicative queries on top of Cassandra data to add restrictions on data.
• Installed and configured Flume, Hive, Pig, Sqoop and Oozie on theHadoopcluster.
• Managing and scheduling Jobs on aHadoopcluster using Oozie.
• Hands on experience in loading data from UNIX file system to HDFS.
• Involved in creating Hive tables, loading data and running hive queries in those data.
• Extensive Working knowledge of partitioned table, UDFs and performance tuning in Hive.
• Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way.
• Designed and implemented Map reduce based large-scale parallel relation-learning system.
• Involved in developing and testing Pig Latin Scripts.
• Involved in gathering the requirements, designing, development and testing.
• Developed the services to run the Map-Reduce jobs as per the requirement basis.
• Developing design documents considering all possible approaches and identifying best of them.

Environment: Amazon EC2, ApacheHadoop1.0.1, MapReduce, HDFS, CentOS 6.4, Cassandra, Hive, Pig, Oozie, Flume, Java (jdk 1.6), Eclipse.

Confidential, Chicago-IL

Java/J2EE Developer

Responsibilities:

• Developed user interface using JSP, Struts and Java Script to simplify the complexities of the application.
• The entire application was developed in J2EE using an MVC based architecture with help of Apache Struts 1.3.8.
• Implemented the application using the concrete principles laid down by several Java/J2EE Design patterns like Business Delegate, MVC, Singleton, Data Transfer Object (DTO) and Service Locator.
• Coded Struts Action classes and Model classes.
• Used JavaScript for client-side validations, and AJAX to create interactive front-end GUI.
• Implemented client side validations using JavaScript.
• Used Web Sphere as the application server for deployment.
• Developed Web applications with Rich Internet applications using Java applets, SilverLight, JavaFX.
• Debugged and developed applications using Rational Application Developer (RAD).
• Developed a Web service to communicate with the database using SOAP.
• Involved in writing stored procedures, complex queries using SQL to process the data on MYSQL DB.
• Performed unit testing on various project modules using JUnit framework.
• Used Apache Ant as build tool.
• Used IBM Rational Clear Case as version control tool for maintaining source code and project documents.
• Implemented Log4J for Logging Errors, debugging and tracking.

Environment: Java 1.5, JSF Sun RI, Facelets, Ajax4JSF, Richfaces, Spring, XML, XSL, XSD, XHTML, Hibernate, Oracle 9i, PL/SQL, MINA, Spring-ws, SOAP Web service, Web Sphere, Oracle, JMX, ANT, Maven2, Continuum, JUnit, SVN, TDD, and XP.

Confidential

Java/J2EE Developer

Responsibilities:

• Analyzed Object Oriented Design and presented with UML Sequence, Class Diagrams.
• Developed Admission & Census module, which monitors a wide range of detailed information for each resident upon pre-admission or admission to your facility.
• Developed UI using HTML, JavaScript, JSP, and developed Business Logic and Interfacing components using Business Objects, XML, and JDBC.
• CreatedRESTfulweb services interface to Java-based runtime engine.
• Used Spring Transactional Management, JDBC Template.
• Designed user-interface and checking validations using JavaScript.
• Developed components using Java multithreading concept.
• Managed connectivity using JDBC for querying/inserting & data management including triggers and stored procedures.
• Involved in design of JSP's and Servlets for navigation among the modules.
• Developed various EJBs (session and entity beans) for handling business logic and data manipulations from database.
• Designed cascading style sheets and XSLT and XML part of Order entry Module & Product Search Module and did client side validations with java script.
• Hosted the application on WebSphere.

Environment: J2EE, Java/JDK, JMS, PL/SQL, JDBC, JSP, Servlets, JavaScript, EJB, JNDI, JavaBeans, XML, XSLT, Oracle 9i, RAD 6.0, HTML/ DHTML, UML, JavaScript.