SUMMARY:

• Over 7 years of professional IT experience which includes 3 plus years of experience in Big data ecosystem related technologies like Hadoop, Pig, Hive, Sqoop, HBase, Cassandra and designing and implementing Map/Reduce jobs to support distributed data processing and process large data sets utilizing the Hadoop cluster.
• Working experience with large scale Hadoop environments build and support including design, configuration, installation, performance tuning and monitoring.
• Excellent understanding / knowledge of Hadoop architecture and various components such as HDFS, Big Data eco system (Job Tracker, Task Tracker, Name Node, Data Node) and Map Reduce programming paradigm.
• Hands on experience in installing, configuring, and using Hadoop ecosystem components like Hadoop Map Reduce, HDFS, HBase, Oozie, Hive, Sqoop, Pig, Zookeeper, Yarn and Lucene.
• Experienced in monitoring Hadoop cluster environment using Ganglia.
• Very good experience in complete project life cycle (design, development, testing and implementation) of Client Server and Web applications.
• Involved in generating automated scripts (YAML files) of Falcon and Oozie using ruby.
• Experience in Object Oriented Analysis, Design (OOAD) and development of software using UML Methodology, good knowledge of J2EE design patterns and Core Java design patterns.
• Experienced in SQA (Software Quality Assurance) including Manual and Automated testing with tools such as Selenium RC/IDE/WebDriver/Grid and Junit, Load Runner, Jprofile, RFT (Rational Functional Tester).
• Proficient in deploying applications o n J2EE Application servers like Web - Sphere, Web-logic, Glassfish, Tuxed o, JBoss and Apache Tomcat web server.
• E0.xpertise in developing applications using J2EE Architectures / frameworks like Struts, Spring Framework and SDP (Qwest Communications) Framework.
• Excellent Java development skills using J2EE, J2SE, Servlets, JSP, EJB, JDBC.
• Experience in NoSQL data stores (Hbase, Cassandra).
• Implemented POC’s using Amazon Cloud Components (S3, EC2 and SimpleDB).
• Experience in database design using PL/SQL to write Stored Procedures, Functions, Triggers and strong experience in writing complex queries for Oracle 8i/9i/10g. .
• Extensive experience using multiple languages/technologies (Java/J2EE, C++, C, Perl, PHP, Ruby) and environments (JVM, Linux, Various Unix, Windows).
• Ability to adapt to evolving technology, strong sense of responsibility
• Ability to meet deadlines and handle multiple tasks, flexible in work schedules and possess good communication skills.
• Performance Tuning Hadoop run-time parameters to minimize the map disk spill, mapper tasks and mapper output .
• Migration of data using sqoop databases transferring data between traditional and Hadoop .
• Using Flume for migration data from any source into Hadoop (HDFS).

TECHNICAL SKILLS:

JAVA Technologies: Java, JDK 1.2, JDK 1.3, JDK1.4, JDK1.5, JDK1.6.

J2EE Technologies: JSP, Java Bean, Servlets, JDBC, JPA1.0, EJB3.0, JDBC, JNDI, JOLT, Amazon Cloud (S3, EC2 ).

Languages: C, C++, PL/SQL, and Java.

Frame Works: Hadoop (HDFS, Map Reduce, Pig, Hive, HBase, Mahout, Oozie, Zookeeper, YARN, Lucene) Struts 1.x and Spring 3.x

Web Technologies: XHTML, JavaScript, AngularJS, AJAX, HTML, XML, XSLT, XPATH, CSS, DOM, WSDL, GWT, JQuery, Perl, VB Script.

Application Servers: WebLogic8.1/9.1/10.x, Web-Sphere5.x/6.x/7.x, Tuxedo server 7.x/9.x, Glass Fish Server 2.x, JBoss4.x/5.x.

Web Servers: Apache Tomcat 4.0/ 5.5, Java Web Server 2.0.

Operating Systems: Windows: XP/2000/NT, UNIX, Linux, and DOS

Database: SQL, Oracle 9i/10g, SQLServer, Hbase and Cassandra.

IDE: Eclipse3.x, My Eclipse 8.x, RAD 7.x and JDeveloper 10.x.

Tools: Adobe, Sql Developer, Flume and Sqoop

Web Technologies:: XHTML, JavaScript, XML, CSS, DOM, WSDL, SOA, Web Services.

Platforms: Windows XP/NT/9x/2000, MS: DOS, UNIX /LINUX/Solaris/AIX

Databases: SQL, PL/SQL, Oracle 9i/10g, MYSQL, Microsoft Access, SQLServer.

PROFESSIONAL EXPERIENCE:

Confidential, Bothell, WA

Sr. Hadoop Developer

Responsibilities:

• Launching and Setup of HADOOP related tools on different sources, which includes configuring different components of HADOOP.
• Experience in Using Sqoop to connect to the Sql Server or Oracle database and move the pivoted data to Hive tables and stored in Orc files.
• Managed the Hive database, which involves ingest and index of data.
• Expertise in exporting the data from orc files and indexing the documents in sequence or serde file format.
• Hands on experience in writing custom UDF’s and also custom input and output formats.
• Scheduling the Hive jobs using Tidal jobs in process files.
• Using wrapper scripts and log aggregation, real time event processing, monitoring and queueing.
• Involved in design and architecture of custom Lucene storage handler.
• Configured and Maintained different topologies in storm cluster and deployed them on regular basis.
• Experience in Using Sqoop to connect to the Sql Server or Oracle database and move the pivoted data to Hive tables and stored in orc files and snappy compression.
• Managed the Hive database, which involves ingest and index of data.
• Expertise in exporting the data from orc files and indexing the documents in sequence or serde file format.
• Understanding of multi-threaded java programs for generated Hive.QL .
• Maintained the test mini cluster using vagrant and VMware fusion..
• Involved transferring data between traditional databases and Hadoop using Sqoop.
• Involved data types testing for source systems and Hive data types in HDFS.

Environment: Hadoop, Big data, Hive, Hbase, Sqoop, Oozie, Map Reduce, Jira, Bit bucket, Maven, Bamboo, J2EE, Guice, AngularJS, Jmockit, Lucene, Ruby, Unix, Sql, ORC.

Confidential, Boston, MA

Sr. Hadoop Developer

Responsibilities:

• Launching and Setup of HADOOP related tools on AWS, which includes configuring different components of HADOOP.
• Experience in Using Sqoop to connect to the Sql Server or Oracle database and move the pivoted data to Hive tables and stored in Avro files.
• Managed the Hive database, which involves ingest and index of data.
• Expertise in exporting the data from Avro files and indexing the documents in sequence or serde file format.
• Hands on experience in writing custom UDF’s and also custom input and output formats.
• Scheduling the Hive jobs using Oozie process files.
• Involved in design and architecture of custom Lucene storage handler.
• Configured and Maintained different topologies in storm cluster and deployed them on regular basis.
• Understanding of Ruby scripts used to generated yaml files.
• Maintained the test mini cluster using vagrant and VMware fusion.
• Involved in GUI development using JavaScript and AngularJS and Guice.
• Developed Unit test case using Jmockit framework and automated the scripts.
• Worked in Agile environment, which uses Jira to maintain the story points and Kanban model.
• Involved in brain storming JAD sessions to design the GUI.
• Hands on experience on maintaining the builds in Bamboo and resolved the build failures in Bamboo.
• Involved transferring data between traditional databases and Hadoop using Sqoop.
• Using Flume for migration data from any source into Hadoop (HDFS).

Environment: Hadoop, Big data, Hive, Hbase, Sqoop, Oozie, HDFS, Map Reduce, Jira, Bit bucket, Maven, Bamboo, J2EE, Guice, AngularJS, Jmockit, Lucene, Ruby, Unix, Sql, AWS (Amazon Web Services).

Confidential, Hoffman Estates, IL

Hadoop Developer

Responsibilities:

• Involved in design and development phases of Software Development Life Cycle (SDLC) using Scrum methodology.
• Developed data pipeline using Cassandra, Pig and Java map reduce to ingest customer profiles and purchase histories into HDFS for analysis.
• Developed job flows in Oozie to automate the workflow for extraction of data from warehouses
• Used Pig as ETL tool to do transformations, event joins, filter boot traffic and some pre-aggregations before storing the data onto HDFS
• Applied pattern matching algorithms to match customers spending habits with loyalty points using Hive and stored the output in Hbase.
• Involved in Performance Tuning Hadoop run-time parameters to minimize the map disk spill, mapper tasks and mapper output
• Use configuration file and command line arguments to set parameters with balancing reducer’s loading.

Environment: JDK1.6, RHEL, HDFS, Map-Reduce, Hive, Pig, Sqoop, Cassandra, Flume, Oozie, Mahout, HBase

Confidential, San Jose, CA

Hadoop Developer

Responsibilities:

• Built a data flow pipeline using flume, java map reduce and pig.
• Used Flume to capture the streaming mobile sensor data and loaded it to HDFS.
• Used Java map reduce and Pig scripts to process the data and store the data on HDFS
• Used Hive scripts to compute aggregates and store them on Hbase for low latency applications.
• Analyze Cassandra database and compare it with other open-source NoSQL databases to find which one of them better suites the current requirement.
• Integrated Cassandra as a distributed persistent metadata store to provide metadata resolution for network entities on the network.
• Used Mahout CF algorithms for deploying recommendation algorithms.
• Involved in design and development phases of Software Development Life (SDLC) using scrum methodology.

Environment: JDK1.6, Red Hat Linux, Big Data, Hive, Pig, Sqoop, Flume, Zookeeper, DB2, HBase, Mahout and Cassandra.

Confidential, Houston, TX

Java/J2EE Developer

Responsibilities:

• Used Hibernate ORM tool as persistence Layer - using the database and configuration data to provide persistence services (and persistent objects) to the application.
• Responsible for developing DAO layer using Spring MVC and configuration XML’s for Hibernate and to also manage CRUD operations (insert, update, and delete).
• Implemented Dependency injection of spring framework.
• Develo0ped reusable services using BPEL to transfer data.
• Created JUnit test cases, and Development of JUnit classes.
• Configured log4j to enable/disable logging in application.
• Developed Rich user interface using HTML, JSP, AJAX, JSTL, Java Script, JQuery and CSS.
• Implemented PL/SQL queries, Procedures to perform data base operations.
• Wrote UNIX Shell scripts and used UNIX environment to deploy the EAR and read the logs.
• Implemented Log4j for logging purpose in the application.

Environment: Java, Jest, SOA Suite 10g (BPEL), Struts, Spring, Hibernate, Web services (JAX-WS), JMS, EJB, Web logic 10.1 Server, JDeveloper, Sql Developer, HTML, LDAP, Maven, XML, CSS, JavaScript, JSON, SQL, PL/SQL, Oracle, JUnit, CVS and UNIX/Linux.

Confidential

SQL Server Developer

Responsibilities:

• Created new database objects like Procedures, Functions, Packages, Triggers, Indexes and Views Using T-SQL in Development and Production environment for SQL Server.
• Developed Database Triggers to enforce Data integrity and additional Referential Integrity.
• Developed SQL Queries to fetch complex data from different tables in remote databases using joins, database links and formatted the results into reports and kept logs.
• Involved in performance tuning and monitoring of both T-SQL and PL/SQL blocks.
• Wrote T-SQL procedures to generate DML scripts that modified database objects dynamically based on user inputs.

Environment: SQL Server 7.0, Oracle 8i, Windows NT, C++, HTML, T-SQL, PL/SQL, SQL Loader.