SUMMARY:

• 8+ years of professional experience in designing, developing, debugging Web - based as well as Enterprise applications using OOA, OOD, OOPS and JAVA/J2EE technologies.
• Over 4 years of experience in the Hadoop ecosystem components like Hadoop MapReduce, Cloudera, Hortonworks, HBase, Oozie, Hive, Sqoop, Pig, Flume, Yarn, Impala, and Cassandra.
• Experience in Hadoop architecture and various components such as HDFS, Job Tracker, Task Tracker, NameNode, Data Node and MapReduce programming paradigm.
• Experience in converting MapReduce applications to Spark.
• Extensive experience in developing PIG Latin Scripts and using Hive Query Language for data analytics.
• Good working experience using Sqoop to import data into HDFS from various RDBMS and vice versa.
• Experience in analyzing data using HIVEQL and Pig Latin and custom MapReduce programs in Java
• Working knowledge of Software Design Patterns, Big Data Technologies (Hadoop, Hortonworks Sandbox) and Cloud Technologies & design
• Familiarity with Hadoop architecture and its components like HDFS, MapReduce, Job Tracker, Task Tracker, Name Node and Data Node
• Knowledge on handling Hive queries using spark SQL that integrate with spark environment implemented in Scala.
• Knowledge in Hadoop And Sub-Modules; HDFS, MapReduce, Apache Pig, Hive, HBase And Sqoop
• Experience with NoSQL databases like CouchDB, MongoDB.
• Good experience in job scheduling and monitoring tools like Oozie and ZooKeeper.
• Experience in Hadoop administration activities such as installation and configuration of clusters using Apache and Cloudera.
• Experienced in using Agile software methodology (Scrum).
• Experience in developing distributed Enterprise and Web applications using UML, Java/J2EE, Web technologies that include EJB, JSP, Servlets, Struts, JMS, JDBC, JPA HTML, XML, XSL, XSLT, Java Script, Spring and Hibernate.
• Expertise in using J2EE Application Servers like Web Logic 8.1/9.2, IBM Web Sphere 7.x/6.x and Web Servers like Tomcat 5.x/6.x
• Designed Use Case diagrams, Class diagrams, Activity diagram, Sequence diagrams, Flow Charts, and deployment diagrams using Rational Rose Tool.
• Proficient in writing and handling SQL Queries, Stored Procedures, and triggers.
• Knowledge of different operating systems including Linux, Windows and UNIX Shell Script.

SKILL SET:

Big Data Eco System: HDFS, MapReduce, Hadoop Streaming, ZooKeeper, Oozie, Sqoop,Hive, Pig, HBase, Spark, Cloudera CDH 3/4/5, Flume.

NoSQL: HBase, Cassandra, MongoDB

Languages: Java/ J2EE, SQL, Shell Scripting, Python

Web Technologies: HTML, JavaScript, CSS, XML, Servlets, SOAP.

Web/ Application Server: Apache Tomcat Server, LDAP, JBOSS, IIS

Operating system: Windows, Linux and Unix

Frameworks: Springs, MVC, Hibernate, Swings

DBMS / RDBMS: Oracle 11g/10g/9i, SQL Server 2012/2008, MySQL

Version Control: SVN, CVS and Rational Clear Case Remote Client

PROFESSIONAL EXPERIENCE:

Confidential, Bellevue, WA

Sr Hadoop Admin / Developer

Responsibilities:

• Installed, Configured and Maintained Hadoop clusters for application development and Hadoop tools like Hive, Pig, Hbase, Zookeeper and Sqoop.
• Worked on migrating MapReduce programs into Spark transformations using Spark and Scala.
• Developed Oozie Workflows for daily incremental loads, which gets data from Teradata and then imported into hive tables.
• Experience in Upgrading hadoop cluster Hbase/zookeeper from CDH3 to CDH4.
• Developed bash scripts to bring the Tlog files from ftp server and then processing it to load into hive tables.
• Used Flume to handle streaming data and loaded the data into Hadoop cluster
• All the bash scripts are scheduled using Resource Manager Scheduler.
• Developed complex queries using HIVE and IMPALA.
• Moved data from HDFS to Cassandra using MapReduce and BulkOutputFormat class
• Loading the data from the different Data sources like (Teradata and DB2) into HDFS using sqoop and load into Hive tables, which are partitioned.
• Developed pig scripts to transform the data into structured format and it are automated through Oozie coordinators.
• Developed MapReduce programs for applying business rules on the data.
• Implemented the workflows using Apache Oozie framework to automate tasks.
• Developed and executed hive queries for denormalizing the data.
• Developed the Apache Storm, Kafka, and HDFS integration project to do a real-time data analyses.
• Responsible for executing hive queries using Hive Command Line, Web GUI HUE and Impala to read, write and query the data into HBase.
• Involved in joining and data aggregation using Apache Crunch
• Continuously monitored and managed the Hadoop Cluster using Cloudera Manager.
• Worked on analyzing data with Hive and Pig.
• Written multiple MapReduce programs in Java for data extraction, transformation and aggregation from multiple file formats including XML, JSON, CSV and other compressed file formats
• Worked with NoSQL databases like Hbase in creating Hbase tables to load large sets of semi structured data coming from various sources.
• Supported Data Analysts in running MapReduce Programs.
• Developed MapReduce ETL in Java and Pig.
• Worked on importing and exporting data into HDFS and Hive using Sqoop.
• Manage the day-to-day operations of the cluster for backup and support
• Imported and Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team.
• Developed Hive queries for Analysis across different banners.
• Developed Spark scripts by using Scala shell commands as per the requirement.
• Worked with Kafka for the proof of concept for carrying out log processing on a distributed system
• Involved in writing, testing, and running MapReduce pipelines using Apache Crunch
• Developed Hive UDF’s to bring all the customers email id into a structured format.
• Experience in setting up Hadoop clusters on cloud platforms like AWS.
• Responsible for building scalable distributed data solutions using Hadoop cluster environment with Hortonworks distribution

Environment: Apache Hadoop, HBase, Hive, Pig, Sqoop, ZooKeeper, Hortonworks, NoSQL, HBase, Storm, MapReduce, Cloudera, HDFS, Scala, Impala, Flume, MySQL, JDK1.6, J2ee, JDBC, Servlets, JSP, Struts 2.0, Spring 2.0, Hibernate, Python, WebLogic, SOAP, MongoDB, Spark.

Confidential, San Jose CA

Sr Hadoop Developer / Admin

Responsibilities:

• Worked with NoSQL databases like Hbase in creating Hbase tables to load large sets of semi structured data coming from various sources. Importing and exporting data into HDFS and Hive using SQOOP.
• Written Hive jobs to parse the logs and structure them in tabular format to facilitate effective querying on the log data.
• Involved in creating Hive Tables, loading data and writing Hive queries.
• Utilized Apache Hadoop environment by Cloudera.
• Created Data model for Hive tables.
• Coordinated with business customers to gather business requirements. And also interact with other technical peers to derive Technical requirements and delivered the BRD and TDD documents.
• Worked on analyzing Hadoop cluster and different Big Data analytic tools including Pig, Hive HBase database and SQOOP.
• Designed and Modified Database tables and used HBASE Queries to insert and fetch data from tables.
• Involved in creating Hive tables, loading with data and writing hive queries that will run internally in MapReduce way. Implemented six nodes CDH4 Hadoop Cluster on CentOS
• Installed Hadoop, MapReduce, HDFS, and Developed multiple MapReduce jobs in PIG and Hive for data cleaning and pre-processing. Extensively involved in Design phase and delivered Design documents.
• Involved in Testing and coordination with business in User testing.
• Responsible to manage data coming from different sources.
• Involved in creating Hive Tables, loading data and writing Hive queries.
• Utilized Apache Hadoop environment by Cloudera.
• Created Data model for Hive tables.
• Populated HDFS and Cassandra with huge amounts of data using Apache Kafka.
• Proficient in designing Row keys and Schema Design for NoSQL Database, Hbase and knowledge of other NOSQL database Cassandra.
• Responsible for importing log files from various sources into HDFS using Flume.
• Monitored and managed Hadoop cluster using the Cloudera Manager web- interface.
• Used Hive to analyze the partitioned and bucketed data and compute various metrics for reporting.
• Experienced in managing and reviewing the Hadoop log files.
• Designing ETL Data Pipeline flow to ingest the data from RDBMS source to Hadoop using shell script, sqoop, package and mysql.
• Used Impala to read, write and query the Hadoop data in HDFS from HBase or Cassandra and configured Kafka to read and write messages from external programs.
• Used Pig as ETL tool to do Transformations, even joins and some pre-aggregations before storing the data onto HDFS.
• Experienced in using Zookeeper and OOZIE Operational Services for coordinating the cluster and scheduling workflows. Involved in Unit testing and delivered Unit test plans and results documents.
• Exported data from HDFS environment into RDBMS using Sqoop for report generation and visualization purpose. Worked on Oozie workflow engine for job scheduling.
• Experience in using Pentaho Data Integration tool for data integration, OLAP analysis and ETL process
• Responsible to manage data coming from different sources.

Environment: CDH4 with Hadoop, HDFS, Pig, Cloudera, Hive, Hbase, Zookeeper, MapReduce, Java, Sqoop, Oozie, Hortonworks, Storm, Impala, ETL, CSS, Ambari, NoSQL, AWS (Amazon Web services), Linux, UNIX Shell Scripting and Big Data.

Confidential, Westlake OH

Hadoop Developer

Responsibilities:

• Responsible for building scalable distributed data solutions using Hadoop.
• Responsible for running Hadoop streaming jobs to process terabytes of xml's data.
• Load and transform large sets of structured, semi structured and unstructured data using Hadoop/Big Data concepts.
• Handled importing data from various data sources, performed transformations using Hive, MapReduce, and loaded data into HDFS.
• Extracted the data from Teradata into HDFS using the Sqoop.
• Exported the patterns analyzed back to Teradata using Sqoop. data to the relational databases using Sqoop for visualization and to generate reports by our BI team.
• Integrated Oozie with the rest of the Hadoop stack supporting several types of Hadoop jobs out of the box (such as MapReduce, Pig, Hive, and Sqoop) as well as system specific jobs (such as Java programs and shell scripts).
• Involved in loading data from UNIX file system to HDFS.
• Installed Oozie workflow engine to run multiple Hive and Pig jobs which run independently with time and data availability
• Responsible for Cluster maintenance, adding and removing cluster nodes, Cluster Monitoring and Troubleshooting, Manage and review data backups and log files.
• Analyzed data using Hadoop components Hive and Pig.
• Responsible for creating Hive tables, loading data and writing hive queries.
• Analyzed the web log data using the HiveQL to extract number of unique visitors per day, page views, visit duration, most purchased product on website.
• Experienced in developing applications in Hadoop Impala, Hive, Sqoop, Oozie, Java MapReduce, SparkSQL, HDFS, Pig and TEZ.
• Exported the analyzed

Environment: Hadoop Cluster, HDFS, Hive, Pig, Sqoop, Linux, Hadoop MapReduce, HBase, Shell Scripting. Linux, UNIX Shell Scripting and Big Data.

Confidential

Sr. Software Developer

Responsibilities:

• Created a front-end application using JSPs and Spring MVC for registering a new transaction and configured it to connect to database Production.
• Developed, enhanced and tested of the Web Methods flow services and Java services.
• Used WebServices for interaction between various components and created SOAP envelopes.
• Created web service XML connectors for use within a flow service
• Developed and provided support to many components of this application from end-to-end, i.e. Front-end (View) to Web Methods and Database.
• Provided solutions for bug fixes in this application.
• Developed queries & triggers in the database
• Used Spring Security for Authorization of users and implemented Spring WebServices.
• Developed and configured Microsoft SQL Server 2008 tables including Sequences, Functions, Procedures and Table constraints.
• Created standalone Java application to read data from several XLS files and insert data into the Database as needed by the Testing team.
• Ant Build tool configuration for automation of building processes for all types of environment - Test, QA, and
• Used Tortoise SVN as a version-controlling tool for managing the module developments.

Environment: Java 1.5, spring 2.5, Spring WebServices, Spring Security, Web logic, Hibernate 3.0, SQL Server 2008, Eclipse, Apache Ant.

Confidential

Java Developer

Responsibilities:

• Designed, developed and enhanced back-end system using J2EE and Database technologies for Subscriber Sales and Marketing operations.
• Involved in designing & developing web-services using REST.
• Involved in database design.
• Created tables, stored procedures in SQL for data manipulation and retrieval, Database Modification using SQL, PL/SQL, Stored procedures, triggers, Views in Oracle 9i.
• Reviewed and managed Entity Relationship Diagram, Entity Beans, and Spring declarative transaction models
• Wrote and optimized SQL queries using Oracle Hints and created supportive stored procedures using PLSQL, Triggers and Cursors
• Designed and developed
• Experienced in using Spring Beans, DAO, Controller and Service layers for fast and efficient processing for retail store sales processing
• Worked with Spring Dependency Injection (DI), Annotations, AOP and advanced multi-threaded application request processing
• WebServices using Axis, and associated business modules integration for B2B partner application interfaces
• Implemented persistence application layer using Hibernate, HQL, Criteria, Annotations, and Object Relational Model (ORM) model.
• Worked on cross-domain application technology based on Web 2.0 and current Bell platform RESTful API
• Worked in advanced requirements analysis (BAs), rapid application creation and deployment teams.
• Analyzed complex data call flows, transaction management and application data traffic models.

Environment: Java, JSP, spring, Hibernate, JavaScript, HQL Struts, Servlets, Axis, Eclipse, Ant, JDBC, WebServices, Web logic 8.1, Oracle 9i, SQL Plus.