SUMMARY:

• 7+ years of experience in the Information Technology Industry with strong exposure to IT consulting, software project management, design, development, implementation, maintenance/support and Integration of software applications.
• 4 years of experience in Big Data processing using Apache Hadoop and its ecosystem.
• Expert in created PIG Latin Scripts and UDFs using JAVA for analysis of data efficiently.
• Expert in creating Hive Queries and UDFs using Java for analysis of data efficiently.
• Knowledge of HDFS, Map/Reduce, Pig, Hive, SQOOP, Spark, MapR, Cloudera's Hadoop distribution and also Horton Data Works distribution
• Expert in using SQOOP for fetching data from different systems and HDFS to analyze in HDFS, and again putting it back to the previous system for further processing.
• Also used HBase in accordance with PIG/Hive as and when required for real time low latency queries.
• Have working knowledge on Apache Storm and Kafka.
• Worked in Windows, UNIX/Linux platform with different technologies such as Big Data, SQL, Teradata, PL/SQL, XML, HTML, CSS, Java Script, Core Java, Python, Scala etc.
• Knowledge of creating Map Reduce codes in Java as per the business requirements.
• Good experience in Oozie Framework and Automating daily import jobs.
• Having working knowledge on Hadoop Administration.
• Good understanding of NoSQL Databases including MongoDb and HBase.
• Hands on work experience in writing application on No SQL database like Cassandra.
• Worked on ETL tools like Talend to simplify MapReduce jobs from the front end.
• Worked with Tableau for report creation and further analysis from the front end.
• Knowledge of Kerberos configuration in Hadoop.
• Extensive knowledge on RDBMS like Oracle SQL, Teradata.
• Good Knowledge of MySQL and administering it with MySQL workbench and XAMP installations.
• Experienced in design and implementation of applications using Java.
• Around 3 years of experience in Core Java programming with hands - on in Java Server Pages (JSP) framework, Springs, Hibernate and web technologies like HTML, JavaScript, CSS and XML.
• Strong knowledge of Software Development Life Cycle (SDLC).
• Experienced in provided training to team members as new per the project requirement.
• Working on development projects which include design, development and unit testing of applications.
• Experienced in creating Product Documentation & Presentations.
• Ability to effectively communicate with all levels of the organization such as technical, management and customers.
• Possess strong commitment to team environment dynamics with the ability to contribute expertise and follow leadership directives at appropriate times.
• Ability to perform at a high level, meet deadlines, adaptable to ever changing priorities.
• Adaptive in learning and working on various technologies.
• Excellent interpersonal skills, good experience in interacting with clients with good team player and problem solving skills.

TECHNICAL SKILLS:

Hadoop/Big Data Technologies: Hadoop, HDFS, MapReduce, HBase, Pig, Hive, SQOOP, Flume, Cloudera, Horton Data works, Oozie, Impala, Cassandra, Avro, Spark, Kafka, Storm and Zookeeper

Programming Languages: Java, C, C++

Scripting/Web Technologies: JavaScript, HTML, XML, Python, Scala, Shell Scripting and CSS

ETL/BI Tools: Pentaho, SAS Enterprise Miner, Rapid Miner, Tableau and Weka

Databases: Oracle 9i/10g/11g, MySQL, Microsoft SQL Server 2008, MongoDB,Teardata, NoSQL

Operating Systems: Linux, Unix and Windows

Java IDE: Eclipse and NetBeans

Additional Skills: Data mining and Business Intelligence Algorithms, Talend, Tableau & R

PROFESSIONAL EXPERIENCE:

Confidential, Woodlands, TX

Senior Hadoop developer

Responsibilities:

• Experience in installing, configuring and using Hadoop Ecosystem components.
• Experience in Importing and exporting data into HDFS and Hive using SQOOP.
• Experienced in executing SQL queries using Spark SQL.
• Experienced in configuring Kerberos for Hadoop clusters.
• Participated in development/implementation of Cloudera Hadoop environment.
• Load and transform large sets of structured, semi structured and unstructured data.
• Experience in working with various kinds of data sources such as Oracle.
• Successfully loaded files to Hive and HDFS from Oracle.
• Responsible for managing data coming from different sources.
• Worked with different APIs of spark including Spark streaming
• Used spark for different data preprocessing using different transformations.
• Involved in writing SQL statements on Hadoop using Impala.
• Performed churn data analytics using spark and Kafka.
• Involved in creating Hive tables, loading with data and writing hive queries.
• Involved in writing Oozie workflows and executing jobs.
• Exported the analyzed data to the relational databases using SQOOP.
• Handled importing data from various data sources, performed transformations using Hive, Map Reduce, and loaded data into HDFS. Had to use Teradata to retrieve and dump data using Flume.
• Developed and Deployed applications using Apache Spark, Scala.
• Approaching HDFS with Apache Sentry and granting access for privileged SQL data.
• Worked on spark and Kafka tools to stream Real time data. And also, performed operations on Statistical analysis.
• Well acquainted with Kerberos and Talend.
• We performed transformations in the Raw layer and store the final transform data in the Parquet format.
• Actively participate in various internal meet / sessions with other project team members to understand the requirements and suggest suitable Hadoop Stack Technologies along with training sessions.

Environment: CDH 5.x, Hadoop, Map Reduce, Impala, Hive, Pig Latin, Java, SQL, SQOOP, Centos, NOSQL database, Storm, Kafka, Teradata.

Senior Hadoop Developer

Responsibilities:

• Involved in architecture design, development and implementation of Hadoop deployment, backup and recovery systems.
• Developed and Supported Map Reduce Programs those are running on the cluster.
• Gathered the business requirements from the Business Partners and Subject Matter Experts.
• Created Hive tables and working on them using HQL.
• Involved in installing Hadoop Ecosystem components.
• Worked on the proof-of-concept for Apache Hadoop framework initiation on Web Services.
• Responsible to manage data coming from different sources in HDFS like cloudera and Horton Data works.
• Supporting HBase Architecture Design with the Hadoop Architect team to develop a Database Design in HDFS.
• Worked on cluster manager like YARN using Apache Spark.
• Involved in HDFS maintenance and loading of structured and unstructured data.
• Wrote MapReduce jobs using Java API.
• Wrote Hive queries for data analysis to meet the business requirements, trained and guided the team on Hadoop framework, HDFS, MapReduce concepts.
• Developed MapReduce jobs for Log Analysis, Recommendation and Analytics.
• Implemented Spark POC operations to mimic Hadoop ETL.
• Wrote MapReduce jobs to generate reports for the number of activities created on a particular day, during a dumped from the multiple sources and the output was written back to HDFS.
• Installed and configured Hadoop HDFS like cloudera and Horton Dataworks Platform and implemented MapReduce, Pig, Hive, SQOOP functionalities on them.
• Wrote Pig Scripts to generate MapReduce jobs and performed ETL procedures on the data in HDFS.
• Processed HDFS data and created external tables using Hive, in order to analyze visitors per day, page views and most purchased products.
• Exported analyzed data to HDFS using SQOOP and Flume from RDBMS like MySQL and Teradata.
• Used spark for analyzing log files and stream processing.
• Used MapReduce and SQOOP to load, aggregate, store and analyze web log data from different web servers.
• Developed Hive queries for the analysts and I have written scripts using Scala.
• Cluster co-ordination services through Zookeeper.
• Experience in optimization of Map reduce algorithm using combiners and partitions to deliver the best results and worked on Application performance optimization for a HDFS/Cassandra cluster.

Environment: CDH 4.x, Map Reduce, AWS, EMR, S3, EC2, Hive, Pig, SQOOP, Oracle, MapR, Cloudera Manager, ZooKeeper. Impala.

Hadoop Developer

Responsibilities:

• Responsible for creating Hive tables, loading data and writing hive queries.
• Developed MapReduce Programs to research the HDFS data and moved them into Flat Files in Linux.
• Load and transform large sets of structured, semi structured and unstructured data.
• Supported Map Reduce Programs those are running on the cluster.
• Developed HQL scripts to manipulate the data in HDFS.
• Worked on the HBase architecture design for the Loan Volumes in HDFS.
• Installed and configured Hive and also written Hive UDFs.
• Involved in creating Hive tables, loading with data and writing hive queries which will run internally in Map Reduce way. Developed scripts to run jobs, using Scala.
• Used to write custom UDF's in Hive and Pig. Used scripts written in Scala for performing MR Operations.
• Responsible for maintaining and analysis of scalable distributed data solutions using Hadoop.
• Responsible for Cluster maintenance, adding and removing cluster nodes, Cluster Monitoring and Troubleshooting, Manage and review data backups and log files.
• Analyzed data using Hadoop components Hive and Pig.
• Responsible for running Hadoop streaming jobs to process terabytes of xml's data.
• Load and transform large sets of structured, semi structured and unstructured data using Hadoop/Big Data concepts.
• Handled importing data from various data sources, performed transformations using Hive, Map Reduce, and loaded data into HDFS.
• Imported and exported the data using SQOOP.
• Experienced in data Migration using Informatica.
• Installed Oozie workflow engine to run multiple Hive and Pig jobs, which run independently with time and data availability.

Environment: Apache Hadoop, Java (JDK 1.6), Oracle, My SQL, SQOOP, Linux Hive, Pig.

Hadoop Developer

Responsibilities:

• Responsible for building distributed data solutions using Hadoop.
• Implemented nine nodes CDH3 Hadoop cluster on Red hat LINUX.
• Involved in loading data from Oracle database into HDFS using SQOOP queries.
• Implemented Map reduces programs to get Top K Results using Map Reduce programs by fallowing Map Reduce Design Patterns. Implemented framework using Scala, and sometimes Python
• Involved in loading the created HFiles into HBase for faster access of large customer base without taking Performance hit.
• Implemented working with different sources using Multi Input formats using Generic and Object Writable.
• Implemented best income logic using Pig scripts and Joins to transform data to AutoZone custom formats.
• Implemented custom comparators and partioners to implement Secondary Sorting.
• Worked on tuning the performance of Hive queries.
• Implemented Hive Generic UDF's to implement business logic.
• Responsible to manage data coming from different sources.
• Configured Time Based Schedulers that get data from multiple sources parallel using Oozie work flows.
• Installed Oozie workflow engine to run multiple Hive and pig jobs.
• Used Zookeeper for providing coordinating services to the cluster.
• Coordinated with end users for designing and implementation of analytics solutions for User Based Recommendations using R as per project proposals.
• Assisted monitoring Hadoop cluster using Gangila.
• Performed few RDBMS operations using Informatica.
• Implemented test scripts to support test driven development and continuous integration.
• Configured build scripts for multi module projects with Maven and Jenkins CI.
• Involved in story-driven agile development methodology and actively participated in daily scrum meetings.

Environment: Hadoop, Map Reduce, HDFS, Pig, Hive, Oozie, Java, Linux, Maven, Oracle 11g/10g, Zookeeper, SVN, Gangila

Java Developer

Responsibilities:

• Develop of dynamic Web Pages using JSP.
• Develop control components and model components using java, servlets.
• Design scalable, extensible system using the J2EE (Java 2 Enterprise Edition) framework architecture.
• Designed and developed the action form beans and action classes and implemented MVC using different frameworks.
• Install, configure and administer Web Logic Application Server and deploy JSP, Servlets and EJB applications.
• Development and testing of the Java classes to be used in JSP and Servlets.
• Also, developed different modules using Hibernate and Spring Frameworks.
• Developed user interfaces using JSP, HTML.
• Experienced in working with different APIs and Web Service Clients.

Environment: Java, JSP, Tiles, Hibernate, Servlets, Web Sphere 5.1, Oracle, EJB, Ant, Eclipse

Java Developer

Responsibilities:

• Involved in the analysis, design, implementation, and testing of the project.
• Implemented the presentation layer with HTML, XHTML and JavaScript
• Involving in creation object model to relational using hibernate.
• Developed web components using JSP, JDBC.
• Later designed modules using Spring Framework.
• Implemented database using SQL Server.
• Designed tables and indexes.
• Wrote complex SQL queries.
• Involved in fixing bugs and unit testing with test cases using JUnit.
• Developed user and technical documentation.
• Worked as Java/J2EE developer in development of PNR and Electronic Ticket Archival system.
• Troubleshoot various GDS, Interline and Codeshare partner cutovers.
• Coding & Bug fixing.

Environment: Unisys Mainframe, Java, Spring, SQL, Accessory Manager, Eclipse, Oracle 8G, Apache Tomcat.