OBJECTIVE:

To seek a challenging position in Big data and Data science field, with an opportunity for learning, growth and career advancement as successful achievements.

SUMMARY:

Having an overall 2.8 years of IT experience in software design and development with major focus in Big Data, Hadoop, Core Java/J2EE and Analytics. I am a Big Data Enthusiast and gradually delving into Data Science and Machine Learning on top of various technologies across the Hadoop stack. Worked on multiple projects including web application development, ingesting the data into analytics pipeline, providing both real time and batch analysis over Data across domains like Insurance, Media & Retail. Good programming knowledge in Object Oriented Programming Languages like Java. Self motivated and a constant learner. Having excellent communication and interpersonal skills. I am a Certified Cloudera Hadoop Developer (CCDH).I am also having an OCJP certification. I hold a masters in computer applications.

PROFILE:

• Worked on Big Data and Data Science related streams.
• Experienced in handling large scale data applications and performing analytics on them.
• Have the Experience in working in CDH4 and its configurations.
• Have the experience in monitoring and administering Cloudera Manager.
• Extensively used Hue for exploration, parsing and analysis and interacting with the cluster.
• Applied knowledge of Hadoop and its ecosystem (Flume,Sqoop,Hive,Hbase,Pig,MapReduce,Oozie) to design and develop Big Data solutions.
• Specialized in Big Data Analysis using python, spark and on their dependent libraries like numpy,pandas,sckit - learn,matplotlib,sparkSQL,Streaming and MLib.
• Dealt with text mining, click stream analysis and recommendation engine using pyspark based on various machine learning techniques like Regression,Classification,KNN,SVM,Naives Bayes etc.
• Worked with Hadoop file formats like Avro and Parquet
• Worked on unix and linux flavours.
• Worked across multiple domains like Insurance, Retail and Media.
• Involved in developing web applications using Java and related frameworks like Struts, Spring and Junit.
• Worked on Web and Application Servers like Apache tomcat, WebLogic
• Interacted with clients for requirement gathering; prepared functional specifications and developed applications based on the specs using Java and frameworks like struts and spring and also responsible for providing support and enhancement to the applications.
• Experience in both Waterfall model and Agile (Scrum) for software development.
• Possess good communication and interpersonal skills.
• Confident and enthusiastic with a zeal to learn new technologies and skills.

TECHNOLOGIES:

Operating Systems: Windows, Unix

Languages: Jdk 1.4/1.5/1.6/1.7 , JavaScript, SQL, Unix Shell(basics), Phython

Hadoop Distribution: Apache, CDH

Big Data Technologies: Apache Hadoop (MRv1, MRv2),Spark, Hive, Pig, Sqoop, HBase, Flume, Zookeeper, Oozie.

Web Technologies: HTML, JSP, CSS, JavaScript, JSON & AJAX

Server-side Frameworks: Struts 1.3, Hadoop,Spring

IDEs: Eclipse, NetBeans, IntellijIDE

Build Tools: Maven

Web Servers/App Servers: Apache Tomcat 6.0/7.0, WebLogic

Databases: Oracle 8i/9i/10g/11g, HDFS, HBASE, Hive

Reporting Tools: Tableau(preliminaries)

WORK EXPERIENCE:

Confidential

Tools: Used: Hadoop 2.3, Spark 1.5.6,Python 2.7, Cloudera v4.3,Hue,YARN,Ananconda,Ipython,Keppelin,Spark Libraries:SQL,Streaming,MLib.Visulisation:MatplotLib,Bokeh. Rest WS. Persistance: HBase

Responsibilties:

• Worked as a developer with the lead and the Architect to implement the solution.
• Worked in a cluster of 18 heterogeneous worker nodes and 1 master node across different geographies.
• Used the combination of python and spark to implement the POC.
• Used Rest Service to retrieve the feed.
• Preprocessed and transformed data using pyspark.
• Built the similarity model using Spark MLib implementing various machine learning techniques like KNN,K-means,SVM and decision trees.
• Used Hbase as the NO-SQL store.
• Used Spark SQL for exploration.
• Validation the model against the live feed using Spark Streaming.
• Visualizations using Matplotlib.

Confidential

Tools: Used: Hadoop v2,Flume,Sqoop,Avro,Hbase,Pig,Hive,Spark,python,oozie.

Responsibilties:

• To collect data from stations servers via Flume.
• Used Avro for source.
• Used interceptors for processing on the fly.
• Using Pig for parsing and metadata inference.
• Used Spark and python for processing the logs.
• Used Sqoop for Media markets records from MYSQL to HDFS which is referred to when validating stations and satalletite data for conficts.
• Used Hive for running batch reports.
• Used HBASE for storing keys for records for Local and National data which is looked up while determining the conflicts.
• Used Oozie for automation.

Confidential

Java Developer

Tools: used: Java 1.6, Struts 1.3, Spring 2.5, Eclipse Kepler, Oracle12c, Toad,Maven,Tortoise SVN, JSTL, JavaScript Apache Tomcat,Junit.

Responsibilities:

• Understanding the scope of the project and requirement gathering.
• Followed J2EE specifications in the project.
• Developed web tier using JSP & JSTL and Struts MVC.
• Developed web components using Struts and spring with some use of REST WS.
• Created and maintained the configurations of the Spring Applications Framework (IOC).
• Implemented various design patterns such as Singleton,Business Delegate,Value Object and Spring DAO.
• Created bean classes for communicating with database.
• Used Spring JDBC for Database connectivity.
• Involved in writing Spring Configuration XML files that contains declarations and other dependent objects declaration.
• Used Tomcat web server for development purposes.
• Used Oracle as Database and used Toad for queries execution.
• Write SQL scripts and PL/SQL code for procedures.
• Involved in creation of test cases and unit testing using Junit.