SUMMARY

• 11 years of experience in teh field of IT including four years of experience in Hadoop ecosytem and four years of experience as a Java developer with good object oriented programming skills.
• Expertise in design, development and Testing of various web and enterprise applications using Type safe technologies like Scala, Akka, Play framework, Slick.
• Experienced in using Scala, Java tools like Intelli J, Eclipse.
• Good noledge of Hadoop Architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node, MapReduce concepts responsible for writing MapReduce programs and setting up standards and processes for Hadoop - based application design and implementation.
• Expertise with different tools in Hadoop Environment including Pig, Hive, HDFS, MapReduce, Sqoop, Spark, Kafka, Yarn, Oozie, and Zookeeper.
• Extensive work in ETL process consisting of data transformation, data sourcing, mapping, conversion and loading using Informatica.
• Expertise in developing data driven applications usingPython2.7,Python3.0 on Pycharm and Anaconda Spyder IDE's.
• Hands on experience in configuring and working with Flume to load teh data from multiple sources directly into HDFS.
• Expertise in MapReduce programs in HIVE and PIG to validate and cleanse teh data in HDFS, obtained from heterogeneous data sources, to make it suitable for analysis.
• Analyzed or transformed stored data by writing MapReduce jobs based on business requirements.
• Experienced in coding Web Services with JAX-WS (SOAP) and JAX-RS (Restful).
• Experience in developing Pig scripts and Hive Query Language.
• Managing and scheduling batch Jobs on a Hadoop Cluster using Oozie.
• Hands on experience working with NoSQL database including MongoDB and HBase.
• Experience in optimizing MapReduce jobs to use HDFS efficiently by using various compression mechanisms.
• Experience in developing Pig Latin scripts to extract teh data from teh web server output files to load into HDFS.
• Hands on experience in using Sqoop to import data into HDFS from RDBMS and vice-versa.
• Hands on experience in application development using Java, RDBMS, and Linux shell scripting.
• Expertise in Web technologies using Core Java, J2EE, Servlets, EJB, JSP, JDBC, Java Beans, Apache, and Design Patterns.
• Detailed understanding of Software Development Life Cycle (SDLC) and sound noledge of project implementation methodologies including Waterfall and Agile.
• Ability to adapt to evolving technology, a strong sense of responsibility and accomplishment. Willing to relocate: Anywhere.

TECHNICAL SKILLS

Operating Systems: Windows 8/7/XP, Unix, Ubuntu 13.X, Mac OSX

Hadoop Eco System: Hadoop 1.x/2.x(Yarn), HDFS, Map Reduce, Mongo, HBase, Hive, Impala, PIG, Zookeeper, Sqoop, Oozie, Flume, Storm, HDP, AWS, Eclipse, Cloudera-desktop and SVN.

Java Tools: Java, Map Reduce, J2EE (JSP, Servlets, EJB, JDBC, JMS, JNDI, RMI), Struts, Hibernate, AJAX, XSLT, HTML, JavaScript, CSS, JUnit, JAVA, JSP, JSON, J2EE, Web Services, DHTML, Javascript, DOM, SAX, Jquery, XML, XSLT.

API’s: Servlets, EJB, Java Naming, and Directory Interface(JNDI), MapReduce, RESTful.

Development Tools: Eclipse, RAD/RSA (Rational Software Architect), IBM DB2 Command Editor, SQL Developer, Microsoft Suite (Word, Excel, PowerPoint, Access), Open Office Suite (Editor, Calc etc..), VM Ware.

Languages: Scala, Java, Java EE, JSP, Python

No SQL Databases: HBase, Cassandra, Monod

Servers: Web sphere (WAS) 6.x/7.0, Web Logic 10-12c, Apache.

PROFESSIONAL EXPERIENCE

Confidential - Minneapolis MN

Sr. Java/Hadoop/Python Developer

Responsibilities:

• Responsible for developing efficient MapReduce on AWS cloud programs for more than 20 years' worth of claim data to detect and separate fraudulent claims.
• Worked with teh advanced analytics team to design fraud detection algorithms and then developed MapReduce programs to efficiently run teh algorithm on teh huge datasets.
• Ran data formatting scripts inpythonand created terabyte csv files to be consumed byHadoop MapReduce jobs.
• Performed Kafka analysis, feature selection, feature extraction using Apache Spark Machine Learning streaming libraries inPython.
• Developed Python code usingversioncontroltools likeGIThub and SVN on vagrant machines.
• Created Hive tables to store data into HDFS, loading data and writing hive queries that will run internally in map-reduce way.
• Involved in building teh ETL architecture and Source to Target mapping to load data into Data warehouse.
• Uploaded and processed terabytes of data from various structured and unstructured sources into HDFS (AWS cloud) using Sqoop and Flume.
• Involved in Cluster coordination services through Zookeeper.
• Exported teh analyzed data to teh relational databases using Sqoop for visualization and to generate reports for teh BI team.
• Played a key role in installation and configuration of teh various Hadoop ecosystem tools such as Solr, Pig, HBase and Cassandra.
• Developed an information pipeline utilizing Kafka and Storm to store data into HDFS.
• Loading spilling data using Kafka, Flume and real time Using Spark and Storm.
• Implemented various hive optimization techniques like Dynamic Partitions, Buckets, Map Joins, Parallel executions in Hive.
• Worked with Pre-Session and Post-Session Linux scripts for automation of ETL jobs and to perform operations like gunzip, remove and archive files.
• CreatedTalendjobs to copy teh files from one server to another and utilizedTalendFTP components.
• Created Joblets and Parent child jobs inTalend.
• Designed & Developed teh ETL Jobs usingTalendIntegration Suite by using various transformations as per teh business requirements and based on ETL Mapping Specifications.
• Extracted meaningful data from dealer csv files, text files, and mainframe files and generatedPythonpanda's reports for data analysis.
• UtilizedPythonto run scripts, generate tables, and reports.
• Coordinates withAgileteamto effectively meet all Confidential commitments.
• Designed and Maintained Oozie workflows to manage teh flow of jobs in teh cluster.
• Parse Json files through Spark core to extract schema for teh production data using SparkSQL and Scala.
• Actively updated teh upper management with daily updates on teh progress of project that include teh classification levels that were achieved on teh data.

Environment: Java, J2EE, Hadoop, HDFS, Pig, Nifi, Hive, MapReduce, Sqoop, Kafka, CDH3, Cassandra, Python, Oozie, collection, Scala, AWS cloud, storm, AbInitio, Apache, SQL, NoSQL, Bitbucket, HBase, Flume, spark, Solr, Zookeeper, ETL, Talend, Centos, Eclipse, Agile.

Confidential - Overland Park, KS

Java/Hadoop Developer

Responsibilities:

• Involved in making Hive tables, stacking teh information and composing Hive queries that will run inside in MapReduce.
• Involved in converting Hive/SQL queries into Spark transformations using Spark RDDs,Pythonand Scala.
• WrotePythonmodules to view and connect teh Apache Cassandra instance
• Involved in writing MapReduce jobs.
• DevelopedRESTfulweb services interface to Java-based runtime engine and accounts.
• CustomizedRESTfulWeb Service using SpringRESTfulAPI, sending JSON format data packets between front-end and middle-tier controller.
• Real-time streaming teh information utilizing Spark with Kafka.
• Responsible for creating information pipeline utilizing flume, Sqoop, and pig to remove teh information from weblogs and store in HDFS.
• Involved in emitting processed information from Hadoop to relational databases or external frameworks utilizing Sqoop, HDFS GET or CopyToLocal.
• Developed data pipeline utilizing Flume, Sqoop, Pig and Java MapReduce to ingest client behavioral information and money related histories into HDFS for analysis.
• Experienced in managing and assessing Hadoop log records.
• Used Pig to do changes like event joins, filter boot traffic and some pre-aggregations before storing teh information onto HDFS.
• Written Hive inquiries for data to meet teh business requirements.
• Importing and sending out information into HDFS and Hive utilizing Sqoop and Kafka.
• Created various Parser programs to extract data from Autosys, Tibco Business Objects, XML, Informatica, Java, and database views usingScala.
• Involved in creating Hive Tables, loading with data and writing Hive queries which will invoke and run MapReduce jobs in teh backend.
• Implemented teh workflows using Apache Oozie framework to automate tasks.
• Developed scripts and automated data management from end to end and sync up between all teh clusters.

Environment: Java, Hadoop, Scala, MapReduce, MongoDB, SQL, Apache, Yarn, Hive, Pig, HBase, Oozie, Sqoop, Flume, Core Java, HDP, HDFS, Eclipse, Kafka.

Confidential, Boston, MA

Software Engineer

Responsibilities:

• Installed and configured Hadoop MapReduce, HDFS, Developed multiple MapReduce jobs in java for data cleaning and preprocessing.
• Involved in installing and updating and managing Environment.
• Collecting and aggregating large amounts of log data using Apache Flume and staging data in HDFS for further analysis.
• Involved in running Hadoop streaming jobs to process terabytes of XML format data.
• Participated in requirement gathering and analysis phase of teh project in documenting teh business requirements by conducting workshops/meetings with various business users.
• Involved in Sqoop, HDFS Put or CopyFromLocal to ingest data.
• Used Hive to analyze teh partitioned and bucketed data and compute various metrics for reporting.
• Created and maintained technical documentation for launching Hadoop clusters and for executing Hive queries and Pig Scripts.
• Implemented test scripts to support test-driven development and continuous integration.
• Implemented SQL, PL/SQL Stored Procedures.
• Involved in developing Shell scripts to orchestrate teh execution of all other scripts (Pig, Hive, and MapReduce) and move teh data files within and outside of HDFS.
• Involved in developing Hive UDFs for teh needed functionality that is not out of teh box available from Apache Hive.
• Actively updated teh upper management with daily updates on teh progress of a project that include teh classification levels that were achieved on teh data.

Environment: Core Java, J2ee, Hadoop, MapReduce, NoSQL, Hive, Pig, Sqoop,, Apache, HDP, HDFS, Eclipse.

Confidential -New York, NY

Java Developer

Responsibilities:

• Involved in Analysis, design, and coding on J2EE Environment.
• Implemented MVC architecture using Struts, JSP, and EJB's.
• Used Core Java concepts in an application such as multithreaded programming, synchronization of threads used thread to wait, notify, join methods etc.
• Presentation layer design and programming on HTML, XML, XSL, JSP, JSTL and Ajax.
• Creating cross-browser compatible and standards-compliant CSS-based page layouts.
• Worked on Hibernate object/relational mapping related to teh database schema.
• Designed, developed and implemented teh business logic required for Security presentation controller.
• Used JSP, Servlet coding under J2EE Environment.
• Good Experience in software configuration management using CVS,GITand SVN.
• Designed XML files to implement most of teh wiring need for Hibernate annotations and Struts configurations.
• Responsible for developing teh forms, which contains teh details of teh employees, and generating teh reports and bills.
• Developed Web Services for data transfer from client to server and vice versa using Apache Axis, SOAP, and WSDL.
• Involved in designing of class and data flow diagrams using UML Rational Rose.
• Created and modified Stored Procedures, Functions, Triggers and Complex SQL Commands using PL/SQL.
• Involved in teh Design of ERD (Entity Relationship Diagrams) for teh Relational database.
• Developed Shell scripts in UNIX and procedures using SQL and PL/SQL to process teh data from teh input file and load into teh database.
• Used CVS for maintaining teh Source Code Designed, developed and deployed on WebLogic Server.
• Performed Unit Testing on teh applications that are developed.

Environment: Java (JDK 1.6), J2EE, JSP, Servlet, Hibernate, JavaScript, JDBC, Oracle 10g, UML, Rational Rose, SOAP, Web Logic Server, JUnit, PL/SQL, CSS, HTML, XML, Eclipse, CVS, GIT, SVN.

Confidential

Java Developer

Responsibilities:

• Worked on both WebLogic Portal 9.2 for Portal development and WebLogic 8.1 for Data Services Programming. Developed teh presentation layer using JSP, HTML, CSS and client validations using JavaScript.
• Developed user interface using JSP, Struts Tag Libraries to simplify teh complexities of teh application.
• Developed business logic using Stateless session beans for calculating asset depreciation on Straight line and written down value approaches.
• Database Modification using SQL, PL/SQL, Stored procedures, triggers, Views in Oracle.
• Created java classes to communicate with teh database using JDBC.
• Responsible for design and implementation of various modules of teh application using Struts-Spring-Hibernate architecture.
• Developed teh Web Interface using Servlets, Java Server Pages, HTML, and CSS.
• Extensively used teh JDBC Prepared Statement to embed teh SQL queries into teh java code.
• Developed DAO (Data Access Objects) using Spring Framework 3.
• Developed Web applications with Rich Internet applications using Java applets, Silverlight, Java.
• Deployed dis application, which uses J2EE architecture model and Struts Framework first on WebLogic and halped in migrating to JBoss Application server.
• Used JavaScript to perform client-side validations and Struts-Validator Framework for server-side validation.
• Designed and developed teh application using various design patterns, such as session facade, business delegate and service locator.
• Involved in designing use-case diagrams, class diagrams, interaction using UML model with Rational Rose.

Environment: Java, Servlets, JSP, EJB, J2EE, STRUTS, XML, XSLT, JavaScript, HTML, CSS, Spring 3.2, SQL, PL/SQL, MS Visio, Eclipse, JDBC, Windows XP, WebLogic portal, JBoss.