PROFESSIONAL SUMMARY:

• Professional experience of 8 years in the field of IT including 4+ years of Big Data Ecosystem related technologies.
• Experience in installation, configuration, management and deployment of Big Data solutions and the underlying infrastructure of Hadoop Cluster.
• Good understanding/knowledge of Hadoop Architecture.
• Hands on experience on major components in Hadoop Ecosystem including Hive, HBase, HBase - Hive Integration, PIG, Sqoop, Flume, Spark and knowledge of Mapper/Reduce/HDFS Frame work.
• Experience in importing data to HDFS through Flume.
• Set up standards and processes for Hadoop based application design and implementation.
• Experience in analyzing data using HIVEQL, PIG Latin and custom Map Reduce programs in JAVA. Extending HIVE and PIG core functionality by using custom UDF’s.
• Good experience in analysis using PIG and HIVE and understanding of SQOOP.
• Experienced in developing Map Reduce programs using Apache Hadoop for working with Big Data.
• Experience in Designing, developing and implementing connectivity products that allow efficient exchange of data between our core database engine and Hadoop ecosystem.
• Worked on NoSQL databases including HBase.
• Experience in importing and exporting the data using Sqoop from HDFS to Relational Database systems/mainframe and vice-versa.
• Good experience in implementing Apache Spark or Spark Streaming project, preferably using Scala, and Spark SQL.
• Experience in application development using Java, RDBMS, and Linux shell scripting.
• Experience migrating data between HDFS and RDBMS using sqoop and also exporting and importing using streaming platforms Flume and kafka.
• Good in writing Python, Shell and Perl scripts to automate activities via Jenkins and Monitoring Build System
• Strong knowledge of Python and corresponding libraries with experience of development for several platforms (Linux, Windows, Unix).
• Designed/Developed Oracle DB/Application monitoring scripts using bash shell.
• Hands on experienced in developing, testing and maintaining applications in Data Warehouse using ETL tools like IBM Info sphere Information Server & Web sphere Data Stage and Ascential Data stage.
• Diverse experience utilizing Java tools in business, Web, and client-server environments including Java Platform, J2EE, EJB, JSP, Java Servlets, Struts, and Java database Connectivity (JDBC) technologies.
• Solid background in Object-Oriented analysis (OOAD) and design. Very good at various Design Patterns, UML and Enterprise Application Integration EAI.
• Expertise in developing Multi-tier enterprise level web applications using various Java … J2EE technologies including JSP, Servlets, JSF, JDBC, JNDI and XML.
• Major strengths are familiarity with multiple software systems, ability to learn quickly new technologies, adapt to new environments, self-motivated, team player, focused adaptive and quick learner with excellent interpersonal, technical and communication skills.
• Good communication skills, work ethics and the ability to work in a team efficiently with good leadership skills.

TECHNICAL SKILLS:

Big data/Hadoop: HDFS, Map Reduce, HIVE, PIG, HBase, Sqoop, Flume, Oozie, and Spark, Core Java, I8N, JFC, Swing, Beans, Log4j, Reflection.

J2EE Technologies: Servlets, JSP, JDBC, JNDI, Java Beans

Methodologies: Agile, UML, Design Patterns (Core Java and J2EE)

Monitoring& Reporting: Ganglia, Nagios, Custom Shell scripts

Frameworks: MVC Struts, Hibernate, spring

Programming Languages: C, C++, Java, Python, Ant scripts, Linux shell scripts

Oracle 11g/10g/9i, MySQL, MS: SQL Server, Netezza, Teradata.

Web Servers: WebLogic, WebSphere, Apache Tomcat

Web Technologies: HTML, XML, JavaScript, AJAX, SOAP, WSDL

ETL Tools: Informatica, Qlickview and Congos

WORK EXPERIENCE:

Confidential, Dearborn, MI

Hadoop/Scala Developer

Responsibilities:

• Worked on Spark core, Spark Streaming, Spark SQL modules of Spark.
• Developing scripts to perform business transformations on the data using Hive and PIG.
• Developing UDFs in java for hive and pig, Worked on reading multiple data formats on HDFS using Scala.
• Involved in converting Hive/SQL queries into Spark transformations using Spark RDDs and Scala.
• Developed multiple POCs using Scala and deployed on the Yarn cluster, compared the performance of Spark, with Hive and SQL/Teradata.
• Analysed the SQL scripts and designed the solution to implement using Scala
• Data analysis through Pig, Map Reduce, Hive.
• Design and develop Data Ingestion component.
• Cluster coordination services through Zookeeper
• Import of data using Sqoop from Oracle to HDFS
• Import and export of data using Sqoop from or to HDFS and Relational DB Teradata.
• Developed POC on Apache-Spark and Kafka
• Implement Flume, Spark, Spark Stream framework for real time data processing.
• Hands on experience in installing, configuring and using eco-System components like Hadoop MapReduce, HDFS, Hbase, Pig, Flume, Hive and Sqoop.
• Developed analytical component using Scala, Spark and Spark Stream.

Environment: Java, Scala, Python, J2EE, Hadoop, Spark, HBase, Hive, Pig, Sqoop, MySQL, Teradata, GitHub.

Confidential, Reston, VA

Hadoop Developer

Responsibilities:

• Gathered the business requirements from the Business Partners and Subject Matter Experts.
• Involved in installing Hadoop Ecosystem components.
• Developed data pipeline using Flume, Sqoop, Pig and Java map reduce and Spark to ingest customer behavioral data and purchase histories into HDFS for analysis.
• Responsible for importing and exporting data from different sources like MySQL, Teradata databases into HDFS using SQOOP to save in file formats AVRO, JSON and ORC file formats.
• Involved in HDFS maintenance and loading of structured and unstructured data.
• Develop and run Map-Reduce jobs on a multi Peta byte YARN and Hadoop clusters which processes billions of events every day, to generate daily and monthly reports as per user's need.
• Weekly meetings with technical collaborators and active participation in code review sessions with senior and junior developers
• Used to manage and review the Hadoop log files, and Responsible to manage data coming from different sources.
• Supported Map Reduce Programs that are running on the cluster.
• Involved in importing the data from different data sources like Teradata into HDFS using Sqoop and applying various transformations using Hive, Spark and then loading data into Hive tables.
• Wrote MapReduce jobs using Java API.
• Delivering tuned, efficient and error free codes for new Big Data requirements using my technical knowledge in Hadoop and its Eco-system.
• Installed and configured Pig and written Pig Latin scripts.
• Involved in managing and reviewing Hadoop log files.
• Imported data using Sqoop to load data from MySQL and Oracle to HDFS on regular basis.
• Developing Scripts and Batch Job to schedule various Hadoop Program.
• Written Hive queries for data analysis to meet the business requirements.
• Creating Hive tables and working on them using Hive QL.
• Utilized Agile Scrum Methodology to help manage and organize a team of 4 developers with regular code review sessions.
• Used JUnit for unit testing and Continuum for integration testing.
• Developed a spark pipeline to transfer data from lake to Cassandra in cloud to make the data available for decision engine to publish customized offers real time

Environment: Cloudera, Hadoop, MapReduce, HDFS, Hive, Pig, Sqoop, Java, Red Hat Linux, XML, MySQL, Eclipse, JUnit

Confidential

Hadoop Developer

Responsibilities:

• Installed/Configured/Maintained Apache Hadoop clusters for application development and Hadoop tools like Hive, Pig, HBase, Zookeeper and Sqoop..
• Knowledgeable in SPARK and Scala Framework exploration for transition from Hadoop/Map Reduce to SPARK.
• Worked on analysing Hadoop cluster using different big data analytic tools including Pig, Hive, and Map Reduce.
• Developed data pipeline using Flume, Sqoop to ingest customer behavioral data and purchase histories into HDFS for analysis.
• Continuous monitoring and managing the Hadoop cluster using Cloudera Manager.
• Used Pig to perform data validation on the data ingested using Sqoop and flume and the cleansed data set is pushed into HBase.
• Participated in development/implementation of Cloudera Hadoop environment.
• Collecting and aggregating large amounts of log data using Apache Flume and staging data in HDFS for further analysis.
• Worked with Zookeeper, Oozie, AppWorx and Data Pipeline Operational Services for coordinating the cluster and scheduling workflows.
• Designed and built the Reporting Application, which uses the Spark SQL to fetch and generate reports on HBase table data.
• Extracted the needed data from the server into HDFS and Bulk Loaded the cleaned data into HBase.
• Worked closely on parallel computing with Spark team to explore RDD in Datastax Cassandra.
• Responsible for creating Hive tables, loading the structured data resulted from Map Reduce jobs into the tables and writing hive queries to further analyze the logs to identify issues and behavioral patterns.
• Involved in running Map Reduce jobs for processing millions of records.
• Involved in scheduling Oozie workflow engine to run multiple Hive and pig jobs
• Developed Hive queries and Pig scripts to analyze large datasets.
• Involved in importing and exporting the data from RDBMS to HDFS and vice versa using Sqoop.
• Involved in generating the Adhoc reports using Pig and Hive queries.
• Used Hive to analyze data ingested into HBase by using Hive-HBase integration and compute various metrics for reporting on the dashboard.
• Developed job flows in Oozie to automate the workflow for pig and hive jobs. Loaded the aggregated data onto Oracle from Hadoop environment using Sqoop for reporting on the dashboard

Environment: Red Hat Linux, HDFS, Map-Reduce, Hive, Java JDK1.6, Pig, Sqoop, Flume, Zookeeper, Oozie, Oracle, HBase

Confidential

Java/J2EE Developer

Responsibilities:

• Actively participated in different phases of the Software Development Life Cycle (AGILE)and analyzed Use Case diagrams and Class diagrams based on requirement.
• Presentation Layer is created using JSP, HTML and Struts Tag Libraries.
• Configured Front end to Server side by using Struts Configuration.
• Validated user data using Struts Action Forms and user request is processed using Action Classes.
• Written Hibernate mapping file for each Java Object and configured with respective table in Hibernate Configuration.
• Designed and Developed Gemfire Spring Repositories with well-designed Domain Objects.
• Created test cases using JUNIT and Mockito.
• Design and implementation of Spring-Security for the application for authentication process against LDAP, J2EE pre-authentication, and Database
• Written HQL Queries to communicate with the Oracle Database.
• Developed DAO's (Data Access Objects) and performed O/R Mapping using Hibernate to access the database.
• Implemented Log4j for logging and developed test cases using JUnit.
• Performed Unit, Integration testing, worked on clearing issues at the time production and application support, worked on the maintenance and deployments of the project with patches and performed documentation of project.
• Used Rational Clear Case as Version Control for versioning and synchronizing the project code.

Environment: Java, J2EE, Struts 1.2, Hibernate, Oracle 9i, Web Sphere 5.0, JavaScript, RAD 6.0, Rational Clear Case.

Confidential

Java/J2EE Developer

Responsibilities:

• Involved in various phases of Software Development Life Cycle (SDLC) of the application like Requirement gathering, Design, Analysis and Code development.
• Developed and designed the front end using HTML, CSS and JavaScript and Ajax.
• Developed the entire application implementing MVC Architecture integrating Hibernate and Spring frameworks.
• Involved in development of presentation layer using JSP and Servlets with Development tool Eclipse IDE.
• Worked on development of Hibernate, including mapping files, configuration file and classes to interact with the database.
• Used XML/XSL and Parsing using both SAX and DOM parsers.
• Designed and developed EJBs to handle business logic and store persistent data.
• Planned and implemented various SQL, Stored Procedure, and triggers.
• Written JUnit Test cases for performing unit testing.
• Responsible for testing, debugging, bug fixing and documentation of the system.
• Application deployment is done in Tomcat server.
• Developed business functionalities using JAVA/J2EE, Spring, Hibernate, RESTful Web Services, Oracle database and Web logic application server.
• Implemented Single Sign-On (SSO) functionality for the application.
• Developed database stored procedures, functions and packages using SQL, PL/SQL and SQL Developer.
• Developed unit test cases using JUnit and performed Unit Testing of application modules.
• Supported QA and UAT testing. Fixed the bugs/issues reported during testing phase.
• Provided the technical guidance to new and/or junior team members.

Environment: Java, Servlets, JSP, JQuery, JUnit, Hibernate 3.2, JPA 2.0, Spring 2.5, Ajax, Oracle 10g, JMS, Eclipse 3.4, Apache Ant, Tomcat, Web Services, Apache Confidential 2.0, WebSphere 6.1, JavaScript, HTML, CSS, XML, Clear Case.