SUMMARY:

• 7 years of professional IT experience in analyzing requirements, designing, building, highly distributed mission critical products and Applications.
• Highly dedicated and result oriented Hadoop Developer with 3+ years of strong end - to-end experience on Hadoop Development with varying level of expertise around different BIGDATA HADOOP projects.
• Experience in Hadoop 2.0 (MRv2) YARN architecture.
• Expertise in core Hadoop and Hadoop technology stack which includes HDFS, Map Reduce, Oozie, Hive, Sqoop, Pig, Flume, HBase, Spark, Kafka and Zookeeper.
• Well versed in installation, configuration, supporting and managing of Big Data and underlying infrastructure of Hadoop Cluster.
• Experienced in implementing complex algorithms on semi/unstructured data using Map reduce programs.
• Experienced in working with structured data using Hive QL, join operations, Hive UDFs, partitions, bucketing and internal/external tables.
• Experienced in migrating ETL kind of operations using Pig transformations, operations and UDF's.
• Good knowledge on Python.
• Excellent Working Knowledge in Spark Core, Spark SQL, Spark Streaming..
• Developed analytical components using Scala and Spark.
• Experienced in working with in-memory processing frame work like Spark transformations, Spark streaming.
• Developed fan-out workflow using flume for ingesting data from various data sources like Webservers, Rest API by using different sources and ingested data into Hadoop with HDFS sink.
• Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems MYSQL, SQL SERVER and vice versa.
• Actively involved in coding using Core Java and collection API's such as Lists, Sets and Maps.
• Hands on experience in application development using Java, RDBMS, and Linux shell scripting.
• Experience on different operating systems like UNIX, Linux and Windows.
• Strong knowledge of agile development methodologies, waterfall methodologies to minimize customer impact.
• Good understanding of all aspects of Testing such as Unit, Regression, Agile, White-box, Black-box.
• Ability to effectively manage deadlines. Self-motivated, highly organized and the ability to multi-task.

TECHNICAL SKILLS:

Hadoop Technologies: Hadoop, PIG, HIVE, HBase, Apache Spark, Oozie, MYSQL.

Programming Skills: C, C++, Java, PHP, Python, Scala.

Operating Systems: Windows, Linux, UNIX.

Other: HTML, XML, Git hub, Microsoft Project.

PROFESSIONAL EXPERIENCE:

Hadoop Developer

Confidential, Dallas, TX

Responsibilities:

• Extracted the data from Teradata/MySQL into HDFS using Sqoop export/import.
• Expertise in using Data organizational design patterns in Map Reduce to convert business data into custom format.
• Implemented JOINS to create tables having the records of Items by Spark SQL.
• Experienced knowledge over the Restful API's like Elastic Search.
• Load log data into HDFS using Flume, Kafka.
• Analyzed the data by performing Hive queries and running Pig scripts.
• Created and worked Sqoop jobs with incremental load to populate Hive External tables.
• Developed Hive scripts for end user / analyst requirements to perform ad hoc analysis.
• Experienced with handling different optimization techniques in Hive joins.
• Developed UDFs in Java as and when necessary to use in HIVE queries.
• Deployed an Apache Solr search engine server to help speed up the search of the government cultural asset.
• Performed iterative algorithms using Apache Spark on top of Hadoop YARN.

Environment: Hadoop, HDFS, Flume, Sqoop, Spark, Pig, Hive, Map Reduce, Elastic Search, Oozie, Avro, Scala, Linux, SVN, MYSQL, Kafka.

Hadoop Developer

Confidential, Dallas, TX

Responsibilities:

• Used SQOOP to dump data from MySQL relational database into HDFS for processing and exporting.
• Strong data warehouse and database design skills.
• Designed and implemented Map Reduce jobs for analyzing the data collected by the flume server.
• Created UDF’S form Ab Initio ETL graphs.
• Developed workflow in Oozie to automate the tasks of loading the data into HDFS and pre-processing, analyzing and testing the classifier using Pig and Hive jobs.
• Experience with creating ETL jobs to load JSON Data and server Data into MongoDB and transformed MongoDB into the Data warehouse.
• Involved in converting Hive/SQL queries into Spark transformations using Spark SQL, Scala.
• Conducted POC using SparkSQL as part of NextGen platform implementation.
• Extracted files from NoSQL database like Cassandra using Sqoop.
• Worked with Flume to import the log data from the reaper logs and syslog's into the Hadoop cluster.
• Used complex data types like bags, tuples, and maps in Pig for handling data.
• Created/modified UDF and UDAFs for Hive whenever necessary.
• Developed Pig UDFs for preprocessing thee data for analysis.
• Involved in writing shell scripts for scheduling and automation of tasks.
• Managed and reviewed Hadoop log files to identify issues when job fails.
• Worked on Hive for analysis and generating transforming files from different analytical formats to text files.
• Used Hue for UI based PIG script execution, Oozie scheduling.

Environment: Ab Initio, Eclipse, Hive, Pig, Sqoop, Oozie, Spark, Cassandra, HDFS, Flume, Agile, SVN, Linux Shell scripting.

Hadoop Developer

Confidential, Detroit, MI

Responsibilities:

• Involved in the Complete Software development life cycle (SDLC) to develop the application.
• Worked on analyzing Hadoop cluster and different big data analytic tools including Pig, Sqoop, zookeeper.
• Involved in loading data from LINUX file system to HDFS.
• Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team.
• Importing and exporting data into HDFS and Hive using Sqoop from SQL SERVER and vice versa.
• Developed multiple Map Reduce jobs in java for data cleaning.
• Created Pig Latin scripts to sort, group, join and filter the enterprise wise data.
• Involved in creating Hive tables, loading with data and writing hive queries that will run internally in Map Reduce way.
• Supported MapReduce Programs those are running on the cluster.
• Analyzed large data sets by running Hive queries and Pig scripts.
• Implemented Frameworks using java and python to automate the ingestion flow.
• Worked on tuning the performance Pig queries.
• Mentored analyst and test team for writing Hive Queries.
• Installed Oozie workflow engine to run multiple Map reduce jobs.
• Worked on zookeeper for coordinating between different master node and data nodes.

Environment: Hadoop, HDFS, Map Reduce, Hive, Pig, Sqoop, Linux, Java, Oozie, zookeeper, SQL SERVER.

Java Developer

Confidential, Charlotte, NC

Roles and Responsibilities:

• Designed use case diagrams, class diagrams, and sequence diagrams as a part of Design Phase using Rational Rose.
• Actively participated in requirements gathering, analysis, design, and testing phases.
• Developed the application based on MVC Architecture, integrating JSP with Hibernate and struts frameworks.
• Designed User Interface using Java Server Pages (JSP), Cascading Style Sheets (CSS), and XML.
• Developed the Enterprise Java Beans (Stateless Session beans) to handle different transactions such as bill payments to the service providers.
• Worked on STRUTS, Tiles, AJAX, for developing the application.
• Developed deployment descriptors for the EJB to deploy on Web Sphere Application Server.
• Implemented Service Oriented Architecture (SOA) using JMS for sending and receiving messages while creating web services.
• Developed Web Services for data transfer from client to server and vice versa using Apache Axis, SOAP, WSDL, and UDDI.
• Extensively worked on MQ Series using point-point, publisher/subscriber messaging Domains for implementing Exchange of information through Messages.
• Developed XML documents and generated XSL files for Payment Transaction and Reserve Transaction systems.
• Implemented various J2EE Design patterns like Singleton, Service Locator, Business Delegate, DAO, Transfer Object, and SOA.
• Worked on AJAX to develop an interactive Web Application and JavaScript for Data Validations.
• Used Subversion to implement version control System.
• Build ANT Script for the application and used Log4J for debugging.
• Used JUnit Framework for the unit testing of all the java classes.

Environment: Java EE 5, EJB 3.0, JNDI 1.2, Hibernate 2.1, Struts 1.3, HTML, JavaScript, XML, CSS, JUnit, UML, iReport 2.0 and 4.0, Web Services, SOAP, WSDL, UDDI, AXIS 2, Ajax, Ant, Eclipse 3.3, IBM Web Sphere 6.1, DB2, subversion, Linux.

Java Developer

Confidential

Responsibilities:

• Involved in End to End Design and Development of UI Layer, Service Layer and Persistence Layer.
• Implemented Spring MVC for designing and implementing the UI Layer for the application.
• Implemented UI screens using JSF for defining and executing UI flow in the application for the Order Guide module.
• Have used AJAX to retrieve data from server synchronously in the background without interfering with the display and existing page in an interactive way.
• Have Used DWR (Direct Web Remoting) generated script to make AJAX calls to JAVA.
• Involved in writing JavaScript for dynamic manipulation of the elements on the screen and to validate the input.
• Have used pair programming model for the development.
• Involved in writing Spring Validator Classes for validating the input data.
• Have set up Acegi security for the application using the spring framework.
• Have used JAXB to marshal and unmarshal java objects to Communicate with the backend mainframe system.
• Involved in writing complex PL/SQL and SQL blocks for the application
• Worked on persistence layer using O/R Mapping tool Hibernate with Oracle 10g Database.
• Provided expertise for performance optimizations on the end-to-end solution, implemented performance enhancements to database interaction objects.
• Used Log4j package for the debugging, info and error tracings.

Environment: Java, J2EE, JSP, Struts, JDBC, XML, JNDI, Hibernate, JMS, ANT, Eclipse, Oracle, JavaScript, Ajax, HTML, Rational Rose XDE, Junit, Log4j, Dojo, JavaScript, XML/XSLT,SAX,DOM.

Java Developer

Confidential

Responsibilities:

• Used Servlets, Struts, JSP and Java Beans for developing the Performance module using Legacy Code.
• Involved in EMI (Repayments), Cheque Bounce, Deposits module in all activities.
• Involved in coding for JSP pages, Form Beans and Action Classes in Struts.
• Created Custom Tag Libraries to support the Struts framework.
• Involved in Writing Validations.
• Involved in Database Connectivity through JDBC.
• Involved in Writing DAO's.
• Developed JUnit Test cases and performed application testing for QC team.
• Used JavaScript for client side validations.
• Participated in weekly project meetings, updates and Provided Estimates for the assigned task.

Environment: JAVA, J2EE, STRUTS, JSP, JDBC, ANT, XML, IBM Web Sphere, WSAD, JUNIT, DB2, Rational Rose, CVS, SOAP and RUP.