SUMMARY

• Around 8 years of experience in Information Technology as a Software Engineer specialized in Big Data analytics and Hadoop technology stack for over 3 years, widespread experience of 3 years in SQL and 2 years in Java.
• Extensively worked onHadoopframework with Cloudera and Hortonworks Distribution.
• Excellent understanding / knowledge of Hadoop architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and Map Reduce programming paradigm.
• Experience in the design, develop and monitoring of large clusters involving with both relational and NoSQL databases.
• Hands on experience in working withHadoopframework like Hive, Pig, Sqoop, Map Reduce, Flume and Oozie.
• Experience in importing and exporting data using Sqoop from Relational Database to HDFS and from HDFS to Relational Database.
• Worked on Flume to maintain log data from external source systems to HDFS.
• Experience in analyzing data using HiveQL, Pig Latin, HBase and custom MapReduce programs in Java. Extending Hive and Pig core functionality by writing custom UDFs.
• Extensively worked on Oozie for workflow management, with separate workflows for each layer like Staging, Transformations and Archive layers.
• Extensively worked on NOSQL Databases such as HBase, Cassandra.
• Worked on Map Reduce programs for parallel processing of data and for custom input formats.
• Extensively worked on PIG for ETL Transformations and optimized Hive Queries.
• Experienced in extracting large datasets from Teradata into HDFS using Sqoop.
• Experience working with databases such as Oracle 8.x/9i/10g, MS - SQL Server 2008/2005 MySQL and using PL/SQL to write stored procedures, functions and triggers for different Data Models.
• Deployed, configured and managed Linux servers in VM.
• Strong UNIX Shell Scripting skills.
• Extensive experience of designing and developing software applications with the JDK 1.6/1.5/1.4/1.3 , J2EE1.4/1.1, Java, JSP, Servlets, Java Beans, JNDI, AJAX, JMS, Web services, JDBC, XML, JavaScript, JQuery, CSS, Web Services, SOAP.
• Worked on Eclipse IDE for developing, deploying and debugging the java applications.
• Experience in Agile development, Test Driven Development and SCRUM.
• Extensive working experience in unit testing framework - JUnit Tests.
• Responsible for designing Presentation Tier (web pages) using the concepts such as Themes, Skins, HTML, XML, CSS, Java Script and JQuery using AJAX.
• Handled several techno-functional responsibilities including estimates, identifying functional and technical gaps, requirements gathering, designing solutions, development, developing documentation, and production support.
• Good Knowledge of Microsoft Office Suite including MS Access and MS Excel.
• Ability to effectively communicate with all levels of the organization such as technical, management and customers.
• An individual with excellent interpersonal and communication skills, strong business acumen, creative problem solving skills, technical competency, team-player spirit, and leadership skills.
• Ability to perform at a high level, meet deadlines, adaptable to ever changing priorities.

TECHNICAL SKILLS

Big data / Hadoop: HDFS, MapReduce, Hive, PIG, Sqoop, Flume, Oozie, HBase,Zookeeper, Cloudera manager.

Languages: C, C++, Java, SQL, HTML, JavaScripts, XML.

Methodologies: AGILE/SCRUM.

Database: MYSQL, Oracle 8.x/9i/10g Enterprise Edition, MS-SQL Server, 2008/2005, Teradata.

Web Technologies: JAVA, J2EE, EJB, STRUTS 1.0&2.0, HIBERNATE, Spring 3.0, Servlets, JSP, SOAP Web Services, REST Web Services JMS,JDBC, Java Beans, AJAX, XML, JavaScript, CSS.

OS: Windows XP, 2000, 7, 8, Linux, Macintosh, Unix (Sun Solaris 2.6/2.8).

PROFESSIONAL EXPERIENCE

Confidential

Hadoop Developer

Environment: HDFS, Pig, Hive, Sqoop, Flume, Map Reduce, Oozie, MySql, HBase, Zookeeper, Cassandra, Cloudera Manager, Eclipse and Linux.

Responsibilities:

• Actively involved in Analysis, Detail Design, Development, Bug fixing and Enhancement in Agile methodology.
• Installed and configured Hadoop on a cluster.
• Developed multiple Map Reduce Jobs in java for data cleaning and pre-processing.
• Experienced in analyzing large sets of data with Hive Query Language and Pig Latin Script.
• Optimized Hive and Pig queries for better performance.
• Extending Hive and Pig core functionality by writing custom UDFs
• Involved in creating Hive tables, loading with data and writing hive queries that will run internally in map reduce way.
• Experienced in defining job flows using Oozie.
• Experienced in managing and reviewing Hadoop log files.
• Experienced in collecting, aggregating, and moving large amounts of streaming data into HDFS using Flume.
• Load and transform large sets of structured, semi structured and unstructured data.
• Responsible to manage data coming from different sources and application.
• Working Knowledge in NoSQL Databases like HBase and Cassandra.
• Involved in Unit level and Integration level testing.
• Prepared design documents and functional documents.
• Based on the requirements, addition of extra nodes to the cluster to make it scalable.
• Involved in running Hadoop jobs for processing millions of records of text data.
• Involved in loading data from local file system (LINUX) to HDFS.
• Experienced in runningHadoopstreaming jobs to process terabytes of XML format data.
• Responsible to manage data coming from different sources.
• Assisted in exporting analysed data to relational databases using Sqoop.
• Created and maintained Technical documentation for launching Hadoop Clusters and for executing.
• Submitted a detailed report about the daily activities on a weekly basis.

Confidential - Pittsburgh, PA

Hadoop Data Analyst/Developer

Environment: Hadoop, HDFS, Hive, Pig, Sqoop, Oozie, Map Reduce, UNIX, Shell Scripting.

Responsibilities:

• Responsible for building scalable distributed data solutions using Hadoop.
• Worked extensively on a large datasets in Hadoop cluster.
• Responsible for Cluster maintenance, managing cluster nodes.
• Involved in managing & review of data backups and log files.
• Developed data pipeline using Flume, Sqoop, Pig and Java Map Reduce to collect customer behavioural data and historical utility data into HDFS for analysis.
• Analyzed data using Hadoop ecosystems like Hive and Pig.
• Hands on experience with ETL process.
• Involved in running Hadoop streaming jobs to process terabytes of data.
• Experienced in loading and transforming large sets of structured, semi-structured and unstructured data Hadoop concepts.
• Created Hive tables and partitioning’s to store data and written Hive queries.
• Involved in importing data from various data sources, performed transformations using Hive, MapReduce, and loaded data into HDFS.
• Extracted the data from Teradata into HDFS using Sqoop.
• Exported the patterns analyzed back to Teradata using Sqoop.
• Scheduled Oozie workflow engine to run multiple Hive and Pig jobs, which independently run with time and data availability.

Confidential, FL

SQL Developer

Environment: Environment:SQLServer 2005/2008,SQL, T-SQL, SSIS, SSRS

Responsibilities:

• Created and executed SQL Server Integration Service (SSIS) package to populate data from various data sources, created packages for different data loading operations for many applications.
• Developed and maintained enterprise reporting (SSRS Reporting Services) based on specifications and business needs and modified existing reports as needed.
• Used SSIS to create ETL packages to Validate, Extract, Transform and Load data to Transaction and Data Ware House.
• Developed Event Handlers for executing Stored Procedures and storing the rows Inserted, rows Selected, rows Rejected, rows Updated and rows Unchanged in appropriateSQLTables.
• Using Checkpoints in packages to enable the package to run from the point of failure.
• Using Configurations to make dynamic changes to packages. Configurations like XML, SQL Server and Environment Variables have been used.
• Using the Default logging as well as Custom Log to keep track of the package.
• Experience in creating multiple reports (SSRS) in Drill mode using tables, crosses tabs and charts.
• Experienced with Implementing Backup and Recovery Strategies.
• Built effective queries for high-performance reporting and rendered them to HTML, XML, PDF and Excel formats using Reporting Services.
• Design, deployment, and maintenance of various SSRS Reports inSQLServer 2005.
• Extensively used VB Script to pass multiple parameters for Stored Procedures to read and write database table.
• Involved in complete SDLC, which includes requirement gathering, analysis, design, development and Implementation.
• Configuring Alerts to be fired in the event of failed backups or performance issues.
• UsedSQL Server Profiler to trace the slow running queries and tried to OptimizeSQLqueries for improved performance and availability.

Confidential

Java Developer

Environment: J2EE, JSP, Spring2.5, Struts 2.0, Hibernate 3.2, JDBC, XML, CSS, Web Services, Junit, SQL

Responsibilities:

• Involved in the requirements gathering. Design, Development, Unit testing and Bug fixing.
• Used Agile Methodologies to manage full life-cycle development of the project.
• Use of Joins, Triggers, Stored Procedures and Functions in order to interact with backend database using SQL
• Wrote SQL to update and create database tables.
• Used Oracle database as backend database.
• Involved in writing the presentation layer in Java Server Pages (JSP).
• Developed application using Struts, spring and Hibernate.
• Developed rich user interface using JavaScript, CSS, JQuery and JSP’s.
• Involved in making release builds for deploying the application for test environments.
• Used Eclipse as IDE for Java.
• Used Hibernate for connecting to the database and mapping the entities by using hibernate annotations.
• Created JUnit test cases for unit testing application.