SUMMARY

• IT professional with 14 years of diversified experience in requirements gathering, analysis, design, development, deployment, and implementation of Hadoop, Java/J2EE and Microsoft technologies.
• Around 2 years of experience as Hadoop Developer with Apache Hadoop components like HDFS, MapReduce, Hive, BigData, Scoop, Oozie, Flume and Pig.
• CCD - 410 Cloudera Hadoop Developer Certified.
• Good understanding of BigData Hadoop architecture and various components such as HDFS, MapReduce, Name Node, Data Node, Job Tracker, and Task Tracker.
• Experience in analyzing large data using MapReduce program in java and Hive QL as per the business requirements.
• Using Flume to import / export data from HDFS to RDBMS and vice-versa.
• Experience in writing MapReduce with combiner and partitioning and custom UDF in Hive.
• Good understanding of data import and export from relational databases into Hadoop cluster.
• Experience in data extraction and transformation using MapReduce jobs.
• Strong experience in core Java, JSP, Servlets, J2EE, and JDBC.
• Expertise in writing stored procedures and complex SQL queries using relational databases like Oracle, SQL Server and MySQL.
• Experience in SOAP based web services.
• Strong experience in Microsoft Technologies such as ASP.Net, C#, VB.Net and ADO.Net.
• Experience in web technologies like HTML, CSS, XML, JavaScript and JQuery.
• Good understanding of performance monitoring tools like IntroScope, Splunk and SiteScope.
• Extensively work in Agile Scrum development methodology and waterfall model of software development life cycle (SDLC).
• Good knowledge on Banking - Mortgage, Automobile and Energy and Utility.
• Ability to work independently, well motivated to rapidly acquire new skills on the job, excellent team member, good problem solving and trouble-shooting capabilities.

TECHNICAL SKILLS

Big Data Platform: MapReduce, Pig, Hive, Sqoop, Flume, Oozie, HBase, Cloudera Manager, and Hue UI

Languages: Core Java, C#, C++, T-SQL/PL-SQL

Web Technologies: JSP, Servlets, ASP.NET, JSP, Servlets, JavaScript, JQuery, HTML, CSS and XML

Databases: SQL Server 2000/2005/2008, Oracle 8/9i/10g and MySQL

Web/App Servers: IIS, Tomcat and Web Logic Server

Operating Systems: Windows XP/2000/vista/7 and Linux

Tools: Eclipse, Tortoise SVN, Visual Studio, Team Foundation Server (TFS), Introscope, Sitescope, Splunk, Version One, and SOAP UI

PROFESSIONAL EXPERIENCE

Big Data Developer

Confidential

Responsibilities:

• Working with data analyst/scientist or application stakeholder to understand business requirements.
• Load events XML data into HIVE using hivexmlserde. Parse the XML and load the data into three different managed/external HIVE tables. Based on the business requirements expire the previous load (partition) events for specific criteria.
• Create HIVE partition managed table for the each incremental loads.
• Extract Informix weather forecast data using Sqoop to load into HIVE table.
• Develop generic SQOOP export utility to export data from HIVE to different types of RDBMS like Teradata, DB2, PostgreSQL (GreenPlum), and SAP HANA.
• Develop generic SQOOP import utility to load data from various RDBMS sources like Teradata, DB2 and GreenPlum.
• Write MapReduce program for finding an items for each department.
• Develop HIVE UDF, .hql scripts passing dynamic parameters using hivevar.
• Write UNIX shell scripting.
• Write Oozie script for workflow and scheduling job.
• Using SFTP to load data from external sources to UNIX box and then load into the HDFS.
• Working on data productionization for PKP, SKP and DataCafe applications to provide better security to data and guarantee a more accurate view of the data for analytical purposes.
• Write UNIX script to load data from Greenplum temp schema to production schemas.
• Using GPLoad utility to load data from Teradata and external files stored by third party vendors to Greenplum temp schema.
• Working on data validation and post deployment supports.

Environment: s: Pivotal Hadoop Cluster, HDFS, HIVE, MapReduce, Sqoop, Oozie, UNIX shell scripting, GreenPlum Database, pgAdmin III, SAP Hana Studio, Teradata SQL Assistant, SuperPutty, Eclipse, UNIX, Version One

Hadoop Developer

Confidential

Responsibilities:

• Work on analyzing and writing MapReduce jobs based on the requirements.
• Involve in creating Hive tables, loading with data and writing hive queries that will internally run as MapReduce job.
• Work on Flume to stream Twitter data in to HDFS.
• Work on creating Hive scripts for data analysts based on the Ad-hoc requirements.
• Involve in writing UDF for Hive.
• Schedule the workflow using Oozie workflow scheduler.
• Extract the data from external data sources into HDFS using Sqoop.
• Develop MapReduce programs using combiner and custom partition.
• Create Sqoop job to populate Hive tables.
• Using Cloudera Manager for monitoring purpose.
• Involve in loading data from local file system to HDFS.
• Involve in all the phases of the SDLC using Agile Scrum methodology.
• Working in Agile environment with 3 weeks sprint, involving in grooming meeting, sprint planning meeting, retrospective meeting and daily stand up meeting.
• Using Version One tool for tracking all agile related activities like stories, tasks, estimated story points and actual burn hours.

Environment: Hadoop, MapReduce, HDFS, Hive, Scoop, Flume, Oozie, Cloudera Manager, Hue UI, Java (JDK 1.6), Eclipse, Version One and Cloudera Distribution

Systems Software Engineer

Confidential

Responsibilities:

• Worked on the SSIS packages used for the loan evaluation engine jobs.
• Worked on the dtsConfig file to set dynamic parameters required for the SSIS packages.
• Developed complex stored procedure for business logic requires for the jobs.
• Being a part of production support team, gave 24X7 support on rotation basis.
• Took initiatives in implementing disaster recovery exercise for consecutive 2 years.
• Understood the complete architecture to successfully implement disaster recovery.
• Engaged in configuring, installing and monitoring of performance monitoring tools in production environment.
• Worked on the configuration part of the different performance tools like Splunk, Introscope and Sitescope.
• After installation of Splunk validated data using the regular expressions.
• Worked with the different teams to successfully install of the performance tools.
• Engaged in SDLC with all the phases like analysis, design, development, testing of the application.
• Used Team Foundation Server as version control tool.
• Involved in unit testing, code review and production release support.
• Defects managed through JIRA

Environment: SSIS, SQL Server 2008, T-SQL, XML, Team Foundation Server, Splunk, Introsocpe, Sitescope, Windows

Sr. Software Engineer

Confidential

Responsibilities:

• Responsible for delivering the assigned stories within the sprint timelines.
• Involved in all the phases of the SDLC using Agile SCRUM development methodology.
• Worked in Agile scrum environment with 2 weeks sprint. Involved in grooming meeting, sprint planning meeting, sprint review and retrospective meeting, and daily stand up meeting.
• Designed and developed various modules and pages using core java, JSP, Spring MVC, and Hibernate.
• Designed and developed the UI using HTML, JSP, CSS, AJAX and JavaScript/JQuery.
• Developed SOAP, WSDL based web services.
• Used SOAP UI to test the web services request/response.
• Developed complex stored procedures, functions and wrote complex SQL queries.
• Maven is used to create build file and unit testing by creating test suites using JUnit framework.
• Use firebug for debugging the UI page.
• Responsible for analyzing and fixing defects during current sprint.
• Responsible to communicate with end client to support the application, analyze and fixing the issue.
• Involved in code versioning, check in, check outs and code merging using Tortoise SVN versioning tool.
• Participated in story grooming, code review, functional review, test case review and support QS and UAT.
• Coordinated with Business System Analyst, Product Owner, Scrum Master and QS team during sprint.
• Used Version One tool for tracking all agile related activities like stories, tasks, estimated story points and actual burn hours.
• Involved in unit testing, code review and post-production support activities of the application.

Environment: Java (JDK 1.4/1.5/1.6), J2EE, Spring 3.0, SOAP, WSDL, Oracle10g/ SQL Server 2008, Tomcat, JUnit, Log4j, Eclipse, Tortoise SVN, Version One, HTML, CSS, XML, JavaScript, JQuery and SOAP UI

Advisory System Analyst

Confidential

Responsibilities:

• Involved in software development life cycle (SDLC) of the project (analysis, design, development, testing and implementation).
• Used MS-Visio for analysis & design flow and monitored the initial applications prototype development for the project.
• Leading a team of 4 developers and point of contact for onshore / offshore communication.
• Designed and developed web pages using JSP, JDBC, Servlets, ASP and ASP.NET.
• Developed modules using core java, C#, VB.Net and VB6.0.
• Used HTML, CSS, XML and JavaScript to design a page.
• Successfully migrated legacy application written in VB6.0 to VB.Net.
• Developed Web Services to get data from the external system in terms of .txt file to load into the database.
• Developed DTS/SSIS packages to load employee details into row Mony tables of the SQL server for further processing.
• Wrote Stored Procedures, functions and complex SQL queries for database operations.
• Used Java Scripts to perform client side validations.
• Worked on performance tuning of queries.
• Developed reports using Crystal Reports reporting tool.
• Have used DataGrid and GridView Controls to display data in a customized format in the ASP.NET web pages.
• Have used LDAP and Active Directory Search Interface (ADSI) to authenticate and authorize user.
• Involved in unit testing and production support of the application.
• Defects were managed through the Remedy

Environment: Java, J2EE, JSP, Servlets, .Net Framework 2.0, ASP.NET, C#, VB.NET, ADO.NET, Oracle9i, SQL Server 2005, T-SQL/PL-SQL, HTML, XML, Web Services, JavaScript, Windows 2000, IIS, Tomcat, Visual Source Safe (VSS), Remedy and Crystal Reports

Product Development Engineer

Confidential

Responsibilities:

• Involved in requirements gathering.
• Based on the requirements, developed prototype in HTML.
• Developed web pages using classic ASP, HTML and CSS.
• Used Java Scripts to perform client side validations.
• Developed stored procedures and wrote SQL queries in PL/SQL.
• Developed various complex windows data entry forms and modules in VB6.0.
• Developed reusable ActiveX COM components.
• Used ADO to communicate with database.
• Developed dynamic crystal reports based on user input.
• Worked extensively on the database design.
• Prepared technical document and involve in unit testing.

Environment: VB6.0, ADO, SQL Server 2000, Crystal Report 8.0, Classic ASP, Oracle 9i, HTML, JavaScript, Visual Studio 6.0, Windows 2000, and IIS

Java Developer

Confidential

Responsibilities:

• Involved in database design.
• Involved in preparation of technical design document.
• Developed and deployed servlets.
• Developed data access layer using JDBC for communicating with the database.
• Developed user interfaces using Java, JSP and HTML.
• Developed stored procedures in PL/SQL.
• Used JavaScript to perform client side validations.
• Responsible for unit testing of the code and code deployment.

Environment: JSP, Servlets, JDBC, JavaScript, HTML, J Builder, Web Logic Server, and Oracle8.0