OBJECTIVE:

Seeking a challenging Hadoop Lead/Dev Manager position where I can leverage over 13 years of software development experience to deliver innovative technology solutions. Expand my knowledge and make an impact using Big Data/Hadoop Analytics and related technologies that can dramatically improve an organization’s ability to drive revenues, profitability, market share, and competitiveness.

PROFESSIONAL SUMMARY:

• Over 13 years of IT experience including around 4 years of hands - on experience in Big Data, Hadoop ecosystem related technologies.
• Architect Big Data Solutions and Lead/Co-lead teams on several Hadoop ingestion project tracks.
• Extensive experience with C# / VB.NET, Java, Spring, Hibernate, JQuery/Javascript, and ASP.NET Web Development.
• Excellent exposure to RDBMS design and writing SQL queries - MSSQL, MySQL, ODBC/JDBC
• Sound knowledge of Hadoop architecture and its various components - Hadoop File System HDFS, YARN, MapReduce, Name node, Data Node, Job Tracker, Task Tracker, Secondary Name Node
• Excellent understanding of Hadoop MapReduce programming paradigm.
• Hands on experience with using Cloudera CDH 4, Hortonworks and Cloud (AWS/EC2)
• Hands on experience with Hadoop ecosystem components like HBase, Oozie, Hive, Zookeeper, Sqoop, Pig, Flume, HUE, Impala, Spark.
• Extended Hive and Pig core functionality by writing Java UDFs.
• Experience with Oozie Scheduler in setting up workflow jobs with Map/Reduce and Pig jobs.
• Extracted & processed streaming log data from various sources and integrated into HDFS using Flume and Storm.
• Importing and exporting data between HDFS and Relational Database Management systems using Sqoop.
• Experience in designing and implementing MapReduce jobs to support distributed processing using Java, Hive and Pig.
• Sound knowledge of using NOSQL database HBase and its architecture.
• Worked with different File Formats like TEXTFILE, AVROFILE, SEQUENCE FILE, JSON, XML, PARQUET/ORC for HIVE querying and processing.
• Experience using MRUNIT to test the working of Java code.
• Exposure to various SDLC methodologies like Agile, Waterfall and Scrum models
• Ability to adapt to evolving technology, strong sense of responsibility and .
• Enjoy working in a fast changing environment and learning new technologies effortlessly.

TECHNICAL SKILLS:

C#, ASP.Net/VB.Net, Ajax, Winforms, Winforms Controls and Components, ADO.Net, XML Web Services, .Net / J2EE, Jquery, Java, Scala, Javascript, Visual Studio 2003, Eclipse, Hue,.Net Framework 1.1, ASP.Net, IIS 5 and 6, SOAP, ASP.Net Handlers, SQL, SQLServer 2000, SSIS, SSAS, SSRS. Hadoop Ecosystem and its tools: HDFS, Map/Reduce, Hive, HBase, Sqoop, Oozie, Zookeeper, Spark, Impala, Windows XP, Visual SourceSafe 6, XSLT, XML Schema, XMLSpy 4.0, XPath, MSMQ, COM, COM+ Interoperability, Linux, UNIX, Korn shell, Bash shell, Perl, Apache IIS, Sequence Diagrams, Use Cases, RUP and Unified Process, Control-M, Github, Gerrit, Jenkins

WORK EXPERIENCE:

Senior/Lead Hadoop Developer

Confidential, Bellevue, Washington

Responsibilities:

• Lead development efforts on several Hadoop Data Lake ingestion tracks, coordinating between developers, analysts, system administrators, app support and other stakeholders.
• Worked on Flatfile and DB ingestion jobs using custom framework, utilitzing Unix Shell, Oozie, Sqoop, JAR files, Pig, Hive, Hue, Hbase, and HDFS.
• Re-architected SIS deployment document to minimize Hadoop jobs deployment and execution to just a few steps, and built corresponding automation scripts - yum installation, HDFS/Hive cleanup, and post-deployment validation.
• Architected a custom file monitoring and movement solution and put together a corresponding Power Point presentation to address client need.
• Participated in POC projects dealing with streaming data sources, using tools such as Storm and Spark.
• Designed and coded count validation Shell Script as part of ABC efforts for over 600 active ingestion jobs.
• Automated mandatory deletion of sensitive files from Hadoop Dev environment - Edgenode and HDFS.
• Designed and wrote a Pig Script to extract Hadoop job error logs from Hbase, and Shell Script driver to sort /email top N errors by job to relevant stakeholders.

Environment: Linux, Hortonworks Hadoop Ver 2.7.1, Oozie, Pig, Hive, Sqoop, Hbase, MapReduce, Spark, Hue, HCatalog, Oracle/MS-SQL/MySQL/Teradata, Shell Scripts, Control-M, Github, Jenkins, Gerrit

Java/.NET/Big Data - Owner

Confidential, New York, New York

Responsibilities:

• Developed .NET/Web adapters and views for VMS
• Handled importing of data from machine logs using Flume.
• Extracted the data from MySQL/RDS into HDFS using Sqoop.
• Worked with cloud services like Amazon web services (AWS) and EC2
• Developed simple to complex Map/Reduce Jobs using Java, Hive and Pig
• Build analytics queries, and exported reports to be displayed on the web.
• Involved in installation and setting up of the Hadoop cluster.
• Wrote Pig/UDF (Java) jobs in performing data cleaning, transformations and joins.
• Used Sqoop to import data into Hadoop for processing, and export for presentation.
• Installed Oozie workflow engine and set it up to run multiple Hive and Pig Jobs.
• Created Hive tables and wrote Hive queries using Hive QL
• Developed MapReduce programs to transform raw data into meaningful format used by various Hadoop ecosystems like Hive and HBase.
• Created the front-end administrative and presentation layer to display Hadoop search results.

Environment: Hadoop, Pig, Hive, Sqoop, Hbase, Java, MapReduce, ASP.Net, Javascript .Net Entity Framework, MySQL

Java/ Big Data - Hadoop Developer

Confidential, New York, New York

Responsibilities:

• Worked on .Net/JEE/Spring/Hibernate application which provided an Analytics UI and was required to run on multiple application servers.
• Joined the “Big Data IT” team responsible for building Hadoop stack and different big data analytic tools, migration from different databases ( i.e. Teradata, Oracle, MySQL) and multiple file formats (Json, XML, Text, etc) to Hadoop.
• Implemented Big Data tools within Hadoop ecosystem (HDFS, Hbase, Hive, Pig, Sqoop, Oozie, Flume).
• Senior Developer specializing in ETL, web log analysis, e commerce and Hadoop to augment and/or replace traditional relational warehouse.
• Worked with Flume for pulling log files from Application server to a central location in HDFS.
• Extensively worked with Oozie workflow manager to scheduling the Hadoop Pig and Hive jobs.
• Handled importing of data from various data sources, performed transformations using Pig, Hive, UDFs, MapReduce, and loaded data into HDFS and HBase.
• Wrote Hive Queries to analyze data in Hive warehouse using Hive Query Language (HQL). Provided support data analysts in running Pig and Hive queries.

Environment: Hadoop, HDFS, Pig, Hive, MapReduce, MRUnit, Sqoop, Cloudera manager, Linux, Cloudera CDH4, Flume, HBase, Oracle, MySQL, Teradata, .Net, Agile/Scrum, JEE, Java, Spring, Hibernate, Eclipse

.NET/Java Web Developer

Confidential, New York, New York

Responsibilities:

• Designed and developed a new C#, Java, Hibernate, ASP.NET web application utilizing .NET 4.5, JQuery, Modernizer, Bootstrap, JavaScript, XHTML and CSS. We used Microsoft SQL Server 2008 R2 for the database and SVN for source control.
• Working with a Project Manager and several other developers, I was a Senior Developer responsible for the UI design, development of C# and Java code, setting coding standards and overseeing the code developed by the other developers.
• I was also responsible for updating and maintaining an existing legacy contingent worker tracking system. The legacy application was developed in Microsoft Access 2003, VBA and Microsoft SQL Server

IT/Technical Recruiter

Confidential, New York, New York

Responsibilities:

• Performed full-cycle recruiting of IT professionals for this consulting and staffing firm: sourced, interviewed, checked s, negotiated terms and rates, extended offers, and closed candidates.
• Delivered qualified, interested and available candidates promptly and within budget for Confidential 500 clients.
• Successfully sourced resumes using traditional (referrals, internal database, etc) as well as advanced internet sourcing techniques via: Job sites, company websites, colleges, resume banks, newsgroups, search engines, home pages, virtual communities, user groups, e-mailing lists)

Senior .NET Web Developer

Confidential, Burbank, California

Responsibilities:

• Saved thousands of man hours, and simplified multiple business processes by creating extensive web-based applications for medical laboratory administrators, various departments, and clients of a largest privately-owned Medical Laboratory in California.
• Researched and developed custom software solutions to meet unique client and internal requests.
• Accountable for most of database design and development - Database Architecture, Stored Procedures, Triggers, Performance Tuning on MS-SQL.
• Created distinctive solutions by integrating in-house created software with custom / third party Active-X components.