SUMMARY

• Over 7 years of strong experience in the IT industry that includes 4+ years as a Hadoop Developer in domains like advertising organization, telecommunication and Mapping
• Hands on experience with the Hadoop stack (MapReduce, HDFS, Sqoop, Pig, Hive, HBase, Flume, Oozie and Zookeeper)
• Well versed in configuring and administrating the Hadoop Cluster using major Hadoop Distributions like Apache Hadoop and Cloudera
• Experienced in deploying and configuring hadoop cluster.
• Hand on experience with installing and managing the hadoop distribution system like CDH3, CDH3 etc.
• Experience with hadoop configuration management tools like Puppet, Chef, CF Engine etc
• Proven Expertise in performing analytics on Big Data using Map Reduce, Hive and Pig.
• Experienced with performing real time analytics on NoSQL data bases like HBase and Cassandra.
• Worked with Oozie work flow engine to schedule time based jobs to perform multiple actions.
• Hands on experience with importing and exporting data from Relational data bases like Netezza, oracle, DB2, MYSQL to HDFS, Hive and HBase using Sqoop.
• Analyzed large amounts of data sets writing Pig scripts and Hive queries
• Experienced in writing MapReduce programs &UDFs for both Hive & Pig in Java
• Used Flume to channel data from different sources to HDFS.
• Experience with configuration of Hadoop Ecosystem components: Apache Phonex, Hive, HBase, Pig, Sqoop, Mahout, Zookeeper and Flume.
• Supported MapReduce Programs running on the cluster and wrote custom MapReduce Scripts for Data Processing in Java
• Experience with Testing Map Reduce programs using MRUnit, Junit and Easy Mock.
• Experienced with implementing Web based, Enterprise level applications using J2EE frameworks like Spring, Hibernate, EJB, JMS, JSF and Java.
• Excellent understanding on RIA, AJAX and Web 2.0 applications both for PC and other devices (iphone, Apple Mac).
• Expert Confidential creating web Icons.
• Excellent skills in creating interactive animations
• Hand on exercise on scripting (python and shell) to provision and spin up virtualized Hadoop clusters
• Expertise in full life cycle of Java Application Developments, Including Analysis, Requirements gathering, Design, Development, Implementation, Maintenance and Enhancements.
• Good working knowledge on Agile and water fall software development methodology.
• Excellent team Player, quick learner and self - starter with effective communication, motivation and organizational skills combined with attention to details and business process improvements.
• Proven capability to meet deadlines and adapt to new technologies quickly. Good communication and presentation skills.

TECHNICAL SKILLS

Operating system: windows, linux,Unix, VMware

Languages: C, C++, Java, SQL

Scripting Languages: Python, Unix, Java Script

Web Technologies: HTML, JavaScript, DHTML, JSP, Servelets, CSS, XML and Ajax

Data Management: Hadoop, big Query, Cassandra, postage sql

Data Acquisitions and Quality tools: Extract, Transport and Load (ETL), Teradata Parallel Transport (TPT), Tivoli workload Scheduler (TWS), Connect Direct, MRunit

Hadoop Development And Tools: HDFS, Map-ReduceHive, HBase, Pig, SQOOP,HABSE,OOZIE,ZOOKEEPER,IMPALAL, Spark, YARN, Ambari, Avro, Cassandra, Chukwa, Mahout, Tez

DBMS / RDBMS: Oracle 11g, MYSQL, Mango, HDFS, PostgreSQL, HSQLDB

Frame Work: State Machine, Structs, springs, hibernet

Application/Web Servers: Web logic, Apache Tomcat and JBoss

IDE: Eclipse, Netbeans, Rational Rose, Photoshop, Dream viewer JDeveloper, SoapUI and Flex Builder

Version Control: SVN, GIT, CVS and Rational Clear Case Remote Client V7.0.1

Tools: FileZilla, Putty, Squirrel SQL Client, PL/SQL DeveloperSQL Oracle Developer, Corbetura and PMDSummary

Methodologies: SCRUM, Agile

PROFESSIONAL EXPERIENCE

Confidential, NYC, NY

Hadoop Engineer

Responsibilities:

• Involved in Installing, Configuring Hadoop Eco System, Cloudera Manager using CDH4 Distribution.
• Responsible to manage data coming from different sources like Netezza, oracle, DB2, MYSQL and involved in HDFS maintenance and loading of structured and unstructured teradata.
• Analyzed, visualized and explored the data using visualization tools like Mahout, Congnos
• Integrated Quartz scheduler with Oozie work flows to get data from multiple data sources parallel using fork.
• Processed Multiple Data sources input to same Reducer using Generic Writable and Multi Input format.
• Created Data Pipeline of Map Reduce programs using Chained Mappers. deploy and configur hadoop cluster with enterprise nodes .
• Implemented Optimized join base by joining different data sets to get top claims based on state using Map Reduce.
• Installing of Apache Phoenix for converting HBase into SQL Database
• Installing and managing the hadoop distribution system like CDH3, CDH3 etc.
• Use hadoop configuration management tools like Puppet, Chef, CF Engine etc to configure nodes.
• Implemented complex map reduce programs to perform joins on the Map side using Distributed Cache in Java.
• Responsible for importing log files from various sources into HDFS using Flume
• Created customized BI tool for manager team that perform Query analytics using HiveQL.
• Imported data using Sqoop to load data from MySQL to HDFS on regular basis
• Created Partitions, Buckets based on State to further process using Bucket based Hive joins.
• Created Hive Generic UDF's to process business logic that varies based on policy.
• Moved Relational Data base teradata using Sqoop into Hive Dynamic partition tables using staging tables.
• Optimizing the Hive queries using Partitioning and Bucketing techniques, for controlling the data distribution
• Done scripting using python and shell to virtualize Hadoop clusters
• Worked on custom Pig Loaders and storage classes to work with variety of data formats such as JSON and XML file formats
• Experienced with different kind of compression techniques like LZO, GZip, Snappy.
• Used Oozie workflow engine to manage interdependent Hadoop jobs and to automate several types of Hadoop jobs such as Java map-reduce Hive, Pig, and Sqoop.
• Developed Unit test cases using Junit, Easy Mock and MRUnit testing frameworks.
• Experienced in Monitoring Cluster using Cloudera manager.

Environment: Hadoop, HDFS, HBase, MapReduce, Java, Hive, Pig, Sqoop, Flume, Oozie, Hue, SQL, ETL, Cloudera Manager, MySQL.

Confidential, Atlanta, GA

Hadoop Developer

Responsibilities:

• Worked on importing data from various sources and performed transformations using MapReduce, Hive to load data into HDFS
• Responsible for building scalable distributed data solutions using Hadoop Written various Hive and Pig scripts
• Created HBase tables to store variable data formats coming from different portfolios
• Performed real time analytics on HBase using Java API and Rest API.
• Implemented HBase Co-processors to notify Support team when inserting data into HBase Tables.
• Configured Sqoop jobs to import data from RDBMS into HDFS using Oozie workflows.
• Importing of data using ETL tool.
• Worked on setting up Pig, Hive and HBase on multiple nodes and developed using Pig, Hive, HBase and MapReduce
• Worked on compression mechanisms to optimize MapReduce Jobs
• Analyzed the customer behavior by performing click stream analysis and to ingest the data used flume.
• Experienced with working on Avro Data files using Avro Serialization system.
• Solved small file problem using Sequence files processing in Map Reduce.
• Implemented business logic by writing UDF's in Java and used various UDF's from Piggybanks and other sources.
• Continuous monitoring and managing the Hadoop cluster using Cloudera Manager Worked on Oozie workflow to run multiple jobs.
• Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team.

Environment: Horton works, Map Reduce, HBase, HDFS, Hive, Pig, Java, SQL, Cloudera Manager, Sqoop, Flume, Oozie, Java (jdk 1.6), Eclipse

Confidential, Boston, MA

Hadoop Developer

Responsibilities:

• Importing and exporting data into HDFS and Hive using sqoop and ETL tool.
• Involved in developing different components of system like Hadoop process involves Map Reduce & Hive.
• Defined and build job flows and data-pipelines.
• Responsible for loading unstructured data into Hadoop File System (HDFS).
• Develop interface validation process to provide validates incoming data arrival in Hadoop HDFS before kicking off Hadoop process.
• Developed Hive scripts for end user / analyst requirements for adhoc analysis.
• Used and Wrote Partitions, Bucketing concepts in Hive and designed both Managed and External tables in Hive for optimized performance.
• Solved performance issues in Hive and Pig scripts with understanding of Joins, Group and aggregation and how does it translate to MapReduce jobs.
• Involved in tuning Hive and Pig scripts to improve performance.
• Developing Hadoop cluster and map reduce programs using Combiners, Sequence Files, Compression techniques, Chained Jobs, multiple input and output API.
• The logs and semi structured content that are stored on HDFS were preprocessed using PIG and the processed data is imported into Hive warehouse which enabled business analysts to write Hive queries.
• Imported data using Sqoop to load data from MySQL to HDFS on regular basis.
• Experience in managing and reviewing Hadoop log files.
• Worked on Unix shell scripts for business process and loading data from different interfaces to HDFS
• Developed suit of Unit Test Cases for Mapper, Reducer and Driver classes using MR Testing library.
• Involved in creating Hive tables, loading with data and writing hive queries
• Involved in daily SCRUM meetings to discuss the development/progress of Sprints and was active in making scrum meetings more productive.
• Hands on experience in eclipse, VPN, Putty, winSCP, VNCviewer, etc.

Environment: Red Hat Enterprise Linux 5, Hadoop 1.0.4, Map Reduce, Hive 0.10, PIG, Shell Script, SQOOP 1.4.3, Eclipse, Java SDK 1.6

Confidential, Newyork, NY

User Interface Engineer

Responsibilities:

• Designed and developed an interface for Shared Shelf- a digital image library.
• Design and functionality using JavaScript libraries (Extjs) and widgets. Implemented the elements producing all the required HTML and CSS and ensured proper connectivity to the backend systems.
• Collaborated with the User Experience team to prototype design ideas and advise on wireframes and visual designs.
• Translated the Photoshop images into functional interfaces.
• Checked for cross-browser compatibility, security and testing.
• Worked with a team of developers in developing and maintaining the promotional area for the Confidential digital library using HTML, CSS, and JavaScript and SVN Version Control system.

Environment: HTML4, DHTML, XHTML, JAVASCRIPT, EXT JS, SVN Version Control, CSS2, PHP, Adobe Photoshop CS2, Dream Weaver MX, Web 2.0, Windows XP, and Windows 2003.

Confidential

Web UI Developer

Responsibilities:

• Designed and developed company's identity elements and propagated them across all media
• Authored and created marketing materials and business-to-business presentations Establish, influence, and implement corporate-wide visual principles and requirements Create, maintain and direct the overall design elements of corporate media, projects and products.
• Review UI design flow-charts, suggest alternative UIs, create & distribute interactive proof-of-concept UI components for team review.
• Develop concepts for the user interface of web products, and marketing and sales related projects.
• Designed web site mock-ups, navigation buttons, etc using Adobe Photoshop.
• Design and implementation of XHTML templates for server driven content, Implementation of CSS-based layouts and styles.
• Created layout for the web pages using JavaScript and dynamic CSS.
• Written Ajax, DHTML, and XHTML for most of the web pages.
• Wrote CSS compatible for IE and Firefox browsers.
• Design and implementation of various interactive elements ofincluding AJAX search using JSON, JSP and Servlet.
• Developed applications for mobile devices using JSP, Procmail, XHTML, and CSS.
• Executed approved design, developing both applications with JSP, JavaScript, and HTML, generating reports with SQL, PL/SQL, and HTML/JSP/JavaScript, MS Query/MS Excel or Oracle Reports, managed all QA processes and transition plans.
• Re-Designed the NPM flow over Interface module, which gathers data from upstream and send it down to the UI using Java, XML and Castor XML Parsing Framework. Resulted in 100 times performance improvement.
• Implemented the build script for subprojects, creating war using ANT.
• Used Logging API (Log4j) for logging purpose in Testing Web Application.
• Used Subversion SVN for CVS.
• Deployed Applications (WAR, JAR, and EAR) in Domain and Clustered environment.

Environment: JavaScript, CSS, XHTML, DHTML, JSP, Java, ServletAjax, Photoshop, Edit plus, W3c Validator, windows, Tomcat, Unix, Linux, Oracle, XML, XSLT, JUnit.