SUMMARY:

• An overall 8+ years of experience in Information Technology industry
• 4+ years of hands on experience in Hadoop Framework and its ecosystem like Map Reduce Programming, Spark,Hive, Pig, Sqoop, Hbase, Oozie,Impala.
• Strong experience in architecture, design and development of Big Data platform including large clusters, Hadoop ecosystem projects.
• Experience in Horton works and ClouderaHadoop distributions.
• Good understanding on cluster capacity planning and configuring the cluster components based on requirements.
• Good experience installing, configuring, testing Hadoop ecosystem components.
• Managing Hadoop Services like Namenode, Zoo keeper,Datanode, Jobtracker, Tasktracker.
• Maintaining the cluster Meta Data backups and make sure we have regular backups to provide high availability of cluster and Manage and review data backups.
• Experience in analyzing data using HiveQL, Pig Latin, HBase and custom Map Reduce programs in Java.
• Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems andvice - versa.
• Tuning, and Monitoring Hadoop jobs and clusters in a production environment.
• Backup configuration and Recovery from a NameNode failure.
• Experience in managing and reviewing Hadoop log files.
• Adding/removing new nodes to an existing Hadoop cluster with proper plan without data loss.
• Extending Hive and Pig core functionality by writing custom UDFs.
• Involved in Analyzing system failures, identifying root causes, and recommended course of actions.Documented the systems processes and procedures for future references.
• Configuring Namenode high availability minimize down time
• Architected, Designed and maintained high performing ELT/ETL Processes.
• Proficient in using Cloudera Manager, an end to end tool to manage Hadoop operations.
• Experience on UNIX commands and Deployment of Applications in Server.
• Worked extensively with Dimensional modeling, Data migration, Data cleansing, Data profiling, and ETLProcesses features for data warehouses.
• Developing the Backup & Recovery strategies
• Regular backups of FSIMAGE & EDIT logs.

TECHNICAL SKILLS:

Hadoop: Hadoop 2.4.0, HDFS, Map Reduce, Zookeeper, Hive 0.13.1, Hbase, YARN, Impala

UNIX Tools: Apache, YUM, RPM.

Tools: Hadoop, Map reduce, YARN, Pig, Hive, Oozie, Zookeeper, Kerberos for Hadoop security, Job monitoring and scheduling tasks in test and production systems

Web Servers: Apache Tomcat 5.x, BEA Weblogic 8.x, IBM Websphere 6.0/5.1.1

Web technologies: DHTML, HTML, XHTML, XML, XSL (XSLT, XPATH), XSD, CSS, JavaScript

Operating Systems: Windows, OEL, Ubuntu, Centos

PROFESSIONAL EXPERIENCE:

Hadoop Administrator

Confidential, Rockville, MD

Responsibilities:

• Install, Configure and maintain Single-node and Multi-node cluster Hadoop cluster.
• Interacted with Windows server management team to setup multiple virtual Windows Application servers on a single Physical box.
• Setup cluster environment for Highly Available systems.
• Test failovers to secondary and failback to primary on VM clusters for Application and SQL VM’s
• Test Disaster recovery system by routing traffic to alternate Disaster recovery server with help of LAN team.
• Installed Apache Hadoop 2.4.2 and Apache Hadoop 2.3.0 on Linux Dev servers
• Upgrade Apache Hadoop from version 2.3.0 to 2.5.2 on Linux server
• Implementing High Availability system for Hadoop Name node
• Installing and configuring KAFKA 2.6 version
• Configuring SQOOP to import data from external database - SQL Server and MYSQL.
• Configured users on Hadoop for HDFS and Map Reduce
• Extensive knowledge on HDFS and YARN implementation in cluster for better performance.
• Setup Hive and NoSQL on remote metastore
• Integrating PIG, Hive, Sqoop on Hadoop
• Monthly Linux server maintenance, shutting down essential Hadoopnamenode and data node, job tracker and task tracker. And restarting Hadoop services including Yarn.
• Involved in snapshots and HDFS data backup to maintain the backup of cluster data and even remotely.
• Kerborised cluster to implement security.
• Good knowledge on maintain mysql databases creation and setting up the users and maintain the backupof databases.
• Assisted with performance tuning and monitoring.
• Created HBase tables to load large sets of structured, semi-structured and unstructured data coming from UNIX, NoSQL and a variety of portfolios.
• Supported code/design analysis, strategy development and project planning.
• Assisted with data capacity planning and node forecasting.
• Collaborated with the infrastructure, network, database, application and BI teams to ensure data quality and availability.
• Work with user to resolve issues related to access and jobs running on cluster.
• Work with vendor to resolve product related issues.

Environment: Centos servers, Windows Server, Apache Hadoop, Map Reduce, Yarn, PIG, Hive, Sqoop, Flume, Oozie, Zookeeper, HBase, NoSQL, MYSQL, Eclipse, Oracle Database

Hadoop Administrator

Confidential, Tampa, Florida

Responsibilities:

• Experience in Installing and Configuration of cloudera manager.
• Created work instructions for installing upgrading and applying patches for hadoop cluster.
• Experience in Upgrading hadoop cluster hbase/zookeeper from CDH3 to CDH4.
• Perform data analysis using Hive and Pig.
• Load log data into HDFS using Flume.
• Monitoring Hadoop cluster using tools like Nagio's, Ganglia and Cloudera Manager.
• Automation script to monitor HDFS and HBase through cron jobs.
• Administrating and optimizing the hadoop clusters, monitoring jobs and worked with development team to fix the issues.
• Worked extensively in creating Map Reduce jobs to power data for search and aggregation
• Designed a data warehouse using Hive
• Worked extensively with Sqoop for importing metadata from Oracle
• Extensively used Pig for data cleansing
• Created partitioned tables in Hive
• Worked with business teams and created Hive queries for ad hoc access.
• Evaluated usage of Oozie for Workflow Orchestration
• Mentored analyst and test team for writing Hive Queries
• Gained very good business knowledge on health insurance, claim processing, fraud suspect identification, appeals process etc.

Environment: Hadoop, Map Reduce, HDFS, Hive, Java (jdk1.6), Hadoop distribution of Horton works, Oozie, Oracle 11g/10g.

Junior Hadoop Administrator

Confidential, Dallas, Texas

Responsibilities:

• Hadoop installation, configuration of multiple nodes in AWS-EC2 &Hortonworks platform
• Setup and optimize Standalone-System/Pseudo-Distributed/Distributed Clusters
• Build/Tune/Maintain Hive QL and Pig Scripts for reporting purpose
• Help develop mapreduce programs and define job flows
• Manage and review Hadoop log files
• Support/Troubleshoot mapreduce programs running on the cluster
• Load data from Linux/UNIX file system into HDFS
• Install and configure Hive and write Hive UDFs
• Create tables, load data, and write queries in Hive
• Develop scripts to automate routine DBA tasks using Linux/UNIX Shell Scripts/Python (i.e. database refresh, backups, monitoring etc.)
• Tune/Modify SQL for batch and online processes
• Monitor cluster using Ambari and optimize system based on job performance and criteria
• Worked with business teams and created Hive queries for ad hoc access.
• Evaluated usage of Oozie for Workflow Orchestration
• Mentored analyst and test team for writing Hive Queries
• Manage cluster through performance tuning and enhancements

Environment: Hortonworks Hadoop (HDFS), MapReduce, AWS, Hive, Java (JDK 1.6), Flat/XML/JSON Files, PSQL, Linux/UNIX Shell Scripting

Linux System Administrator

Confidential

Responsibilities:

• Worked as a System Administrator on Linux- UNIX platforms.
• Administered Linux servers Linux (Red hat - RHEL 3/4/5/6), for several functions including managing Apache/Tomcat server, mail server, MySQL database, and firewalls in both development and production.
• Responsibilities as a Unix System Administrator include monitor and tune system to make sure of the optimum level of the performance.
• Experience in Hardware and Software refreshes on the server.
• Performed common system administration task including adding users, creating file systems, configuring volumes weekly mksysb.
• Configuration of NIS, NFS, SAMBA, SENDMAIL, APACHE SERVICES on Linux & UNIX.
• Adding Oracle ASM disk to the server. Creating and managing LVM.
• Responsible for Patching Linux Servers.
• Monitored the servers and Linux scripts regularly and performed troubleshooting steps tested and installed the latest software on server for end-users.
• Perform standard system administration tasks, such as patching, software and hardware upgrades, troubleshooting and problem resolution.
• Responsible for resolving network issues using network tools like ping, tcptraceroute, traceroute, tcpdump.
• Perform day to day Linux administration such as user accounts, logon scripts, directory services, file system shares, permissions. Support Oracle database.
• Keep a track of the appropriate software and upgrade the software packages.
• Develop and maintain the documents, library and procedural documents of the system.

Environment: RHEL, MySQL, Linux, NIS, NFS, SAMBA, SENDMAIL, APACHE SERVICES, LVM.

Junior System Administrator

Confidential

Responsibilities:

• Installation/ Maintenance of Hardware/Software in Production, Development & Test Environment as an integral part of the Solaris Support team.
• Support of Solaris 8/9/10 systems administration, operational support and problem resolution for serversystems.
• Performed daily housekeeping functions, such as establishing new accounts, creating and resetting passwords, developing scripts, performing system backups and recovery, and installing software patches and updates.
• Writing and modifying shell scripts (Perl, ksh)&cron to perform automated administration task
• Installing and maintaining ftp, SSh for SUN servers.
• Troubleshooting and analysis of hardware and software failures for various UNIX servers using utilities coredump and log file analysis.
• Maintain and troubleshoot switch and application network connectivity, UNIX infrastructure, including DNS,DHCP, LAN and TCP/IP issues, accounts and security for all applications servers.
• Applied security and functionality patches as released and recommended by vendors.
• Configured and installed Routers, Switches, and RAS equipment on a WAN and LAN level.
• Managed Volumes and configuring RAID using Solaris Management Console (SMC).
• Utilizing Solar winds to maximize network throughput, when downloading to field terminals, minimizing download times during upgrades without causing network saturation.
• Responsible for job scheduling and monitoring using Autosys solution.
• Installation of OAS (Oracle Application Server) on Solaris 9 and its configuration with oracle database.
• Explore new technologies and design methodologies that enhance the efficiency of system administration& support for my team.
• Scheduling and monitoring backup jobs for oracle DB.
• Provided afterhours and weekend support to facilitate the issues in the production environment.

Environment: Solaris 9, Perl, Cron, SUN servers, SMC, Autosys, Oracle DB