SUMMARY

• Over 9 years of overall experience in IT as a Systems Administrator on multiple Operating systems like Linux/AIX with cross platform integration experience using Hadoop
• Over 3 years of experience in Hadoop Administration using Cloudera (CDH) & Hortonworks (HDP) Distributions
• Hands on experience in installing, configuring, and using Hadoop ecosystem components like HDFS, MapReduce, Hive, Impala, Sqoop, Pig, Oozie, Zookeeper, Sentry, Spark, Solr, Hue, Flume & Yarn distributions.
• Experience in performing backup and disaster recovery of Name Node metadata and important sensitive data residing on cluster.
• Experience in Hadoop Cluster capacity planning, performance tuning, cluster Monitoring, Troubleshooting.
• Experience in minor and major upgrades of hadoop and hadoop eco system
• Experience in Hadoop administration activities such as installation, configuration and management of clusters using Cloudera Manager & Hortonworks.
• Good Understanding of the Hadoop Distributed File System and Eco System (MapReduce, Pig, Hive, Sqoop and HBase)
• Good knowledge on Hadoop HDFS architecture and MapReduce framework.
• Experience in monitoring the health of hadoop cluster and also performing multiple administrative cluster maintenance such as commissioning /decommissioning data nodes
• Experience in importing and exporting data between HDFS and Relational Database Management systems using Sqoop and troubleshooting for any issues.
• Experience in monitoring and reviewing Log4j logs
• Setting up Kerberos principals and testing HDFS, Hive, Pig and MapReduce access for the new users
• Experience in ingestion, storage, querying, processing and analysis of Big Data using Different tools including MapReduce, YARN, HDFS, Hive, Pig, Hbase, Sqoop, Flume and Oozie.
• Providing Change, Problem & Incident Management using Tools like Remedy, Maximo, Chipre, SharePoint and Manage Now.
• Maintain and use Red Hat Kickstart servers, Jumpstart, Ignite Installation Methods and NIM Master for installs and upgrades.
• Expertise in Installation, administration, upgradation, configuration, patching, performance tuning and troubleshooting of Red Hat Linux 4/5/6, Sun Solaris 8/9/10 & AIX 5.3/6.1/7.1
• Have flair to adapt to new software applications and products, self - starter, have excellent communication skills and good understanding of business work flow.

TECHNICAL SKILLS

Big Data: Hadoop, HDFS, Map Reduce, YARN, PIG 0.8, Hive, Hbase 0.94, Zookeeper 3.4.5, Oozie, Ambari, Kerberos, Knox, Ranger, Sentry, Spark, Tez, Impala, Hue, Storm, Kafka, Flume, Sqoop 1.4.4, HCatalog, WebHChat, Solr

Hardware: IBM pSeries,pureflex,RS/6000,IBM Blade servers, Dell

Storage: Hitachi,IBM XIV,IBM Storage DS8000 & DS8300

Operating Systems: Linux, AIX, CentOS, Solaris & Windows

Services: HTTP,DNS,SMTP,FTP,SSH,Samba & SNMP

Tools: & Utilities: Managenow,Remedy,Maximo,Nagios,Chipre & SharePoint

Databases: Oracle 10g, 11g & DB2

Backups: Veritas Netbackup & TSM Backup

Network: NFS, NIM

Virtualization: Vmware,VIO

Cluster Technologies: HACMP 5.3, 5.4, Power HA 7.1

Web/Application Servers: WebSphere Application Server 5.0/6.0/7.0, Message BrokerMQ Series, Web Logic Server, IBM HTTP Server.

Cloud Knowledge: Openstack, AWS

PROFESSIONAL EXPERIENCE

Confidential, St. Louis, MO

Hadoop Administrator

Responsibilities:

• Responsible for implementation and administration of Hadoop infrastructure.
• Continuous monitoring and managing the Hadoop cluster using Cloudera Manager
• Worked with application teams to install operating system, Hadoop updates, patches, version upgrades as required
• Supported Map Reduce Programs those are running on the cluster.
• Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, HDFS, Hive, and MapReduce access for the new users.
• Inputs to development regarding the efficient utilization of resources like memory and CPU utilization based on the running statistics of Map and Reduce tasks
• Importing and exporting data into HDFS and Hive using Sqoop.
• Commission or decommission the data nodes from cluster as needed.
• Cluster coordination services through Zoo Keeper.
• Configure Cloudera manager High availability
• Configure YARN and tune YARN settings to improve performance
• Replace mapreduce1 with YARN
• Tune YARN settings for improving performance
• Upgraded Cloudera manager from CM4 to CM5
• Upgraded Cloudera hadoop cluster from CDH4 to CDH5
• Taking HDFS backup to storage (Isilon)
• Day to day support for the cluster issues and job failures.
• Working with Dev Team to tune Job Knowledge of Writing Hive Jobs.

Environment: Hadoop, Cloudera Manager, HDFS, YARN (MR2), Cloudera CDH4/5, Hive, Zookeeper, Hbase and Solr

Confidential, Minnetonka, MN

Hadoop Administrator

Responsibilities:

• Installed and configured CDH4 cluster and other Hadoop ecosystem components.
• Proactively monitored systems and services, architecture design and implementation of Hadoop deployment, configuration management, backup and disaster recovery systems and procedures
• Proactively monitored Map Reduce Programs for those are running on the cluster
• Involved in loading data from UNIX file system to HDFS
• Monitoring Hadoop cluster using Cloudera Manager
• Supported Map Reduce Programs those are running on the cluster
• Configured Namenode high availability
• Experience in cluster tuning by changing the configuration parameters.
• Defined file system layout and data set permissions.
• Importing and exporting data into across RDBMS and Hive using Sqoop
• Commissioning and Decommissioning Nodes as per requirement.
• Worked with Hadoop developers, designers in troubleshooting map reduce job failures and issues and helping to developers.
• Worked with network and Linux system engineers to define optimum network configurations, server hardware and operating system.
• Evaluate and propose new tools and technologies to meet the needs of the organization.

Environment: Cloudera Manager, MapReduce, HDFS, Hive, Spark, Oozie, Pig, Sentry, Hue, CDH5, Zookeeper and RHEL

Confidential, Oakland, CA

Hadoop Administrator

Responsibilities:

• Installed and configured Hadoop cluster in pseudo and fully distributed mode environments.
• Capturing data from existing databases that provide SQL interfaces using Sqoop.
• Implemented multipole POC clusters.
• Cluster maintenance using Ambari & Nagios
• Setting up HDFS users for performing Hive, Pig and MapReduce jobs
• Manage and review Hadoop log files.
• Hadoop File system management and monitoring.
• Installed Oozie workflow engine to run multiple Hive and Pig jobs.
• Administer Linux servers, other UNIX variants, and managed hadoop clusters.
• Worked on professional services engagements to help customers design, build clusters, applications, troubleshoot network, disk and operating system related issues.
• Upgrading OS, latest patches and packages on Ubuntu and Redhat Linux machines
• Experience in building, testing & troubleshooting on Ubuntu & RHEL platforms
• Point of Contact for Vendor escalation

Environment: Hadoop, Ambari, HDFS, Pig, Hive, Sqoop, Hbase, Ubuntu, RedHat Linux, CentOS

Confidential, Sunnyvale, CA

Unix/Linux Administrator

Responsibilities:

• Providing Change Management and Problem Management using the Tools SharePoint & Chipre.
• Installed, Configured and Maintained Red Hat /Solaris Linux (Solaris 8, 9 & 10, RedHat Enterprise Linux 4.x, 5.x & 6.0) on SPARC, x86 and HP, IBM Blade Centers.
• Kernel up gradation, Compilation, Tuning and configuring kernel parameters to optimize and enhance the Performance.
• Supported Redhat servers in Production and Development environments
• Package management, Install, remove and update and querying packages using YUM in Red Hat Linux.
• Built VIO servers & Clients through NIM installation.
• Migrating OS from AIX 5.3 to AIX 6.1 & SAN Data from Hitachi to IBM XIV.
• Migrations of Lpars from Old Hardware to New Hardware. (p570/p 5 & p6)
• Upgraded ML/TL & service packs to latest levels on AIX machines as and when required.
• Updated FC adapters for both directly SAN attached and virtual clients.
• Configuring SNMP to register the lpar as client to Nagios server.
• Experience in implementation of sendmail, Fetchmail, pop3 and imap and SMTP.
• Installed, configured and implemented Oracle RAC (Real Application Cluster) environment as per bank standards with help of Oracle DBAs
• Administration of monitoring infrastructure consisting of Nagios server with Centreon as web interface for configuration and display of performance data.
• Migrating logical volumes, mirroring VGs and LVs, copying logical volumes, export and importing volume groups.
• Working experience on LVM to create & extend logical volumes
• Experience in File system maintenance and file integrity check tools like tripwire.
• HACMP Cluster configuration, plan, design HACMP cluster nodes, Network configuration, configuring disk heart beats, non ip heart beats, performing failover testing, verification, synchronization & administration
• Installing & configuring TSM Backup client & Message Broker software on the Lpars.
• Performance tuning, capacity planning and recommendations.
• Implementation and troubleshooting of network services like IP Bonding, NFS, FTP, SAMBA, NTP, IPTABLES, Telnet, SSH.
• Managing Disk space using LVM & User Administration tasks.

Environment: Red Hat Linux 5, 6 AIX 5.3, 6.1, 7.1 pSeries Server, Solaris 8, 9, CentOS, Sun Enterprise Server, TSM, EMC Clariion, HP Proliant, Oracle 10g/11g

Confidential, Minneapolis, MN

UNIX Administrator

Responsibilities:

• Worked on Change Management and Problem Management using Tools like Remedy, Maximo & Manage Now.
• Built VIO servers & Clients through NIM installation
• Handled Patch Management to control vulnerability.
• Upgraded servers to latest ML/TL update & microcode on the frame through HMC.
• Upgraded the SDD & SDDPCM drivers & HMC to latest levels
• Upgraded HBA and other system firmware to latest levels.
• Installed and upgraded of OpenSSH 4.3p1 on AIX 5.2 and 5.3, OpenSSH 4.1p1 on AIX 5.1 servers.
• Migrated AIX oslevel from AIX 5.3 to AIX 6.1 & performed TL/ML updates.
• Managing File systems, paging spaces issues & Managing Disk space using LVM.
• Monitoring performance of AIX servers, Memory, CPU, Network and Disk activities and analyzing these reports and finding any issues that occur.
• Disk replacement techniques, replacing fault disks, working on issues on related to volume management, file system management.
• Configuring new devices, working with configuration manager (cfgmgr).
• Configuring TCP/IP AND NFS services and troubleshooting.
• Migrating and managing LV, mirroring VGs and LVs, copying logical volumes, export and importing volume groups.
• Installing new packages and file sets when required by the developers.
• Configuring cron jobs, and working on cron logs to checking for job status.
• Configuring the private repository for accessing the packages with yum.
• Package and Patch administration on the Solaris & Red Hat Linux.
• Monitoring and troubleshooting Backup failures using VERITAS Backup Exec.
• As a member of Security Compliance Team, involved in audits & User revalidations.
• Patch administration & User administration on the Linux & AIX boxes.

Environment: Red Hat Linux 5, 6 AIX 5.3, 6.1, 7.1, pSeries Server, Veritas Net Backup, Solaris 8,9, HP 9000 K, L, N Class Server, Solaris Volume Manager

Confidential, Irving, TX

Systems Administrator

Responsibilities:

• Working in 24X7 Build & Break fix production Engineering UNIX Support
• Configure and working on Solaris & AIX using SPARC & pSeries hardware
• Working experience on EMC SRDF and Hitachi data storage technologies
• Handling Incident and Change Management tickets using Service Now & remedy ticketing system
• Working Knowledge with System Performance related Issues and network availability
• Handling AIX & Solaris servers commissioning & Decommissioning requests
• Migrations of Lpars from Old Hardware to New Hardware. (p570/p 5 & p6)
• Patch administration & User administration on the AIX & Solaris boxes
• Migrating logical volumes, mirroring VGs and LVs, copying logical volumes, export and importing volume groups.
• Configuring cron jobs, and working on cron logs to checking for job status.
• Configuring new devices, working with configuration manager (cfgmgr).
• Configuring TCP/IP AND NFS services and troubleshooting.
• Monitoring performance of AIX servers, Memory, CPU, Network and Disk activities and analyzing these reports and finding any issues that occur.
• Managing AIX on production environment hosting various applications like WebSphere,
• Siebel, Inforte, Message Broker etc along with databases DB2 & Oracle.

Environment: Red Hat Linux 5, 6 AIX 5.3, 6.1, 7.1, pSeries Server, HP DLseries G8, Dell Hardware, Solaris 8/9

Confidential, Minnetonka, MN

Systems Administrator

Responsibilities:

• Installation & Maintenance of Solaris, & AIX
• Handle Incident, Problem, Change and Service tickets by using Remedy.
• User and package management.
• Managing local disk devices and file system management
• Management of system security, user and group privileges
• Systems Troubleshooting H/W ranging from PC to Enterprise Servers. configuring Jumpstart servers for complete hands-free installation of workstations, with custom profiles, begin/finish scripts, custom package suites/clusters
• Managing NFS environment with Auto mount.
• Managing NIS Master / Slave servers and Clients
• Taking backups, performing recoveries using standalone tape drives.
• Level1 monitoring and escalating issues to level2/3 teams.
• Root Disk mirroring using Solstice Disk Suite.
• Writing Shell Scripting to automate jobs

Environment: IBM AIX 4.3.3, 5.1, 5.2, Solaris 8/9/10, Red Hat Linux 4/5, Sun Enterprise Servers, SUN FIRE 6800/E6500/E4500, Sun Sparc1000, IBM RS/6000, Disk Suite.