We provide IT Staff Augmentation Services!

Hadoop Administrator Resume

Long Beach, CA

SUMMARY:

  • 7 years of experience with proven expertise in system development activities including requirement analysis, design, implementation and supporting with emphasis on, SQL and Hadoop(HDFS, Map Reduce, Pig, Hive, Impala, Hbase and Sqoop) technologies.
  • Experienced in installing, configuring, and administratingHadoopcluster of majorHadoopdistributions.
  • Good knowledge on Oozie, Flume and Zookeeper
  • Good knowledge on data analysis with R.
  • Familiarity with networks: TCP/ IP Firewall, DNS.
  • Assisted in designing, development and architecture of Hadoop systems.
  • Coordinated with technical teams for installation of Hadoop and third party related applications on systems
  • Working experience with large scale Hadoop environments build and support including design, configuration, installation, performance tuning and monitoring.
  • Good Knowledge in Hadoop, Pig, Hive, Sqoop, Yarn and designing and implementing Map/Reduce jobs to support distributed data processing and process large data sets utilizing the Hadoop cluster.
  • Good knowledge on Apache Hadoop Cluster planning which includes choosing the Hardware and operating systems to host an Apache Hadoop cluster.
  • Expertise in developing applications using J2EE Architectures / frameworks like Struts, Spring Framework and SDP (Qwest Communications) Framework.
  • Excellent Java development skills using J2EE, J2SE, Servlets, JSP, EJB, JDBC.
  • Experience in database design using PL/SQL to write Stored Procedures, Functions, Triggers and strong experience in writing complex queries for Oracle 8i/9i/11g.
  • Proficient in writing PL/SQL code (Stored Procedures, Packages, Triggers etc.,) in retrieving data efficiently from database.
  • Worked on different OS like UNIX/Linux, Windows XP, and Windows Sound Relational Database concepts and extensively worked with ORACLE, DB2. Very good in writing complex SQL queries and PL/SQL procedures.
  • Implemented Java Webservices (JAX - WS and JAX-RS).
  • Experience in Agile Engineering practices.
  • Good understanding of Scrum methodologies, Test Driven Development and continuous integration

TECHNICAL SKILLS:

Bigdata: Hadoop (MapReduce, HBASE, HDFS, Sqoop, Hive, oozie, flume, PIG, Zookeeper).

Distributions: Cloudera, Apache Hadoop.

NoSQL Data Stores: HBASE, CouchDB

Scripts: Pig.

Programming Languages: C, C++, Core Java, SQL, PIG, PL/SQL.

Databases: Oracle 11g/8i/9i, MY SQL, MS SQL server.

IDE s & Utilities: Eclipse, JCreator and NetBeans.

Web Dev. Technologies: HTML, XML.

Protocols: TCP/IP, UDP, HTTP and HTTPS.

Operating Systems: Linux, Unix, MacOS, WINDOWS 98/00/NT/XP/7/8.

PROFESSIONAL EXPERIENCE:

Confidential, Long beach, CA

Hadoop Administrator

Responsibilities:

  • Worked on analyzing Hadoop cluster and different big data analytic tools including Pig, Hbase database and Sqoop.
  • Responsible for building scalable distributed data solutions using Hadoop.
  • Implemented nine nodes CDH4 Hadoop cluster on Ubuntu LINUX.
  • Involved in loading data from LINUX file system to HDFS.
  • Worked on installing cluster, commissioning & decommissioning of datanode, namenode recovery, capacity planning, and slots configuration.
  • Supported technical team members for automation, installation and configuration tasks.
  • Provided technical assistance for configuration, administration and monitoring of Hadoop clusters.
  • Implemented a script to transmit sysprin information from Oracle to Hbase using Sqoop.
  • Implemented test scripts to support test driven development and continuous integration.
  • Worked with application teams to install operating system, Hadoop updates, patches, version upgrades as required.
  • Assisted in designing and development of technical architecture, requirements and statistical models using R.
  • Coordinated with end users for designing and implementation of analytics solutions using R as per project proposals.
  • Responsible to manage data coming from different sources.
  • Involved in loading data from UNIX file system to HDFS.
  • Load and transform large sets of structured, semi structured and unstructured data
  • Cluster coordination services through Zookeeper.
  • Experience in managing and reviewing Hadoop log files.
  • Installed Oozie workflow engine to run multiple Hive and pig jobs..
  • Analyzed large amounts of data sets to determine optimal way to aggregate and report on it.

Environment: Hadoop, HDFS, Pig, Hive, Sqoop, HBase, Shell Scripting, Ubuntu, Linux Red Hat.

Confidential, Chandler, AZ

Hadoop Admin

Responsibilities:

  • Gathered the business requirements from the Business Partners and Subject Matter Experts.
  • Involved in installing CDH3 Hadoop Ecosystem components.
  • Responsible to manage data coming from different sources.
  • Supported Map Reduce Programs those are running on the cluster.
  • Assisted in designing, development and architecture of Hadoop systems.
  • Coordinated with technical teams for installation of Hadoop and third party related applications on systems
  • Involved in HDFS maintenance and loading of structured and unstructured data.
  • Installed and configured Pig and also written PigLatin scripts.
  • Imported data using Sqoop to load data from MySQL to HDFS on regular basis.
  • Developed Scripts and Batch Job to schedule various Hadoop Program.
  • Utilized Agile Scrum Methodology to help manage and organize a team of 4 developers with regular code review sessions.
  • Weekly meetings with technical collaborators and active participation in code review sessions with senior and junior developers.

Environment: Java Hadoop, MapReduce, HDFS, Hive, Java (jdk1.7), Pig, Linux, XML, MySQL, MySQL Workbench.

Confidential, Los Angeles, CA

Linux / UNIX Administrator

Responsibilities:

  • AIX 5.x, Red Hat Linux, RHEl and Solaris 9/10 server’s administration.
  • UNIX Administration- maintaining around 1000 Production environment including IBM AIX & RHEL 4.x and 5.x servers. Managing their memory / CPU load, Disk Space, swap space, processes etc running on them.
  • Installation, configuration & administration of Red Hat Linux 8/ 9/ RHEL 4.x,5.x, AIX 5.1/5.2 and Solaris 8/9 servers.
  • Extensive experience on installation, configuration and maintenance of Squid proxy.
  • Manage Servers using HMC/WebSM and create LPARS.
  • Building Servers using NIM from mksysb or spot in AIX.
  • Configure servers to use HTTP, DNS, NFS, NetBackup, and Storage Disk configuration.
  • Creating &administer user accounts, SUDO access, etc.
  • Managing file systems; grow them on fly using LVM on AIX and Linux.
  • Diagnose and correct boot failures arising from boot loader, module, and file system errors on Linux.
  • K Shell scripting of error logs, print queue checking, and disc space status via email routing.
  • Technical lead, overseeing development of PHP, Perl- based website and other directory sites operated by Cerner Corporation.
  • Installed and maintain Puppet-based configuration management system. Designed and deployed the Nagios implementation, Implemented Puppet modules to automate configuration of a broad range of services.
  • Responsible for installation, configuration, administration, performance tuning, troubleshooting, and maintenance of RHEL 4.x and 5.x systems, Red Hat Enterprise Linux Satellite Servers.
  • Mirror the root volume group in AIX and use it for redundancy.
  • Configure HACMP for a clustering environment on AIX servers.
  • Performing O/S upgrades and Maintenance level upgrades.
  • Use ILO/HMC for remote access of servers on Linux/AIX respectively.
  • Troubleshoot hardware, software and Operating system related errors on Linux and AIX.
  • Troubleshooting AIX/Linux network problems.
  • Installed and configured monitoring tools Big Brother and nagios for monitoring the network bandwidth and the hard drives status.
  • Maintain & troubleshoot SAN and Fiber card related errors on AIX.
  • Maintain & troubleshoot Storage Disks from IBM, HITACHI, and EMC Disk arrays.
  • Installed MultiplePathing (MPIO) software such as EMC Powerpath, HDLM.
  • Configured Bonding in Linux and Ether-channel in AIX.

Environment: IBM AIX 4.3.3, 5.1, 5.2, Solaris 8/9, RHEL 3.X, 4.X, Oracle 8i, 9i,MySQL, Apache 2.x, LPARS, VMware ESX Server, Veritas Volume Manager, NIM, Kick Start, HACMP, HMC, WebSphere. IBM P510, P670, P690, P550, P570, P590, HP DL320, HP DL330, HP DL 380s .EMC Symmetrix, Hitachi, IBM arrays, Linux Satellite Servers, Informix 7.x, 11.x, munin, Nagios.

Confidential

UNIX/LINUX Administrator

Responsibilities:

  • Installation and configuration of Red Hat Enterprise Linux (RHEL) 5x, 6x Servers on HP, Dell Hardware and VMware virtual environment
  • Installation, setup and configuration of RHEL, CentOS, OEL and VMware ESX on HP, Dell and IBM hardware
  • Installation and Configuration of Sun Enterprise Servers, HP and IBM Blade Servers, HP 9000, RS 6000, IBM P series
  • Expertise in enterprise class storage including SCSI, RAID and Fiber-Channel technologies
  • Configuration and maintenance of virtual server environment using VMWAREESX 5.1/5.5, VCenterVSphere
  • Involved in supporting different HW ranging from Rack to Blade and also supported Vblock HW to run ESX environment
  • Configured Enterprise UNIX/LINUX systems in heterogeneous environment (Linux (Redhat&SUSE), Solaris, HP-UX) with SAN/NAS infrastructure across multiple sites on mission business critical systems
  • Created a standard kickstart based installation method for RHEL servers. Installation includes all changes required to meet company’s security standards. Installation method is possible over HTTP, or via PXE on a separate network segment
  • Adding SAN using multipath and creating physical volumes, volume groups, logical volumes
  • Storage Provisioning, Volume and File system Management using LVM, VERITAS Volume Manager and VERITAS File system (VERITAS Storage Foundation), Configuring ZFS file systems
  • Creating user accounts, user administration, local and global groups on Solaris and Red Hat Linux platform
  • Setup, Implementation, Configuration, documentation of Backup/Restore solutions for Disaster/Business Recovery of clients using TSM backup on UNIX, SUSE &Redhat Linux platforms.
  • Installed and configured Netscape, Apache web servers and Samba Server
  • Installed and Configured WebSphere Application servers on Linux and AIX
  • Installation and configuration MySQL on Linux servers.
  • Performed quarterly patching of Linux, AIX, Solaris and HPUX servers on regular schedule
  • Heavily utilize the LAMP stack (Linux,Apache,Mysql,PHP/Perl) to meet customer needs
  • Installation and configuration of Oracle 11g RAC on Red Hat Linux nodes
  • Installed and configured different applications like apache, tomcat, JBoss, xrdp, WebSphere, etc.. and worked closely with the respective teams
  • Setup, Implementation, Configuration of SFTP/FTP servers
  • Setting up JBoss cluster and configuring apache with JBoss on RetHat Linux. Proxy serving with Apache. Troubleshooting Apache with JBoss and Mod jk troubleshooting for the clients
  • Installed Jenkins and created users and maintained Jenkins to deploy Java code developed by developers and build framework.
  • System performance monitoring and tuning.
  • Working on Shell and perl scripts
  • Setting up the lab environment with Tomcat/Apache, configuring the setup with F5 virtual load balancer for customer application
  • Document all system changes and create Standard Operating Procedure (SOP) for departmental use. Resolve all helpdesk tickets and add/update asset records using Remedy Action Request System
  • Provide 24x7 oncall production support on rotation basis.

Environment: Redhat 4x, 5x, Solaris 9/10, AIX, HP-UX, VMware ESX 5.0/5.1/5.5, VSphere,HPProLiant Servers DL 380/580, Dell Servers (R series),Windows 2008 sever, EMCClariion, Netapp, SCSI, VMWare converter, Apache Webserver, F5 load balancer, oracle, MySQL, PHP, DNS, DHCP, BASH, NFS, NAS, Spacewalk, WebSphere, WebLogic, Java, Jenkins, JBoss, Tomcat, Kickstart.

Confidential

Linux Administrator

Responsibilities:

  • Performed Red Hat Enterprise Linux, Oracle Enterprise Linux (OEL), Solaris, and Windows Server deployment to build new environment by using Kickstart and jumpstart.
  • Preformed Installation, adding and replacement of resources likeDisks, CPU’s and Memory, NIC Cards, increasing the swapandMaintenanceof Linux/UNIX and Windows Servers.
  • Implemented NFS, SAMBA file servers and SQUID caching proxy servers
  • Implemented centralized user authentication using OpenLDAP and Active Directory
  • Worked withVMware ESX ServerConfigured for Red Hat EnterpriseLinux.
  • Configured IT hardware- switches, HUBS, desktops, rack servers
  • Structured datacenter stacking, racking, and cabling
  • Install, configured, troubleshoot, and administer VERITAS and Logical volume manager and managing file systems.
  • Monitored system performance, tune-up kernel parameter, added/removed/administered hosts and users
  • Created and Administered user Accounts using native tools and managing access using sudo.
  • Actively participated and supported in the migration of 460+ production servers from old data center to New Data Center
  • Involved in using RPM for package management and Patching.
  • Creating documentation for datacenter hardware setups, standard operational procedures and security policies
  • Create and maintain technical documentation for new installations and systems changes as required

Environment: RHEL 3/4/5, Solaris 8/9, ESX 3/4, HP DL 180/360/580 G5, IBM p5 series, Fujitsu, M4000, EMC Symmetrix DMX 2000/3000, Linux Satellite Server