We provide IT Staff Augmentation Services!

Lead Bigdata Hadoop Architect Resume

5.00/5 (Submit Your Rating)

Richmond, VA

SUMMARY:

  • Over 14 years of IT experience including Hadoop System administration, HDFS Cluster Administration, RedHat Enterprise LINUX Systems Administration, HP - UX Systems Administration, Sun Solaris Systems Administration and AIX Server Administration, Server/VM build, Deployments.
  • Coordinated and directed projects, made detailed plans to accomplish tasks and goals as needed.
  • Build BigData Hadoop clusters(HDFS), Redhat GlusterFS, Docker Containers etc.
  • Involved in Backup Administration and project engineering.
  • Closely worked with different branches of IT operations such as Network engineering, Network monitoring, Database services, Systems Administration, Application Teams, Change management, Middleware & Systems performance etc.
  • Worked as Architect, Sr. Unix/Linux Systems Administrator in heterogeneous SAN environment comprising HP-UX, SUN, AIX, RedHat Enterprise Linux, Red Hat Enterprise Virtualization, Centos, AIX and also lead UNIX SME team.
  • Worked on Hadoop HDFS cluster installed and configured nodename and datanodes, secondary nodnames in Master slave architecture (Distributed Frame Work).
  • Extensively worked on Red Hat Virtualization technology, VMs RHEVM, RHN Satellite server, XEN Hypervisor, KVM Hypervisor, VMware, ESX and vSphere (snapshot/cloning etc), vCenter Orchestrator 5.1.0 and vCloud Director.
  • AWS (Amazon Web Services) Cloud computing EC2.
  • OCFS2 and Automatic Storage Management (Oracle ASM) on RedHat Linux.
  • Worked on Redhat Firewall configuration using IPTABLES.
  • Extensively Worked on Physical servers to Virtual server’s conversion (HP/SUN to RedHat).
  • IBM Edge Universal Load balancer configured on Linux servers.
  • Extensively Worked on LVM (HP/Linux/AIX) and VERITAS Volume manager (SUN).
  • LDAP-UX integration with AD server.
  • Storage migration using OpenMigrator and LVM.
  • Installations and configurations of multi-vendor software and applications support.
  • Installed and configured GroundWork using open source packages like JBOSS, Apache, Nagios, Cacti, and MySQL.
  • Used automation tools like SPLUNK, NewRelic, Puppet, Cfengine, VMWare, vCenter, RHEL Satellite.
  • Installed and set up PostgreSQL 9.2 on RedHat Enterprise Linux servers.
  • Worked on Red Hat cluster GFS and High Availability HA Cluster.
  • Supported 24/7 Datacenter environment.
  • Change and Configuration Management CCM.

TECHNICAL SKILLS:

HARDWARE: DELL PowerEdge 1950, 2600, 2850, 2950, 6850, R900, R910. HP-UX- 10.20/11.0/11 i/11.23, 9000 Series N4000, RP3410, RP3440, RP5470, RP8400, RP7400, HP ProLiant BL460c, BL480c, HP Superdomes, SUN Enterprise E220R, E450, E4500, E5500 Sun ultra 30, 60, 80, A1000, IBM RS 6000, IBM System P Series.

SOFTWARE: AWS (Amazon Web Services) EC2, Red Hat Enterprise Linux v.5/6, RHEV, XEN, VMware, CENTOS v5/6, Dell OpenMAnage,EMC Solution Enabler, EMC PowerPath, Open Migrator, HP-UX- 10.20/11.0/11 i, SUN Solaris 2.6, Solaris 2.7, Solaris 8i/9. HP-UX MC/Service Guard, OmniBack 3.5/4.0, HP Open View Dataprotector 5.5, HP Open View NNM 6.20, Veritas Backup Exec 10.0, Veritas Net Backup 6.5, TeamQuest 10.3, BMC Patrol, NET-SNMP, ActiveXperts Network Monitor 5.40/5.5, Veritas VxVM, Weblogic 4.0, Websphere 6.0/6.1, Webmethods, Apache Tomcat 5.x/6.x, Siteminder ver6.0/12.0 and F5 Load Balancer, PostgreSQL 9.2 database.

EXPERIENCE:

Confidential, Richmond, VA

Lead BigData Hadoop Architect

Responsibilities:
  • Lead BigData Hadoop/YARN Operations and managed an off-shore team.
  • Upgraded HDFS YARN cluster from version 5.1 to version5.2 and 5.2 to 5.2.1
  • Managed YARN Cluster Resource Manager, Node Manager, Application Master, Job History server, Namenode, datanode, zookeeper services through Cloudera Enterprise Manager and CLI.
  • Implemented Kerberos security and integrated with Centrify for security and AD authentication.
  • Used Cloudera Manager for Day-to-day Cluster operations management and node health monitoring.
  • Decommission and re-commission of cluster nodes.
  • Provided assistance and guidance in fine tuning the cluster.
  • Installed and configured Hadoop Framework HDFS, YARN, Master (Namenode) and Slave (Datanodes), Mapreduce MRv1 and MRv2 (YARN) HUE and eco system components Hive, PigLatin, Sqoop, Spark, Flume, Spark, Storm..etc.
  • Configured and managed Datanode, Namenode high availability (HA) & HDFS/YARN cluster.
  • Installed and configured Redhat GlusterFS distributed cluster and build Docker and containers.
  • Installed and configured NoSQL like MongoDB database in the environment.
  • Worked with the Systems Engineering team to plan and deploy new Hadoop hardware and software environments and expanded existing Hadoop environments.
  • Monitored health of the cluster, Preventive maintenance steps have been taken as needed, viewed cluster logs and troubleshoot issues.
  • Hadoop User Administration: Worked with data center provisioning teams to setup new Hadoop users (LDAP). This includes setting up Linux users, setting up Kerberos principals, and testing HDFS, Hive, Pig, spark and MapReduce access for the new users.
  • Coordinated Hadoop installations/upgrades and patch installations.
  • Installed, configured and implemented Hadoop Security on HDFS cluster.
  • Installed and configured HIVE, PIG, SQOOP, SPARK on Hadoop clients.
  • Monitored multiple Hadoop cluster environments (Test/DEV/PROD ) using Cloudera Manager Enterprise, HP Sitescope. Also, worked with data center operations teams to resolve server hardware and software issues as needed.
  • Worked Hadoop users, developers, Data analysts and Data Scientists on hadoop related issues and provided resolutions/recommendations.
  • Worked with Vendor Cloudera RCAs and maintained a RUN Book.
  • Created and reviewed standard operating procedures for Cluster maintenance and operation support.

Confidential, Arlington, VA

Sr. Linux/Hadoop Administrator

Responsibilities:
  • Supported in designing and architecture of BigData Cloudera Hadoop, YARN, HBase, MapReduce, Zookeeper.
  • Installed and configured Hadoop Framework HDFS Master (Namenode) and Slave (Datanodes), Mapreduce MRv1, YARN and eco system components Hive, PigLatin, Sqoop, Flume..etc.
  • Configured and managed Datanode, Namenode high availability (HA) & HDFS cluster.
  • Worked with the Systems Engineering team to plan and deploy new Hadoop hardware and software environments and expanded existing Hadoop environments.
  • Monitored health of the cluster, viewed cluster logs and troubleshoot issues.
  • Worked with data center provisioning teams to setup new Hadoop users (LDAP). This includes setting up Linux users, setting up Kerberos principals, and testing HDFS, Hive, Pig and MapReduce access for the new users.
  • Coordinated Hadoop installations/upgrades and patch installations.
  • Installed, configured and implemented Hadoop Security on HDFS cluster.
  • Installed and configured HIVE, PIG, SQOOP, on Hadoop clients.
  • Monitored multiple Hadoop cluster environments (Test/DEV/PROD ) using Cloudera Manager Enterprise, Dell Open Manage and other tools. Also, worked with data center operations teams to resolve server hardware and software issues as needed.
  • Performance monitoring and tuning of a HDFS cluster.
  • Coordinate with production application operators/admins and development teams to resolve application specific issues.
  • Resolved day-to-day issues as needed.
  • Used AWS (Amazon Web Services ) Cloud computing EC2 for provisioning like new instance (VM) creation.
  • Used puppet tool for configuration management.
  • Applied patches, firmware, version upgrades etc.
  • Used automation tools like SPLUNK, NewRelic to monitor system health and dynamic logs view and troublesshoot..
  • Installed and configured PostgreSQL 9.2 on RedHat Enterprise Linux servers.
  • Used vCenter Orechetrator, VCOPS, Hyperic APPINSIGHT and vCloud director for visualization needs.
  • Managed Apache/JBOSS web and application servers.
  • Integrated and implemented server solutions and server components such as proxy servers, web servers, application servers and database servers.
  • Unix/Linux Production/DEV/Test Environment support.
  • Provided production support to all Confidential applications and resolved issues as per SLAs.
  • Provided Unix support for Middleware servers (JBOSS, Apache,Websphere).
  • Troubleshooting OS/Networks issues.
  • Managed change requests and Incident tickets using ServiceNow ticketing system.

Confidential, VA

Sr. Linux Systems Administrator

Responsibilities:
  • Trained in Cloudera Hadoop and worked on building a PROTO type HDFS cluster of 15 nodes .
  • Implemented Hadoop HDFS framework and installed and configured eco system components, Master Slave environment.
  • Worked with JAVA code developers, Data analysts and Data scientists and provided support on HDFS related issues and debugging error logs etc
  • Installation and configurations on HP-UX 11.0, 11.20, 11.31, Linux Red Hat Enterprise v.3/4/5/6
  • O.S Installation up-gradation and Firmware upgrade.
  • Day to day UNIX administration on HPUX/LINUX servers.
  • UNIX/Linux VG/LV/FS management, worked extensively on vgextend/lvextend etc.
  • Installed and configured BMC Patrol, NET-SNMP, PowerPath and EMC Solutions Enabler, SYMCLI on Linux/UNIX hosts.
  • Worked on Virualization technologies, creating Linux virtual machines (VMs) and Linux VMs using VMWARE vSphere, RHEVM, XEN and KVM.
  • Configured Redhat repositories as needed.
  • Installed Dell OpenManage Systems management software on physical servers.
  • Configured Multipath, powerpath and NIC/HBA etc.
  • Unix/Linux Production Environment support.
  • Supported multiple applications in 24/7 environment.
  • Bonding and GigE: Configured NIC to GigE speed and bonded the interfaces.
  • Managed Redhat Firewall configuration using IPTABLES.
  • Configured Multipath on Linux servers.
  • Built Linux physical servers using KickStart configuration.
  • Built VMs (Linux Virtual Machines) using XEN, RHEV & VMware/vSphere. Configured Kickstart that makes standard base line all Linux servers in an Enterprise.
  • Cloned servers using vSphere (VMware)
  • Crated Repo servers and built and managed Redhat Satellite server.
  • Built new Linux servers using kickstart, RHN satellite server and installed RPM packages on Red Hat Enterprise Linux servers. Installed patches using RPM/YUM.
  • LVM management like create new filesystems, extend a filesystem, extend volume group on Redhat Linux servers.
  • Filesystems management, export and import volume groups.
  • UNIX supports on Oracle 10G/11G upgrades on Redhat Linux servers.
  • Installed Oracle client on RedHat Enterprise Linux servers.
  • Installed and configured PostgreSQL on RedHat Enterprise Linux servers.
  • Patch installation and firmware upgrades and managed patches.
  • User profile Administration and user security implementation.
  • Server hardening and PRR Production readiness review.
  • Server commissioning and decommissioning.
  • Disk space management, extending VGs and file systems etc.
  • Problem management and implementation of changes to the storage operational infrastructure.
  • Managing change requests Using REMEDY.
  • Change and Configuration Management CCM.

Confidential, Alexandria, VA

Sr. UNIX/Linux Systems Administrator/Engineer

Responsibilities:
  • Lead UNIX/Linux SME (Subject Matter Expert) team and resolved day-to-day issues as needed.
  • Coordinated and directed projects, made detailed plans to accomplish tasks and goals, directed the integration of technical activities and negotiated the preparation of project technical specifications. All customer requests were handled and assigned to team members and prioritized tasks and delivered as per SLAs.
  • Coordinated and worked with different team leads like Network engineering, Network monitoring, Database services, Systems Administration, Change management, Middleware & Systems performance to accomplish tasks and to resolve issues as needed.
  • Assessing server loads and worked with technical leads SDLs to develop tuning recommendation.
  • IBM Edge Universal Load balancer (IBM ULB) configured on Linux servers.
  • Bonding and GigE: Configured NIC to GigE speed and bonded the interfaces.
  • Managed Redhat Firewall configuration using IPTABLES.
  • Configured Multipath on Linux servers.
  • Built Linux physical servers using KickStart configuration.
  • Built VMs (Linux Virtual Machines) using XEN, RHEV & VMware/vSphere. Configured Kickstart that makes standard base line all Linux servers in an Enterprise.
  • Cloned servers using vSphere (VMware)
  • Built Redhat clusters, GFS..etc
  • Conducting server builds and operation and maintenance coordinate server installations as per the application requirements. Creating change requests and requests for service from external and internal service providers.
  • Implemented Kernel tuning for systems optimal performance on Redhat Linux servers as per application need.
  • Installation and configurations on Linux CENTOS, Red Hat Enterprise v.3/4/5/6
  • O.S Installation up-gradation and Firmware upgrade.
  • Day to day UNIX administration on LINUX servers.
  • Linux VG/LV/FS management, worked extensively on vgextend/lvextend etc..
  • Installed and configured BMC Patrol, NET-SNMP, PowerPath and EMC Solutions Enabler, SYMCLI on Linux/UNIX hosts.
  • Implemented Server consolidation, Storage consolidation projects, P2V migration projects,
  • Worked on Virualization technologies, creating Linux virtual machines (VMs) and Linux VMs using VMWARE vSphere, RHEVM, XEN and KVM.
  • Configured Redhat repositories as needed.
  • Installed Dell OpenManage Systems management software on physical servers.
  • Worked on MC/ServiceGuard High Availability Cluster.
  • Configured Multipath, powerpath and NIC/HBA etc.
  • Unix/Linux Production Environment support.
  • Supported multiple applications in 24/7 environment.
  • Installation and configurations on HP-UX 10.20/11.0/11 i, Linux Red Hat Enterprise v.3.x, v4.x, v5.x, v6.3, and Sun Solaris 8.0/ 8i/9.0.
  • Crated Repo servers and built and managed Redhat Satellite server.
  • Built new Linux servers using kickstart, RHN satellite server and installed RPM packages on Red Hat Enterprise Linux servers. Installed patches using RPM/YUM.
  • Installed/upgraded/configured Cleaercase, Middleware MQ, Websphere, Veritas Netbackup, EMC Powerpath, Dell Openmanage and Capacity planning Software TeamQuest etc on Redhat Linux 4.x/5.x/6.x
  • LVM management like create new filesystems, extend a filesystem, extend volume group on Redhat Linux servers.
  • Filesystems management, export and import volume groups.
  • UNIX supports on Oracle 10G/11G upgrades on Redhat Linux servers.
  • Installed and configured PostgreSQL database on RedHat Enterprise Linux servers.
  • Configured LDAP on HP-UX servers. LDAP-UX integration with eDirectory server on HPUX 11.31 servers.
  • Patch installation and firmware upgrades and managed patches on HPUX/AIX/Linux servers.
  • Performed IGNITE backup on all HP-UX servers.
  • Installed and configured HP MC Service Guard cluster.
  • User profile Administration and user security implementation.
  • Server hardening and PRR Production readiness review.
  • Server commissioning and decommissioning.
  • Disk space management, extending VGs and file systems etc.
  • Problem management and implementation of changes to the storage operational infrastructure.
  • Participated in storage capacity, measurement and planning.
  • Implemented cluster Red Hat Linux Cluster.
  • VERITAS Netbackup 6.5 client/server configuration, storage node configuration, scheduling backup configuration for linux servers.
  • Managing change requests Using REMEDY.
  • Change and Configuration Management CCM.
  • Troubleshooting and documentation and responded system alerts.

Confidential, Glenn Allen, VA

Sr. UNIX/Linux Administrator

Responsibilities:
  • Extensively worked with Solution Architects on multiple projects and provided UNIX support as needed.
  • Installation and configurations on HP-UX 10.20/11.0/11 i, Linux Red Hat Enterprise v.3, and Sun Solaris 8.0/ 8i/9.0.
  • O.S Installation and up-gradation.
  • NPAR and VPAR configuration on HP-UX and AIX servers.
  • Extensively worked on Server consolidation and Storage consolidation.
  • Supporting an Enterprise Storage environment (EMC SAN) comprising DMX3000/DMX3/IBMFastT during server/storage migrations. Used utilities like openmigarator, symcli, inq, syminq etc.
  • Unix Production Environment support.
  • Supported multiple applications (SAS, Teradata) and projects in 24/7 environment.
  • Actively involved in Server consolidation, Oracle license consolidation and enterprise storage migrations Confidential Confidential datacenters.
  • Supported Clearcase, Middleware MQ and Teradata etc.
  • LVM management on HP-UX and Linux servers.
  • Filesystems management, export and import volume groups.
  • Upgraded Confidential applications as needed.
  • UNIX support on Oracle 10G upgrades.
  • Patch installation on HP-UX servers ( 10.20/11.0/11 .11i/ 11.23/11.31 ) and managed SD-UX patch depots.
  • Performed IGNITE backup.
  • User profile Administration and user security implementation.
  • Built new servers and implemented server hardening.
  • Server commissioning and decommissioning.
  • Supported Storage migration from EMC DMX3000 and IBMFasT to DMX3 Symmetrix Frames.
  • Disk space management and LVM management.
  • Installed and configured EMC SYMCLI, PowerPath and TimeFinder.
  • Involved in Datacenter storage consolidation.
  • Participated in storage capacity, measurement and planning.
  • Managing change requests Using HPOV Service desk HPSD.
  • Change and Configuration Management CCM.
  • Involved in BCE Business Continuity Exercise (DR).

Confidential, Alexandria, VA

UNIX Systems Administrator

Responsibilities:
  • System administration on HP-UX, SUN, Linux Servers.
  • HP Open View Omniback 3.5/4.0 and DataProtector 5.0/5.1/5.5 backup monitoring and scheduling backups.
  • Installed and configured backup Cell server 0n HP RP5470 server.
  • Installed and configured backup clients locally and remotely on various HP-UX, Linux and Windows NT/2000/2003 servers in SAN environment.
  • Configured and extended Omniback database as per the requirement.
  • Extensively used Omniback utilities for routine backup administration.
  • Monthly test restore has been performed to validate the backed up data.
  • Upgraded from Omniback 4.0 to Dataprotector 5.0/5.1/5.5
  • Installation and configurations on HP-UX 10/11.0/11i and Linux Fedora Core 3.
  • O.S Installation and up-gradation.
  • Extensively worked on Server and Storage consolidation.
  • Installed and configured SAS, Teradata, Clearcase, MQ, Websphere, webmethods, Weblogic and TSM etc.
  • Patch installation and management of SU-UX patch Depots.
  • Kernel parameters tuning using SAM.
  • User profile Administration and user security implementation.
  • Configured backup specifications and created device drivers for tape libraries.
  • Supported NOC Network Operation Center (Data Center) for nightly backup 24/7 in a heterogeneous Enterprise SAN environment comprising SUN, HP, Windows, Linux servers.
  • Back up and restoring the Unix File systems and windows file structures.
  • Handled all restore/recovery requests on Windows, Linux, HP-UX and Sun Solaris Servers.
  • All Windows and UNIX servers put into the process of migration to Centralized Enterprise Backup in FCPS Data Center.
  • I have involved and spent lot of time and energy to make migration process successful in FCPS Data Center.
  • Managed the HP Storage works Enterprise System Library (ESL) E-Series tape libraries ESL-712e-3 each have 640 tape slots and 24 drives, MSL 5000/6000 each have 40 slots and 4 drives Ultrium 460 -2 and DLT standalone tape drives in SAN environment.
  • Handled all UNIX and backup administration tasks.
  • Worked on Veritas Netbackup and Veritas Backup Exec.
  • Unix Production Environment support.
  • Supported multiple applications in 24/7 environment.
  • Supported FCPS Library application ECOLE 24/7and also supported other major applications like HRIS, AIRWAVE, SASI, Webmethods
  • Storage administration and capacity planning and implementation.
  • Assist and support EMC based SAN infrastructure.
  • Managing change requests.
  • Handles all storage requests across the enterprise.
  • Storage allocation to UNIX and windows hosts.
  • Brocade and McData SAN switch configuration.
  • Performed mapping, zoning and masking.
  • Storage migration using OpenMigrator.
  • Installed and configured EMC SYMCLI, Power Path and TimeFinder.
  • Involved in Datacenter storage consolidation.
  • DR planning and implementation.
  • Managed DNS and NFS servers
  • IGNITE backup is performed on all HP-UX servers.
  • Printer’s administration using HP Jetdirect.
  • Configured network printers and handled all user requests and issues about print services.
  • Apache web server’s administration.
  • Performance monitoring and tuning.
  • Developed shell scripts to sent E-Mail notification for specific events like File system reached threshold etc.
  • Installed and configured ActiveXperts Network Monitor5.40/5.5 for monitoring all aspects of LAN and WAN servers in a Datacenter.
  • Involved in documenting DR disaster recovery planning and procedures.
  • Trouble shooting.
  • Documented UNIX and backup procedures as per the FCPS policy.

Confidential, VA

UNIX System Administrator

Responsibilities:
  • Production environment support 24/7.
  • Installed and configured SUN Solaris 8.0, HP-UX 10.20
  • Installation and configuration of Application code.
  • IBM Application Support TSO/SRP, IDTO/L etc.
  • O.S Installation and up-gradation on SUN and HP-UX.
  • User profile Administration.
  • Trouble shooting - Fixing TR’s (Trouble Reports).
  • Configured NIS, NFS environment.
  • Jump Start configuration
  • Installed and configured the oracle 8 on one of the nodes of the HA cluster in a parallel server option (SUN PDB).
  • Management of HP-UX MC Service guard (HA cluster).
  • Worked on LDAP.
  • Installed and configured weblogic server 4.5
  • Installed and configured Netscape Fastrack server 3.01.
  • Shell Scripts developed for automation of environment, like bouncing the application, Application status script, adding multiple users into the environment with the same profile and placing the desired scripts in to cron job for periodic execution.
  • Auto sync up.
  • Back up and restoring the File systems.
  • Installed and configured TSM.
  • Performance monitoring and tuning.
  • Provided Unix support in Database Up-gradation, from ORACLE 7.3 to 8.05

We'd love your feedback!