SUMMARY:

• UNIX/SAN Storage/Virtualization Expert with 18 years of industry experience and highest levels of IBM and Confidential Microsystems Professional Certification.
• Experienced in IBM PowerVM, Live Partition Mobility, Active Memory Sharing, NPIV, AIX 7.1/6.1 WPAR, Live Application Mobility, Confidential LDOM, Solaris Containers, Data Protection and Disaster Recovery, Capacity Planning, Performance Monitoring/Tuning for High - End SMP Servers/SAN Storage in heterogeneous UNIX environment, HA Clustering/Replication, Enterprise Fault Monitoring and Alerting.
• Designed and implemented highly available scalable UNIX systems, maintained and supported his implementations 24x7. Planned and successfully executed major hardware/OS upgrades and cross-platform migrations with minimum downtime.
• In-depth UNIX kernel, TCP/IP protocol stack and Oracle internals knowledge, excellent troubleshooting skills and strong development background.

TECHNICAL SKILLS:

Servers: IBM POWER7/POWER6//POWER5/POWER4 Servers: Power 780, 770, 750. 570, 550, 520, BladeCenter H/E/S, JS22/JS12, pSeries p650, p615, p680, p660, HMC, PowerVM LPM. AMS, SPLPAR, VIOS, SEA, HEA, NPIV, SSP Confidential T-series/M-Series/ Confidential Fire/Enterprise servers: T5440/T5240, M5000/M4000, Confidential Fire E25K, E10K v880, v480, v20z, HP, IBM, Dell x86-64 servers

Storage/SAN: HP 3PAR, HDS, IBM, EMC, NetApp, McData, Cisco: F400/T800, 7700E/9980V, 5802/5877, DMX-3, CLARiiON CX, FAS6240/V6080//FAS3070, ED-6064 Director switches, MDS- 9509

Tape products: STK, Qulastar, Confidential, NetApp: L700, 9940B/9840 TLS-4000, Lx DLT7000, VTL700

UNIX OS: AIX 7.1/6.1/5.3/5.2 , Solaris 10/9/8/7/6, ONTAP 8.1/8.0.1/7/6 G, Red Hat Linux RHEL 5/4, Novell/SuSE Linux SLES 8, HP/UX 10.x, OPENSTEP 4.2, Tru64 4.x, SCO Open Server 5

Database: Oracle 11gR2/10gR2/10g/9i/8i, MySQL, Progress RDBMS 6.x/7.x/8.1

High Availability/Data Protection: IBM HACMP 5.3, VCS 5.0, Confidential Cluster 3.0/2.2, Oracle Data Guard, 11g/10g ASM/ RAC

Volume Managers/File Systems/Replication: AIX LVM/JFS2/JFS, Solaris ZFS/SVM, VERITAS Storage Foundation for Oracle HA/RAC 5.1/4.1/4.0/3.5 , CFS, VxVM, VxFS, Storage Checkpoints, VVR, VFR, rsync, Linux LVM2/ext3/ReiserFS, HP LVM/HFS

Array-Based: HDS ShadowImage/HORCM, EMC BCV, SnapView/MirrorView, NetApp FlexClone, SnapMirror, DataMotion, SnapRestore, FlashCash, FlexShare, A-SIS de-duplication/compression

SAN Multipathing: EMC PowerPath, AIX MPIO, HDS HDLM 5.4, VERITAS DMP, Confidential SSTM/MPxIO

IP Multipathing/Link Aggregation: AIX EtherChannel/VIP/NIB, Solaris IPMP, Link aggregation, Confidential Trunking

Enterprise Backup/Archiving/HSM: NetBackup Enterprise Server 7.0.1/6.0, DataCenter 4.5/3.4, Fibre Transport, Bare metal Restore, vADP for vSphere 4.0, SAN SSO, NetBackup for Oracle, BLI, Oracle RMAN, Confidential SAM-FS HSM, Tivoli TSM 5.3

Network/Security: Confidential ONE Directory Server 4.0, LDAP, Confidential +/ Confidential /NFS/Automounter, DNS/Bind 8.x, NTP, Samba, Sendmail, Apache, SSL, Kerberos, Netscape Enterprise Server 3.5, VeriSign OnSite, VNC, AIX IP Security, Solaris IPF, netstat, ssh, sudo, tcpdump/snoop/iptrace, lsof

UNIX Performance/Dump Analysis: dtrace, Probevue, truss, sar, vmstat/iostat/prstat, lparstat, topas, nmon, nfsstat, entstat, tprof, kdb/mdb/adb

Enterprise Monitoring: OPNET Panorama, Netcool/OMNIbus 7.0.1/SSM 3.1, SystemEDGE, Tivoli ITM/EFM/TEC, McData EFC Console, NetApp OnCommand, EMC Control Center

Scripting/Programming Languages: Perl, sh/ksh/csh, TCL/Tk, Expect/Tk, awk/sed, C, Assembly

PROFESSIONAL EXPERIENCE:

Confidential, Manassas, VA

Sr. System Engineer

Responsibilities:

• Designed and built from scratch a PowerVM farm of POWER7/POWER6 servers with 2 redundant HMCs, 32 VIO servers and 2 alternate NIM masters hosting 180 virtual micro-partitioned LPARs running AIX 6.1/7.1. Implemented dual redundant VIO Servers with SEA failover, vFC/NPIV for VTL access from LPARs, Live Partition Mobility, Active Memory Sharing, WPAR Live Application Mobility.
• Automated provisioning of LPARs with HMC/NIM CLI-based scripting to allow for dozens of AIX LPARs to be created in parallel, within an hour, including the storage part, VIO Server mappings, network configuration and OS.
• Implemented IBM Systems Director 6.1.2 for monitoring and inventory of Power systems.
• Automated sFTP, FTP/S and HTTP file transfers between a mainframe and Open Systems.
• Configured the OS, SAN storage and network portion of an Oracle 11g RAC clusters on Solaris 10 with ASM and ZFS and virtual AIX 6.1.
• Implemented NFSv4 file sharing with NetApp filers for Tibco HA
• Implemented AIX/Solaris/Windows Single Sign-On against Windows 2008 R2 Active Directory with Kerberos/LDAP
• Architected and built from scratch NetBackup 7.0.1 infrastructure with Bare Metal Restore to backup 1000 VMware vSphere VMs with vADP, 180 AIX virtual LPARs, 32 Solaris servers with 150 zones, 200 Oracle instances with RMAN over Fibre Transport to a NetApp VTL700
• Introduced HP 3PAR storage, migrated 40 Tb of Oracle RAC data from NetApp to 3PAR with no downtime
• Wrote security hardening script for AIX 6.1
• Analyzed Solaris/AIX production workloads, profiled applications, identified and addressed performance bottlenecks
• Collected utilization date and generated reports
• Did capacity planning, created hardware/software specifications, made purchase recommendations, obtained quotes from vendors
• Researched, evaluated and eventually implemented many OS, Virtualization and data protection technologies such as NFSv4, Live Partition Mobility, Active Memory Sharing/Expansion, Active Memory de-duplication, Shared Storage Pools, WPAR Live Application Mobility, to increase Data Center efficiency and manageability, eliminate scheduled and minimize unscheduled downtime
• Performed FAS3070 to FAS6240 heads upgrade 7.1.3 to 8.1 ONTAP upgrade, in-place converted 200 Tb worth of volumes on aggregates to 64-bit. Completely re-laid out data to maximize the number of spindles per aggregate with minimum downtime using SnapMirror migrate and DataMotion for volumes. Established ATA, SAS and BSAS storage tiers.
• Proactively resolved all PowerVM and virtualized AIX issues, kept systems up and running for 3 years with no unscheduled downtime
• Maintained PowerVM and virtualized AIX infrastructure, upgraded HMC, platform firmware, VIO servers and AIX
• Zoned Cisco MDS switches, created volumes. LUNs, initiator groups and Confidential shares on clustered NetApp filers. Cloned LUNs, restored LUNs/files with SnapRestore, adjusted aggregate and volume snapshots schedules.
• Presented LUNs and mounted Confidential shares on AIX and Solaris systems, created/adjusted/resized volume groups, volumes, JFS2 file systems and ZFS pools/datasets.
• Provisioned SAN storage and LPARs, installed and patched applications such as JVMs, IBM WebSphere and HTTP Servers, performed the system portion of SIEBEL, WebSphere Portal, Oracle BI, Adobe LiveCycle, EMC Documentum, Oracle 11g RAC/Single Instance and client installation and configuration.
• Resolved SAN storage, AIX, Solaris, Oracle RAC and applications issues as they occurred.

Confidential, Herndon, VA

Infrastructure & Recovery Engineer

Responsibilities:

• Built and maintained a NIM Server, created NIM resources for new builds and upgrades, migrations, cloning and patching of existing systems. Scripted regular rootvg backups to NIM. Implemented Secure NIM with NIMSH for SOX compliance.
• Implemented LDAP-based user accounts with netgroups on AIX 5.3, automated deployment of LDAP clients, converted existing local accounts with no downtime.
• Implemented WLM with Oracle class for easier memory consumption monitoring and CPU-capping at an Oracle-licensed number of CPUs.
• Upgrades of AIX 5.2 systems from TL04 to TL08 CSP with DST patches.
• Migrations of all AIX 5.2 systems to 5.3 with JFS-to-JFS2 rootvg conversion using NIM Alternate Disk Migration with only one reboot. Fixed bugs and added rootvg JFS-to-JFS2 conversion functionality that didn’t exist in IBM nimadm scripts.
• Upgrades of AIX 5.3 systems to TL06 SP4.
• HMC upgrades from 5.0 to 6.1.2
• Firmware upgrades of legacy systems for them to be able to run AIX 5.3
• Provisioned storage, created LUNs/volume groups/file Systems for Oracle databases.
• Tuned VMM, Fibre Channel and Ethernet settings, adjusted storage/file systems layouts for higher performance and availability. Resized paging spaces and dump devices to accommodate varying workloads.
• Identified CPU, disk I/O and memory hogs, provided metrics and OS-level insights for all applications performance issues.
• Monitored resource consumption trends on AIX systems, measured impact of the new releases, explained unusual patterns and made capacity upgrades recommendations.
• Watched for and dealt with hardware failures, identified and replaced failing parts.
• Kept the AIX environment up and available, demonstrated 2 years of continuous uptime of Production p5 570 systems. Made sure the environment was clean and manageable with all issues completely understood and resolved.

Confidential, Herndon, VA

UNIX/Storage Consultant

Responsibilities:

• Implemented redundant dual VIO Servers with SEA failover, PowerPath and client LPAR MPIO with CLARiiON Cx300 backing. Established virtual slots assignment and VTD naming standards.
• Scripted provisioning of fully-virtualized LPARs
• Maintained a NIM server, upgraded it to TL07 SP2, created resources for VIO Server installs.
• Registered VIO Servers as NIM clients, upgraded from 1.3.1 to 1.5.1, defined procedures for backing up and restoring them to/from NIM.
• Worked on HMC upgrades from 6.1.1 to 6.1.3 and 7.3.2

Confidential, Herndon, VA

Sr. UNIX and Storage Engineer

Responsibilities:

• Analyzed performance trends in the existing systems.
• Evaluated new UNIX hardware, SAN storage platforms, OS and Enterprise Data Protection software from IBM, HDS, EMC and VERITAS for scalability, performance and fault tolerance, did capacity planning, provided technical data for making million-dollar purchase decisions to accommodate the explosive data growth while fitting the limited budget of the company.
• Architected and built the complete virtualized environment with multiple p5 570, System p5 520 servers/LPARs, D11/D20 RIO drawers, 2 redundant HMCs and NIM servers. The environment is SAN-attached, SAN-bootable, takes full advantage of APV features such as SPLPAR, VIO Server, and SEA and runs multi-terabyte Oracle databases, Java and Linux on POWER applications.
• Worked on expanding one of the p5 570 CECs with an extra CPU/Memory drawer and planning for additional 8-way System p5 550Q.
• Implementing 20 Tb of EMC CLARiiON SATA as a cheaper SAN-attached storage.
• Created standards for redundant server/LPAR configurations and SOPs for installation, maintenance and troubleshooting.
• Automated deployment and maintenance with AIX NIM and SUMA and Solaris customized Jumpstart.
• Provided high-performance, scalable and redundant I/O foundation as well as LUNs/volumes/filesystems layouts for multi-terabyte Oracle databases, utilizing SAN multipathing, Oracle ODM with asynchronous/direct I/O.
• Set up a proof-of-concept 2-node Oracle 10g RAC cluster.
• Migration of most critical Oracle and Java applications from E10K domains, Confidential Enterprise/ Confidential Fire servers to p5 570, System p5 520 LPARs
• Upgrades of all 24x7 production, development and QA LPARs from AIX 5.2 to the latest 5.3 TL4 SP1
• Migration of 10 Tb of data from 2 HDS 7700E to 9980V.
• Maintained p5 570 environment at the latest firmware levels, went from HMC v4 R1 to HMC 5.2.
• Upgrades of VERITAS Storage Foundation for Oracle to 3.5, 4.0, 4.1 on AIX and Solaris.
• Upgrades of Confidential Enterprise, Confidential Fire servers and E10K domains from Solaris 2.6/2.7 to 2.8, 2.9 and 2.10.
• Upgrade from NetBackup Datacenter 3.5 to 4.5.
• Upgrade of L700 robotic library with 9940B drives, migration of terabytes of backup data from 9840 to a new tape media.
• Worked on NetBackup Enterprise Server 6.0 upgrade, which includes migration of multiple SAN Master/Media servers from Solaris to AIX and Linux.
• Migration from Oracle 8i 32-bit Solaris QIO to 9i 64-bit AIX 5L with Oracle ODM.
• Worked on migration to 10g R2 with Oracle ASM.
• Upgrades of E10K, Confidential Enterprise/ Confidential Fire servers, added CPU/Memory/ I/O boards and disk array enclosures.
• Migration of Java applications from Solaris to x86-64 Linux.
• Implemented VERITAS NetBackup Datacenter in a heterogeneous SAN environment with multiple SAN Media Servers.
• Designed for scalability and performance to fit into shrinking backup windows.
• Backed up and archived Oracle RMAN, AIX, Solaris, Windows, MS-Exchange and Linux clients.
• Used Advanced BLI Agent to backup 6 Tb Oracle data warehouse.
• Kept 90 Tb on tape, duplicated 10 Tb per weekend for Iron Mountain Vault.
• Evaluated IBM Tivoli Storage Manager.
• Provisioned AIX and Linux LPARs, monitored workloads, made DLPAR changes, AIX kernel and storage parameters tuning to improve performance.
• Managed a fully populated E10K, created and modified domains, made Dynamic Reconfiguration adjustments to accommodate varying workloads.
• Made copies of Oracle LUNs on Hitachi with ShadowImage to refresh QA and development instances with production data.
• Monitored performance, Identified and provided solutions for performance bottlenecks in the complex multi-tier heterogeneous UNIX environment.
• Wrote Perl and shell scripts for UNIX, Oracle and NetBackup fault monitoring and reporting, routine management tasks automation.
• Supported all critical UNIX systems being On-Call 24x7, resolved software and hardware issues, and replaced failed parts as necessary.

Confidential, Herndon, VA

Sr. UNIX System Engineer, SA Team Lead

Responsibilities:

• Supported Solaris systems for Confidential "You've Got Pictures" and Kodak Photonet Online services 24x7, over the Internet and in the Data Center, working closely with Confidential, ORACLE DBA, Networking and Development teams to isolate and resolve issues, making sure all the SLAs defined are met.
• Was SA Team Lead, participated in on-call rotation at the highest SA escalation level.
• Installed, configured, troubleshot and tuned for performance redundant Confidential systems from Apache/Netscape based Web front ends, DNS, Sendmail and Confidential servers to Confidential Cluster HA ORACLE back ends, using Confidential arrays and Qualstar Tape Libraries, with RAID Manager 6, SDS and VxVM, VxFS, SAM-FS HSM, VERITAS File Replicator and Confidential Trunking.
• Developed upgrades/patches deployment scripts, application reconfiguration and statistics collection scripts, performance monitoring, problem identification and alerting tools in Perl and shell.
• Responsible for DNS, e-mail and Secure Certificates management, Sendmail/Netscape Mail servers, BIND 8 servers, VeriSign OnSite Administrator.

Confidential, Reston, VA

UNIX System Engineer

Responsibilities:

• Supported production Secure Internet Payment systems 24x7.
• Built Solaris 2.6 and SCO 5.0.4 systems with RAID arrays, configured, deployed and troubleshot complete transaction processing systems exposed to the Internet, monitored and troubleshot UNIX Systems and custom applications on an intranet with multiple levels of security utilizing packet filtering and switches, application proxies and firewalls, VPN and encryption technologies. Installed application drops, upgrades and patches, added new and replaced failing hardware.
• Developed log files analysis scripts to collect statistics and identify problems, performance monitoring tools in shell, Perl and SE Toolkit.
• Configured Sendmail8.9.3, Squid Proxy Cache and NTP.

Confidential, Washington, DC

UNIX System Engineer, contractor

Responsibilities:

• Worked within Systems Engineering UNIX Production Support group, providing analysis and support for Confidential Solaris, NeXT Step/Open Step and Digital UNIX environments.
• Supported SE projects and initiatives, designed and implemented methods to resolve issues as they were identified.
• As a UNIX Primary, responded to Urgent and Standard PCM tickets or calls within 15 minutes, 24x7 via pager, monitored and responded to Event Fault Management Alerts, completed scheduled change controls, took ownership of problems and coordinated with business units and outside vendor maintenance personnel for hardware and software repairs.
• Position required oversight of more than 1500 UNIX clients and 500 servers in a big Confidential + auto mounted environment with VERITAS clustered HA Sybase and ORACLE systems, supporting mission critical functions and financial activities.
• Was accountable for insuring that all Service Level Agreements are met and business hours maintained without interruption.