Sr, Aix Engineer Resume
Cary, NC
CAREER SUMMARY:
- Over 14 years of IT experience including over 12 years of professional experience in AIX System Administration, 6 Years Linux System Administration & 3 years as Technical Lead.
- Expertise in AIX 5.3/6.1/7.1, Red Hat Enterprise Linux 5/6/7, Hands on experience in Solaris 5.9/5.10 & Windows 2008/2012.
- Excellent written & Verbal communication skills and ability to work closely with clients at various management levels even during escalations and providing detailed analysis on issues.
- Ability to technically lead and mentor a team Onsite or Offshore independently and driving them towards excellence.
- Proactive working style in planning as well as identifying and prevention of any issues.
- Dedicated, focused, independent & self sufficient working style.
- Proficient in writing Shell/Bash scripts for Automation.
- Extensive experience and knowledge in AIX Patching (TL / SP Upgrades ), Troubleshooting & Restoration.
- Extensive experience in planning & performing AIX Migration Upgrades from AIX 5.3 to 6.1 / 7.1 using NIMADM method for minimum downtime.
- Extensive experience in Power systems migration from POWER5 to POWER6 ( Standalone migration ) and POWER6 to POWER7/8 ( Using Live Partition Mobility LPM ).
- Expertise in installation, configuration, tuning, recovery, upgrades & troubleshooting of IBM AIX using Standalone and Logical Partitioning (LPAR).
- Expertise in installing AIX via Network Installation Manager (NIM).
- Expertise in implementing AIX Virtualization which includes Creating VIO Servers and VIO Client LPARS, Administering and Troubleshooting issues of LPAR’s, VIO’s, DLPAR’s, HMC’s & Dynamic resource allocations.
- Expertise in AIX LVM and Creation/Modification of VG’s, LV’s, Filesystem’s, including VG and LV Mirroring and troubleshooting issues.
- Extensive experience in Multipathing software MPIO, Powerpath, HDLM to manage various storage vendors and disk subsystems.
- Expertise in installing, configuring, maintenance and troubleshooting of High Availability (HA) system based on IBM HACMP, PowerHA & Power HA System Mirror with CAA.
- Expert in Red Hat kickstart installations including configuring RAID 1 local drives for redundancy.
- Expert in RHEL 7 and systemctl services, LVM, XFS filesystems.
- Experience with Red Hat Linux 5/6/7 performance and kernel tuning parameters.
- Red Hat Linux server patching using Satellite servers and Package / RPM management with YUM.
- Experienced in Linux troubleshooting from Single user / Rescue / Maintenance modes for boot issues.
- Vast experience in providing On - call support as well as Datacenter HEF(Hands, Eyes and Feet) support which includes troubleshooting problem tickets, executing change requests, working with CE’s and engage in customer bridges for production incidents.
- Extensive experience and in depth knowledge having worked in Datacenters and on various hardware including IBM Power Systems, Blade & Chassis Systems.
- Excellent client relation skills and the drive to complete tasks effectively and efficiently as well as the ability to communicate effectively with all levels of management and the client community.
- Experience in creating playbooks consisting of instructions of commonly used remediation steps and server/application information for known issues for a specific server or application across an environment with the purpose of quick restoration during an outage.
- Experience in Training new team members on roles, daily activities as well as communication methods with the client’s management and maintaining composure during an outage situation.
TECHNICAL SKILLS:
Operating Systems: IBM AIX 5.3/6.1/7.1, Red Hat Enterprise Linux 5.x/6.x/7.x., SUN Solaris 5.8/5.9/5.10 & Windows 2008/2012.
Hardware: IBM p-Series (p520, p550, p570, p650, p690, p770, S814, S822, S824), HMC ( 7/8 ), VIO, LPAR, DLPAR, IBM System X (x336, x346, x366, x460, x3650, x3690, x3850, x3950), HP Proliant BL and DL Series Servers, IBM Blade Center HS23, SUN (V440, V490, V890, E6900) SUN SPARC ENTERPRISE (M4000, T5240), SUN ULTRA E250, E450, E3500, E6000, E10K, FUJITSU (250, 450, 650).
System Admin Tools: IBM VIOS 1.5/2.2, IBM HACMP 3.0/4.0/4.5/5.4 , PowerHA 5.5/6.1/7.1, TSM Backup, VMware Vsphere 5
Network Protocols/Services: TCP/IP, UDP, HTTP/HTTPS, RMI/IIOP, SOAP, SSL, SMTP, ICMP, IMAP, POP3, NIS, NIS+, NFS, DNS, DHCP.
PROFESSIONAL EXPERIENCE:
Confidential, Cary, NC
Sr, AIX Engineer
Responsibilities:
- Migrate from POWER 7 and POWER 8 to New POWER 9 ( S924 ) hardware.
- Migrate the AIX from 7.1 to 7.2
- The current servers run critical SAP applications and is migrating to brand new hardware and software.
- Evaluate the current hardware, configuration and data structures on old servers.
- Assist installing new hardware and complete initial setup which includes racking the HMCs & machine, cabling, network setup.
- Establish discovery of the new hardware into the network.
- Upgrade the HMC and Machine firmware to the latest available level.
- Create 2 VIO servers on each machine with the required CPU, Memory and IO adapters.
- Load the OS on the VIO servers and upgrade to the latest version.
- Perform the necessary virtualization for scalability by creating microprocessor pools for CPU sharing and thereby allocating shared processor units for virtualization.
- Work with network team and Configure network communication for the servers using best practices for maximum performance with accepted redundancy by implementing ether-channel, shared Ethernet adapters, active-passive adapters.
- Perform network tuning for optimal performance of the network adapters with parameters like media speed, duplex settings, jumbo frames, large send and receive, multicast and broadcast addresses.
- Assign required virtual LAN’s for accessing multiple networks.
- Configure required storage as per the requirements and current values.
- Perform fault tolerance and failover testing to evaluate the resiliency of the new hardware to hardware faults.
- Create LPAR partitions with appropriate resources for the application requirement.
- Assign the boot disks, storage adapters and network adapters.
- Load the operating systems and patch to the latest levels to fix any security issues that can effect the hardware components.
- Perform the QA checks to match with the security baseline.
- Migrate all the data including data structures, peripherals, ownerships and permissions to the new hardware.
- Configure network mounts in exactly the same manner as in the old servers.
- Work with the application owners to troubleshoot any issues that get reported.
- Decommission all old hardware.
Confidential
UNIX Track Lead / Sr. AIX and Linux Admin
Responsibilities:
- Onsite Track Lead for Confidential project managing highly diverse environment of 8000 servers including AIX / Linux / Solaris and managing a team of 20 SA’s ( Offshore & Onsite ) working 24/7.
- Managing client’s day to day operations, providing technical guidance to the team, documentation of various SOP’s as per client requirements, process improvement with the extensive knowledge acquired by working for almost 3 yrs with the client.
- Work with client management, technical and engineering teams on identifying common environmental, repeat issues and providing solutions to close the gap from design standpoint.
- Working and Managing various Non-BAU projects for client including TSM to EMC Networker migration, Hitachi to EMC storage migration, Samba and Java vulnerabilities remediation.
- Escalation point of contact from HCL side for all UNIX technical and management issues 24/7.
- Also working as a lead AIX SME for a team of AIX SA’s within the same team.
- ITIL Process & Documentation SME - Provide advice for the team for working efficiently as and when needed on Incident and Change Management to ensure process is followed and SLA’s are met. Also responsible for creating runbooks to perform work as per client expectations and avoid mistakes.
- Responsible for managing AIX 5.3 / 6.1 / 7.1 environment of 600 servers and technically leading / mentoring all AIX SA’s within the team both onsite & offshore.
- Support large scale of Red Hat Enterprise Linux VM’s ( including cloud ) and Physical servers.
- Regular patch, firmware and hardware maintenance of Linux servers.
- Configure and Upgrade ILOM for new Linux Physical servers for build’s.
- Work with SAN and Network teams for cabling of new servers.
- Configure RAID 1 Local drives and Installation of Linux via Kickstart.
- Perform Confidential specific post build QA and customer turnover.
- Troubleshooting and providing RCA for wide ranging issues like performance, server crashes, login failures, NFS issues, connection and DNS issues.
- Work with Redhat and HP as needed on issue basis.
- Complete LVM management including creation of Filesystems using Virtual or Storage disks, NFS, NAS mounts.
- Backup and restore using TSM as well as EMC Networker.
- RPM and Fileset management for Linux and AIX.
- Server Patching using satellite ( Linux ) and NIM, Alt disk, In-line ( AIX ).
- Ensure proper decommission of servers ( SAN, DNS, Backup cleanups and local disk scrub ).
- Responsible for complete AIX infrastructure services support on various hardware platforms including P5, P6, P7 & P8 machines, IBM Blades and H Chassis, various clusters including PowerHA, CAA, Oracle RAC, GPFS, Power VM & Shared Storage Pool Clusters.
- Responsible for managing and assisting the team 24/7 with RHEL 5/6/7 infrastructure consisting of 6000 Physical ( HP blade and rack, Exadata ) & Virtual servers ( VMware & Cloud ) with day to day activities.
- Guiding the team and managing RHEL Physical Server builds along with infrastructure teams end to end ( i.e. Server racking, Cabling, Networking setup, OS installs using kickstart, SAN setup, Post build QA and Final customer turnover ).
- Writing scripts for various day to day activities for automation and significantly reducing amount of manual efforts & human errors.
- Proactively do an overall monitoring for common AIX issues across the environment and work with client in addressing them effectively.
- Driving AIX Upgrade project to upgrade legacy out of support AIX 5.3 servers to AIX 6.1 & AIX7.1 and performed numerous migration upgrades via NIM servers using “NIMADM”.
- Server migration from Old P5/P6 hardware to Newer P7/P8 machines using standalone methods ( non-LPM ) and Live Partition Mobility based on existing setups.
- Driving EMC Driver remediation project to upgrade or install EMC ODM drivers on AIX servers already migrated to EMC storage.
- Configuring and Managing SAN devices using Powerpath and HDLM.
- Patching GPFS (3.5) and VIO SSP (2.2.3.50) clusters.
- Configuring SEA on VIO servers with VLAN tagging and testing for failover.
- Configuring NPIV and Mapping Virtual Fiber Channel adapters to LPAR’s across the environment.
- Extensive and expert working knowledge on various storage related work in AIX including SAN, MPIO configurations.
- Handling and working all regular storage growth requests & reduction ( to reduce costs ) with minimum or no downtimes in AIX LVM, PowerHA clusters, GPFS Clusters (NSD creation, etc..), Oracle RAC clusters ( ASM ), SSP Clusters (Thin and Thick provisioning).
- Analyzing and troubleshooting various SAN & Path issues with SAN & Cabling teams.
- Managing & Troubleshooting Power HA clusters (v5.4, 6.1 & 7.1).
- Upgrading System Firmware for P-Series machines.
- Server restore / rebuild / clone as and when needed.
- Managing MKSYSB Backups for space optimization.
- Configuring and Management of TSM Backups including configuring Backup IP’s, VLAN’s, Setting up initial backups, daily backup failure troubleshooting issues.
- Data backup and restore using EMC Networker which is being replaced instead of TSM.
- Management of all NIM resources including machines, LPP’s, Spot’s.
- Dynamically allocating IO adapters, SAS disks to LPAR’s as needed in critical situations.
- Managing and Handling of various hardware service calls to IBM and replacement of HBA, NIC, SAS disks, Backplane, etc..
- Management of HMC’s (V7R7 and V8R8) including troubleshooting and restoring.
- Performing AIX kernel changes including Swap space, ulimits, memory tuning, network tuning as needed by application or DB teams to optimize performance.
- Making sure DUMP devices are configured on all servers across the environment for crash analysis in case of an outage.
- Fixing AIX boot issues due to BLV, Filesystems corruption.
- Access management for servers through Local, SUDO, NIS and AD (Likewise/Power Broker).
- Representing all changes within various CAB meetings (Test CAB, LCAB, MCAB) day to day basis every week.
- Support quarterly DR exercises to meet audit requirements.
- Available 24 /7 on call for technical or process help and guidance for team members onsite and offshore whenever needed.
- Complete ITIL Process awareness & Managing service now queues for INC’s / CHG’s / REQ’s within SLA’s.
Confidential, Lexington, KY
Sr. AIX/UNIX Systems Administrator/Transition Engineer
Responsibilities:
- Worked directly with the client as Primary System Administrator to over 30 premium designated applications distributed over more than 250 multi platform (AIX/Solaris/RHEL/HP-UX/INTEL) servers in production during business hours which require lowest downtime and are of highest priority for the Client.
- Installation, Migration and Configuration of AIX 5.3/6.1 on p-Series servers using mksysb and NIM servers.
- Adding/Deleting/Dynamic resource allocation (CPU, RAM, and IO Adapters) for LPAR’s using HMC, VIO and Micro-Partitioning.
- Creating LPAR’s and Profile on p5 and p7 hardware (p570 & p770).
- Involved during Major SAN switch migration for multiple AIX servers.
- Mapping of SAN disks from VIO servers to VIO client LPAR’s.
- Configuring of SAN disks on VIO clients and checking for any path issues to VIO servers.
- Creation and Modification of VG’s, LV’s, FS’s in both Standalone and Cluster (HA) LPAR’s.
- Migrated data from old disks to new disks during SVC migration.
- Regular upgrades to VIOS (v1.5 and v2.1) and HMC’s.
- Creating, Modifying & Removing standalone and cluster file systems using IBM HACMP and PowerHA.
- Migration of HACMP 5.4 to PowerHA 5.5 and later PowerHA 6.1.
- Involved in regular patching of AIX 5.3/6.1 to newer Technology Levels throughout the environment.
- Applied Service Packs and APAR’s on AIX Servers to fix any known bugs or issues.
- Restored missing file systems and directories in AIX several times after a reboot due to corrupt superblock.
- Transformation and Transition involving complete overhaul of hardware infrastructure to IBM pSeries 770, 750, 720 and IBM xSeries 3550, 3650, 3850 servers.
- Worked on initial network and SAN setup on IBM pSeries and xSeries machines.
- Worked with SAN teams for fixing various physical SAN related issues including identifying cabling and port issues.
- Actively responding to emergency On-site requirements due to Server outages and helping other remote team members as on-site resource for other platforms like Windows and Solaris.
- Involved in deploying applications on IBM Websphere Application Server 5.x/6.x on AIX environment.
- Effectively communicated with client over successful deployment, configuration and issue diagnosis involving utilization and settings of JVM heap sizes and Connection count settings of deployed Websphere applications.
Confidential, Columbus, OH
UNIX/Websphere Administrator
Responsibilities:
- Responsible for Installation, Configuration & Upgradation and support existing systems with AIX 4.3/5.3L, Sun Solaris 2.7/7/8/2.9 operating environment.
- Responsible for the operation, maintenance and integrity of a Distributed, Networked AIX based environment.
- Installed and Configured enterprise applications on IBM WebSphere Application Server 3.5/4.0/5.x, IBM HTTP Web Server in AIX, Sun Solaris, Linux and Windows NT/2000/98/95 environment.
- Implemented Cloning, Clustering, Performance tuning and trouble shooting of IBM WebSphere Application Server 4.0/5.x.
- Migrated existing applications from WebSphere 3.5/4.0 versions to 5.0 using Waspreupgrade and Waspostupgrade tools.
- Implemented, installed and supported High Availability (HA) cluster on IBM pSeries (p690) platform (HACMP for AIX)
- Applying software maintenance, File sets, program fixes and keeping the system software releases current.
Confidential, Alpharetta, GA
Unix/Websphere Administrator
Responsibilities:
- Responsible for the implementation and daily administration of a 100-node AIX/Sun Solaris corporate network.
- Installation, configuration, maintenance and fine-tuning of AIX on IBM RS/6000.
- Integrating enterprise-wide J2EE applications and deploying using IBM Websphere Application Server 3.5/4.0, Application Assembly Tool (AAT) and managing security policies for different applications.
- Strong experience in Analyzing, Trouble shooting and taking appropriate actions for Application/Web server errors and logs using WebSphere Log Analyzer tool.
- Installation and support of IBM HTTP Server, WebSphere Application Server, Oracle 7.x/8i on AIX/SUN Solaris.
- Installed and configured Oracle in a high availability environment, using AIX HACMP for disaster recovery scenario.
- Planning and management of hardware installations and upgrades with AIX hardware.
Confidential
AIX System Administrator
Responsibilities:
- Installation, maintenance & Administration of AIX Systems.
- System & backup management using IBM ADSM Backup Server.
- AIX systems administration and Disk Management using SMIT.
- Logical Volume Management (LVM) of AIX.
- Predefined and Customized Volume Group management on AIX
- Disk Replacement on AIX.
- Performance Management & Tuning of AIX UNIX Kernel.