We provide IT Staff Augmentation Services!

Director Data Center Operations And Systems Administration Resume

4.00/5 (Submit Your Rating)

SUMMARY:

  • I enjoy white - boarding “big picture” architecture and strategy with my team and colleagues.
  • I regularly share my experience by mentoring, publishing, and presenting.
  • I invented, developed, and chaired the standardization of DOCSIS Provisioning o EPON (DPoE), the Cable Labs (industry) standard for FTTH. DPoE allows cable operators to provision FTTH services using legacy back office DOCSIS OSS by making the EPON gear look like DOCSIS systems.
  • As a result cable operations can roll EPON deployments without re-writing the OSS and many processes from ordering, through fulfillment and billing (BSS).
  • Automation. From writing load balancing software for a big .COM in the 90’s to scripts that recommend new compute and memory requirements, I believe than even complex analysis and decision making can be automated. I don’t believe in automation because it eliminates jobs. I believe in automation because it frees time for intelligent people to solve the next big problem. One of the great challenges for operations is the constant forward change of automation.
  • Network reliability engineering. I’m currently authoring a book on the topic tentatively titled “Reliability engineering for IP, MPLS, and Ethernet Networks”
  • I recently authored chapter in a new IEEE Press, Wiley and Sons book Cable Networks Services and Management, edited by a colleague and authored with many other peers.
  • I was the Principal Architect for Software Defined Networks for Confidential (now Confidential ) for cable networks designing the automation standards for bootstrap to operations for NFv operations including vCPE, vRouter, infrastructure, xPON, and DOCSIS distributed SDN (during my tenure as a consultant)

WORK EXPERIENCE:

Director Data Center Operations and Systems Administration

Confidential

Responsibilities:

  • Managed IaaS team running Confidential data center operations with 13 sites (2 International, 11 in US). Team responsible 24x7x365 for power, environmental conditions, systems (compute), company owned storage systems, and all network hardware and cabling (but not network configs).
  • Managed relationships with internal customers and audits including: PHI, PII, HIPPA, and SOX compliance and audits. Lead HITRUST work for data center operations.
  • Recruited and hired permanent staff to replace cabling contractors.
  • Managed transition from “rack and stack” to an infrastructure oriented organization focused not on individual tasks, but entire infrastructure builds, hiding the complexity of virtualization from internal customers. Built up and developed team to focus on more complex Linux and Windows servers, scripting, and automation.
  • Processes and Automation:
  • Customized JIRA work-flows and streamlined commissioning and de-commissioning processes to free up staff time to provide greater OS/Linux support
  • Wrote Ruby scripts to automate creation of JIRA tickets from inbound emails.
  • Managed development of process and scripts for DCIM development on top of company’s custom object asset database (REST/JSON APIs)
  • Team replaced manual RMA creation with HP IRS (iLO Reporting Service) automated failure reporting/rma (RIB/XML)
  • Wrote a python script to calculate the replacement compute and memory requirements for VMware hypervisor clusters based on current CPU GHz and memory utilization.
  • Shut off most email alerting in favor of automated logs/thresholds and API alerts to pagerduty.
  • IaaS
  • Managed with my peers the migration of corporate operations from office environments to infrastructure platform in data centers
  • Managed relationships and SLAs with data center REITs
  • Managed capital budgets, capital expenses, and operational expenses for all capital in data centers excluding EMC hardware and network hardware. (All compute, local storage, and shared storage). Reduced data center capital expenditures by (22%) in 2015 largely through continued virtualization, conversion to 10G (rather than Nx1G, and consolidation of workloads and clusters), and zombie hunting.
  • Reduced data center footprint with my team identifying zombie servers and incentivizing P2V and rapid decommissioning. Net total reduction in power consumption of (35%) in months. Immediate return in in electrical opex savings.
  • Reduced maximum VM SLA work from 2 business to Confidential (next business day). Typical reduced from 1 day to 2 hours.
  • Analyzed temperature trends, checked with manufacturers and raised temperatures from 64 deg to 72 deg F in one location and from 68 deg F to 76 deg F in a second location and reduced CFM to reduce opex while still meeting warranty requirements for compute, storage, and network devices in both facilities. Immediate savings with opportunity to continue to raise the temperature.
  • Vendors and Purchasing
  • Managed selection and purchasing of all compute, local storage, and data center infrastructure except for SAN (separate team) and network.
  • Built relationships with Confidential and Pure Storage. Maintained relationships with HPE and other vendors.
  • Technology
  • Managed strategy transition from spinning media to 100% SSD for all local system storage and boot drives. Dramatically reduced hard drive break fix and increased customer satisfaction with performance.
  • Introduced all flash SSD shared storage (iSCSI)
  • Managed major infrastructure migrations with many hundreds of server moves, switch replacements, cluster refreshes, and system replacements, with only one single (internal) outage caused by my staff during 2015). This outage didn’t affect the production services and was resolved within 20 minutes.

Consultant

Confidential

Responsibilities:

  • Other clients include 3 of the top 5 MSO (cable) operators in the US; two CDN operators; large enterprise and IT service companies, multiple network chip manufacturers, and a few large telecom equipment manufacturers.
  • Chaired DOCSIS Provisioning of EPON (DPoE 1.0), a multi-MSO standard which was then handed over to Cable Labs for standardization and publication. Invented the virtual CM of vCM, the first NFV in cable
  • Participated in DPoE 2.0 standards development.
  • Managed vendor communications with RFI and RFP process to select scalable and reliable OTN/DWDM, IP router, and PON access vendors for multiple operators. Included lab configuration and testing, field testing (Engineering Field Trials), and through to First Customer Ship (FCS).
  • Worked with engineering team for client to select EPON access equipment and successfully deploy EPON with IP/MPLS/VPLS transport to delivery MEF carrier Ethernet services for cell tower backhaul operated for their customers including: Verizon Wireless, Sprint, and T-Mobile (operating at over 1,200 cell tower sites). Co-authored an article with one of my colleagues on this. Saved tens of millions of $ avoiding dedicated fiber installations and reduced CPE cost per tower
  • KPI: Analysis of 1.5 years of failure statistics (syslog, SNMP, and Remedy data) for IP router, access (PON), fiber cuts, and power outages, suggesting architectural changes that were implemented to improve reliability and meet customer require SLAs. Performed statistical analysis with JMP(SAS) and Excel. Performed reliability prediction calculations using MathCAD.
  • Design and implementation of IP/MPLS/VPLS solutions with PB and PBB for MEF EPL,EVPL, ELAN and EVPLAN services and EPON/DPoE including modifications to CM TLV TFTP config files to automate MEF provisioning end to end (published an article about this).
  • Represented client in mobile WiFi architecture and standards development for MSO WiFi Federation service which is now available nationwide as “Cable WiFi”
  • Participated in Cable Broadband Intercept (CBI) specifications development and various SCTE standards in the Interface Practices Subgroup.
  • Wrote Product Requirements Definition (PRD) for commercial services Ethernet products for an operator.

Director of Network Strategy and Architecture

Confidential

Responsibilities:

  • Managed cable network division network engineering teams
  • Developed the virtual CPE model for DOCSIS Provisioning of EPON (DPoE). The first vNF in the cable industry.
  • DWDM/CWDM transport, VOD/XOD,Digital Broadcast, Simulcast, Switched digital MPEG2 IP, DOCSIS broadband, EPON, commercial (VPLS/MEF), and wireless (MetroWiFi) network design and implementation.
  • Participated in industry standards work including lobbying for 10G EPON Study Group, DOCSIS 3.0 standards (I contributed the IPv4/v6 eRouter concept).
  • Designed and deployed first MetroWiFi outdoor network with Virtual Private Wireless Networks and mobile VoIP over WiFi - up and running Proposed DOCSIS integrated backhaul modems in outdoor WiFi AP’s (now built by BelAir Networks and Cisco Systems).
  • Designed converged IP network to combine 18 different services into a single IP network with Cisco CRS-1 (4/8/16) and ECI SR 96xx and Cisco ASR9000 MEF Edge (VPLS) equipment. Developed four year migration strategy including IPv4/IPv6 dual stack network.
  • Designed DWDM/SONET/TDM transport and IP networks for startup CLEC operation
  • Designed carrier class telecom facility and cable head end for Tier I US city - from conception through commissioning as part of design team.
  • Participated in DOCSIS 3.0, Packet Cable 2.0, and other cable specifications development.

Director of Network Engineering and Operations

Confidential, Chantilly, VA

Responsibilities:

  • The company hired me to provide continuity of operations during a sale and integration with Confidential Communications after the previous director abruptly left.
  • Managed team of architects, network engineers, and system engineers responsible for 24x7 operations of nationwide OC-48 IP backbone with Internet access and dial-up services.
  • Ran engineering and operations and eventual integration in Confidential Communications network and operations.

Director of Business Development / Member of Technical Staff

Confidential, San Jose, CA

Responsibilities:

  • Advise the legal department on potential acquisitions of intellectual property, development of internal intellectual property, and represent the company in some public forums.
  • Filed one US Patent application in Layer 4-7 technology. Other significant innovations in vNFs in load balancing, email proxies, web, SSL, streaming media, and security on Ethernet switches and iP routers.
  • Advise the CEO, VP Engineering, VP Marketing, VP of Software development, and General Counsel on market technologies and directions from established and new or developing customers and partners.
  • Develop new markets and business by establishing relationships with technology partners and strategic customers.
  • Organize references and technology discussions in support of sales and marketing organizations.
  • Develop and summarize technology partnership or acquisition ideas to the General Counsel, Intellectual Property Counsel, and CEO.
  • Participate in selecting technologies to patent, prosecution of patents, and patent litigation as required

Manager of Network Architecture

Confidential, Reston, Virginia

Responsibilities:

  • Managed team of Network Architects, statistician, technical writer, and draftsperson.
  • Reported to VP NetOps.
  • Managed oncall rotation and schedule for Network Architecture
  • Managed the design, implementation, and operation of AOL's domestic and global data and telecommunications services.
  • Oversaw growth of the network from 80,000 to 1.2M concurrent subscribers online and from under 1M to 20M+ subscribers.
  • Engineered and deployed: DWDM metro-optical networks, IP over SONET, and 802.11 wireless Ethernet, and VoIP technologies to AOL's networks.
  • Wrote and presented papers at numerous industry forms including Telecosm, Networld/Interop, All Optical Networks, Optical Internetworking Forum (founding member), et. al.
  • Managed relationships with equipment vendors.
  • Program manager for all network operations for the design and construction of two data centers in Dulles and Manassas, Virginia.
  • Also worked on smaller data center and co-location facilities around the world. Team was also responsible for outside plant engineering and operations.
  • Over 640,000 sq. ft. of raised floor computer room space designed and implemented including AC,DC power systems, inside and outside plant, and other aspects of design.
  • Over 800,000 fiber tips in one building alone.
  • Team conceived of and designed international Internet transit network called ATDN. Team also served as SME’s in all Internet peering negotiations and escalation for three different engineering teams support Cisco 12xxx/75xx routing platforms and over 7000 Ethernet switches.
  • SME on Layer 4-7 load balancing, caching, and application services. Issued US patent in network security.

Network Architect

Confidential, Syracuse, New York

Responsibilities:

  • Managed engineering and implementation projects for network and systems designs for corporate customers.
  • Developed new customers. Managed staff of 3-5 engineers on each project.
  • Wrote proposals for customers for network upgrades. Developed relationships with vendors.
  • Designed and implemented a 15 month upgrade strategy to service this ISPs network and web hosting facilities.
  • Managed to completion data center and corporate office network upgrades to implement that strategy.

Advanced Communications Engineer

Confidential, Rochester, New York

Responsibilities:

  • Project leader for multiple projects to manage engineering staff, resources, & customer relationships.
  • Responsible for oversight of engineering and implementation of projects, hand-off to operations, and continued escalation support from operations to engineering.
  • Participated on the Unix Security Council and Xerox Computer Emergency Response Team (XCERT).
  • Designed, tested, and supported deployment of global enterprise remote dial access system.
  • Design and testing of an enterprise wide electronic software distribution and distributed computing management systems (IBM/Tivoli Systems).

We'd love your feedback!