EWR1 Emergency Maintenance
Scheduled Maintenance Report for Packet
Postmortem

Reason for Outage

Start Date: November 7th, 2018 @ 12:56 PM EDT

End Date: November 7th, 2018 @ 1:21 PM EDT

Internal Ticket: #855

Location: EWR1

Description: EWR1 Emergency Maintenance

Outage Details

On Wednesday, November 7th 2018, Packet performed an emergency maintenance in one of the top of rack switch pair in our EWR1 facility, which started at 12:56 PM EST and was resolved at 1:21 PM EST.

During the maintenance, Engineers located a problem with a member switch in a redundant stack. Engineers rebooted the faulty member and provisioning was able to work properly.

Timeline

All times are in EDT.

  • Wednesday, November 7, 2018

    • 12:20 PM - Network engineers were alerted of a provisioning problem and began investigating
    • 12:30 PM - Issue was identified
    • 12:58 PM - One member in a redundant pair was determined that it required a reload
    • 1:12 PM - Authorization was approved and reload was performed
    • 1:15 PM- After reload, the problem was resolved

Impact Notes

  1. Customer that had their servers still in a bond setup, should not have seen any impact.
  2. Customers that did break their bond on their servers, may have seen server degradation.
Posted about 1 month ago. Nov 09, 2018 - 09:00 EST

Completed
The emergency maintenance has been completed without any customer impact.
Posted about 1 month ago. Nov 07, 2018 - 13:21 EST
In progress
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Posted about 1 month ago. Nov 07, 2018 - 13:01 EST
Scheduled
We will be performing an emergency maintenance in one of the TOR switch pair in EWR1.
Posted about 1 month ago. Nov 07, 2018 - 12:56 EST
This scheduled maintenance affected: Packet Network and EWR1 Device Provisioning.