Resolved
VOIP Services Disruptions
We just received an update that all Calling services and BLF function have been restored but individual phones may need to be restarted if they are still having any issues.
For now we are going to Mark this as resolved. Any forwards we had in place to cellphones we are now returning to the normal phone systems. If we need to we will turn them back on, but at this moment no further issues are expected.
Resolved
VOIP Service Disruptions
We have been made aware by our upstream carrier that they are experiencing a failure in some of their PBX Nodes that is causing calls to fail to complete or drop. We are working with them currently to get updated on the status of the situation and a timetable for repair.
Resolved
VOIP Service Disruptions
12:13 PM - Update - It looks as if call functionality is being restored globally. We will continue to monitor the situation. Hopefully this situation is about to be resolved. Phone services should be working at this point, but until they say they are completely back online, we will continue to monitor the situation. Please let us know if you are still having issues.
11:57 AM - Update - We continue to work on the resolution to the high memory utilization. Changes have been deployed to the primary servers of each high availability pair, but they have not yet been deployed globally. Call functionality has been restored on all nodes except SW-01, which is being worked on now. We are seeing signs of stability and improvements. However, the platform depends on inner network communication between servers, and some of that communication is still queued and delayed. Some services and functionality will also be slower or unavailable until the recovery process is complete.
After these changes are deployed globally, we will begin our recovery process to get all servers back into a healthy state. We expect intermittent calling services issues until full recovery is complete.
We do not yet have an estimated time to full recovery. We will provide more information as soon as possible.
11:00 AM - Update from the carrier - "We have identified the source of the issue causing the high memory utilization and have begun working on a resolution, which will require a recovery process to get all servers back in a healthy state. We expect intermittent calling services issues until recovery is complete. We do not yet have an estimated time to full recovery. We will provide more information as soon as possible. "
***As a workaround we can now forward your main inbound numbers to a cellphone. Please email us at support@vanderlink.com or call us at 417-973-0365 to give us a number to forward your inbound calls to.
Incident Initial Report:
Our upstream carrier is currently experiencing intermittent outages with VOIP services. Customers may experience disruption in their voice communication. We apologize for the inconvenience and will provide updates as we progress towards restoring service.
Maintenance