The outage, in one clear storyline
This version puts the outage first, keeps billing in the background, and explains the issue as a service-control problem with a simple progression from normal state to constrained recovery to restored operations.
Chapter 1
Normal production design
OpenFax operated through a redundant Equinix Direct Connect design, with an active/standby arrangement. Telnyx propagated the private NAT over BGP, and production media was expected to travel over the VXC path.
- Private NAT presented through the Telnyx-provided VXC environment
- SIP and media were originally aligned to the private deployment
- This deployment pattern was prescribed by Telnyx during installation and deployment testing
Chapter 2
OpenFax narrowed the failure
Before the total outage, OpenFax was already seeing many calls with random signaling misses. During the outage, media was not received at all. That combination raised the possibility that the private-IP NAT signaling path had been inconsistent for a longer period before the full production break.
- Random signaling was not received on many calls before the total outage
- During the outage window, no media was being received
- Short call durations and long-extended calls may both fit a longer-running private NAT inconsistency
Chapter 3
Recovery required a new region
With no customer-side portal control over the private path, no visible VXC object in the online account, and no timely response to test disabling the VXC over roughly two days despite repeated email and phone escalation, OpenFax had to restore operations by standing up infrastructure in another region over public internet. That recovered service before the original private path was resolved.
- OpenFax could adjust signaling behavior on its own side, but not the Telnyx return path
- Repeated support attempts by email and phone did not produce timely VXC disablement testing
- Recovery came from bypassing the affected private environment entirely