OpenAI's Infrastructure Gamble on Ephemeral Kubernetes Servers

OpenAI's voice AI infrastructure exposes a technical tension: WebRTC, the protocol powering low-latency voice, assumes persistent server identities, but Kubernetes—the dominant container orchestration platform—destroys and recreates servers at will. Engineers must choose between abandoning Kubernetes's elasticity or patching WebRTC's assumptions, creating a gap between what modern infrastructure promises and what the protocol requires. Whoever solves this cleanly gains a competitive advantage, since every AI company pursuing voice-first interfaces faces the same constraint.