Rapidly scaling online storage to serve over 1 billion ChatGPT users (Part II)
Summary
OpenAI describes how Habitat was scaled with dependable multi-tenancy, worldwide caching, and Azure Cosmos DB to deliver 12x faster reads.
Why this matters
Official source · Covers GPT and API
Source: OpenAI News · openai.com