Why AI Compute Comes in Rectangles — Erik Bernhardsson, Modal CEO
- ID
- 38367
- Status
- summarized
- Published
- 23 Oct 2026, 1:40 AM
- Fetched
- 23 Oct 2026, 2:25 AM
- Provider
- Latent Space
- Category
- developer-ai
- Original URL
- https://www.latent.space/p/modal-d
- Source URL
- https://www.latent.space/feed
Summary
- Score
- 7.0
- Created
- 23 Oct 2026, 2:25 AM
- Tags
- Audience
- developersvibe_codersai_ml_learnersai_agent_userssaas_startup_founders
What happened
Latent Space interviews Modal CEO Erik Bernhardsson after Modal reported crossing $1B annualized run rate, raising a $750M Series D at a $16B valuation, and spinning up nearly 3B sandboxes. The core argument is that fixed GPU capacity contracts look like rectangles, while real AI workloads spike and fall, so Modal pools demand across thousands of customers and sells elastic slices; the risk is locking in supply at today’s prices if GPU prices fall. Modal’s sandbox product was nearly shut down before coding agents, background agents, and reinforcement learning created new demand.
Why it matters
If you build coding agents or background agents, this gives a concrete signal that code-execution sandboxes can become a major workload: Modal says it has run nearly 3B sandboxes, and the product survived only after agent workloads arrived. That argues for designing agent execution around per-use elastic sandboxes rather than buying peak GPU capacity up front, and for checking whether a provider’s pooled-capacity model exposes you to repricing if GPU prices fall.
Discussion angle
Modal’s sandbox almost got shut down before coding agents took off — what workload signals would make you bet on agent code-execution infrastructure now, and would you use a pooled per-use sandbox API or keep self-hosting?