AI Weekly Malaysia

Cloudflare opened a closed beta for a self-serve OHTTP Gateway, a paid add-on customers enable on their zone to receive Oblivious HTTP traffic without seeing client IP addresses or TLS fingerprints. OHTTP splits requests across two independently operated hops — a relay that blindly forwards encrypted requests and a gateway that decapsulates them — so no single party sees both client identifiers and request contents; Cloudflare also renamed its 2022 'Privacy Gateway' product to 'Cloudflare OHTTP Relay'. Named users of the pattern include Flo Health's app Anonymous Mode and Apple's Private Cloud Compute, which uses OHTTP to disassociate AI inference requests from user identities.

Why: The specific decision: if your servers already sit behind Cloudflare, you previously could not pair them with a Cloudflare-operated relay without collapsing the relay/gateway separation of trust — this gateway is the missing half, so the choice becomes pairing a non-Cloudflare relay with the Cloudflare gateway versus staying with your current setup. Because it is a waitlist closed beta on a paid add-on with no published price, treat it as a watch-list item and do not architect around it this quarter; the actionable step now is deciding whether an IP-free request path is worth a two-hop latency and vendor-pairing cost for any feature where you currently log client IPs. No Malaysia- or SEA-specific detail appears in this text, so the relevance is only as general infrastructure local apps could adopt.

TechCrunch reports, citing a source with knowledge of the deal, that AI inference provider Modal Labs is close to a $750 million round led by Accel at a $15.75 billion valuation — more than triple the $4.65 billion it hit in its $355 million raise just four months earlier. The article notes the wider inference market is repricing fast: Baseten is reportedly nearing a round at a $26 billion valuation (double its June number), Fireworks said in July its annualized revenue hit $1 billion (5x year over year), and Fal has also talked to investors. It also flags the catch: revenue is growing quickly but margins are thin because acquiring or leasing compute stays expensive.

Why: This is a capital-markets signal, not a product change — no pricing, API, or capability change is stated, so there is nothing to migrate or re-architect today. The one decision-relevant detail is the thin-margin caveat alongside Fireworks' $1B annualized revenue: if you are choosing an inference provider for a production or agent workload, expect competition to keep going up while compute costs keep the providers' margins thin, which makes multi-provider abstraction and exit cost worth designing for before you commit. Nothing here is Malaysia-specific; treat it as context on the vendors a Malaysian team might depend on, not as local market news.