AI Weekly Malaysia

Back to items Summaries

The gap in shared understanding of LLM capability is widening

ID
34378
Status
summarized
Published
12 Oct 2026, 4:20 AM
Fetched
12 Oct 2026, 10:48 AM
Provider
Hacker News
Category
dev-community
Original URL
https://twitter.com/karpathy/status/2109361546505966046
Source URL
https://hnrss.org/best

Summary

Score
6.5
Created
12 Oct 2026, 10:48 AM
Tags
Audience
developersvibe_codersai_ml_learnersai_agent_userssaas_founders

What happened

Andrej Karpathy re-upped an April tweet arguing the gap in shared understanding of LLM capability has stopped being two groups talking past each other and become a 'sharp funnel' with four tiers: roughly 6B people (~75%) who have barely touched LLMs, 1-2B (~20%) casual free-tier chatbot users who treat it as a better search or writing aid, ~20M (~0.2%) professionals doing frontier-grade math and code work where agents finish weeks-long projects from a prompt, and ~5,000 (~0.00006%) with internal access to frontier systems. He attributes the funnel to impact scaling with ambition, problem size and horizon, plus the jaggedness of the systems. He also notes human review and comprehension are falling behind, citing people still doing 'archeology' on the OpenAI-HF incident and mathematicians working through 722 frontier-mathematics manuscripts. The Hacker News thread drew 259 points and 424 comments.

Why it matters

If your product assumes your users are in the 0.2% tier, you are probably building for a market of ~20M people globally, not the 20% tier where most paying customers and almost all non-tech professionals actually sit. Decide deliberately which tier you're selling into: a casual-tier user described here wants a writing aid or flight-booking agent, not a multi-week autonomous swarm, and shipping swarm-grade autonomy to that user produces the 'derpy chatbot' experience that makes them conclude they have no use for it. The 722-manuscript and OpenAI-HF examples are also a concrete warning for teams shipping agent output: if review can't keep pace with generation, the archaeology cost lands on you later.

Discussion angle

Ask everyone in the room to place themselves and their target customer in one of the four tiers — then check whether the autonomy level they're shipping matches the tier their actual buyers occupy, especially if you're building for Malaysian SMEs or non-technical teams who live in the 20% casual tier.

Top