AI-assisted mushroom hunting is a recipe for a bad trip
- ID
- 20934
- Status
- summarized
- Published
- 03 Sep 2026, 4:34 AM
- Fetched
- 03 Sep 2026, 7:51 AM
- Provider
- The Register
- Category
- technology
- Original URL
- https://www.theregister.com/offbeat/2026/09/02/ai-assisted-mushroom-hunting-is-a-recipe-for-a-bad-trip/5294060
- Source URL
- https://www.theregister.com/headlines.atom
Summary
- Score
- 6.5
- Created
- 03 Sep 2026, 7:53 AM
- Tags
- Audience
- developersai_agent_usersai_ml_learners
What happened
Polish software engineer Piotr Migdał tested 16 AI models on 1,040 mushroom photos across 55 species, finding that even the best performer (Gemini-3.8-flash) identified the correct species on first guess only 65% of the time. Critically, the errors were not random—deadly species were confused with edible ones in patterns that mirror real foraging fatalities, such as the death cap being mistaken for edible species 16-48% of the time.
Why it matters
This is a concrete, measured demonstration that LLM vision models fail in systematic, dangerous ways on high-stakes classification tasks—not randomly, but in exactly the patterns that cause real-world harm. Builders shipping AI agents or tools for any domain where misclassification has real consequences (food safety, medical, compliance) should treat this as evidence that confidence scores and top-5 accuracy are insufficient guardrails; you need domain-specific validation layers, not just a model call.
Discussion angle
The most useful takeaway isn't about mushrooms—it's that model errors cluster in semantically meaningful ways (deadly webcap → chanterelle is the exact mistake that kills foragers). How do you detect whether your AI agent's failure modes are the 'harmless wrong answers' or the 'specifically dangerous' ones before shipping?