Import AI 476: Creativity and RSI; worse-than-China open weight models; AI goes to space
- ID
- 34536
- Status
- summarized
- Published
- 12 Oct 2026, 8:30 PM
- Fetched
- 12 Oct 2026, 11:30 PM
- Provider
- Import AI
- Category
- research-analysis
- Original URL
- https://importai.substack.com/p/import-ai-476-creativity-and-rsi
- Source URL
- https://importai.substack.com/feed
Summary
- Score
- 6.5
- Created
- 12 Oct 2026, 11:32 PM
- Tags
- Audience
- developersai_ml_learnersai_agent_users
What happened
Import AI 476’s available excerpt covers Humanity’s Sixth Sense (HSS), a benchmark built by Elorian and Scale AI to test intuitive visual reasoning: 522 questions over 288 images and 234 short video clips (17.6 hours). Human aggregate pass@1 is 93.1, while the best AI system, GPT 6 Astra, scores 53.6; Chinese open-weight models GLM-5.3-flash and Kimi K3 score 26.8 and 25.5. The most common failures are missing a detail that decides the answer (21%) and misidentifying an object, person, or role (20%).
Why it matters
Before shipping a multimodal feature that asks users to upload photos or videos, test it on unstated-context questions like whether a bookcase can fit more books or whether chains bear a plough’s drag weight. HSS shows the best AI system at 53.6 pass@1 versus humans at 93.1, with 21% of failures from missing a deciding detail and 20% from misidentifying objects, people, or roles. If you are choosing open-weight models, GLM-5.3-flash at 26.8 and Kimi K3 at 25.5 on HSS means they likely need extra guardrails for visual reasoning tasks.
Discussion angle
Ask whether a 53.6 pass@1 on HSS is good enough for your multimodal agent use case, or whether tasks involving physical fit, temporal order, and social intent need human review or a different model choice. Also compare whether the low HSS scores for GLM-5.3-flash and Kimi K3 would change your open-weight evaluation shortlist.