AI Weekly Malaysia

Back to items Summaries

America.gov gets really weird when you ask it about Minecraft, but it’s not a glitch

ID
30071
Status
summarized
Published
30 Sep 2026, 7:30 AM
Fetched
30 Sep 2026, 8:25 AM
Provider
TechCrunch
Category
technology
Original URL
https://techcrunch.com/2026/09/29/america-gov-gets-really-weird-when-you-ask-it-about-minecraft-but-its-not-a-glitch/
Source URL
https://techcrunch.com/feed/

Summary

Score
3.0
Created
30 Sep 2026, 8:25 AM
Tags
Audience
developersvibe_codersai_ml_learners

What happened

The U.S. government launched the America.gov AI chatbot on Tuesday, September 29, 2026, built in partnership with Google and SpaceXAI, and it has reportedly resisted jailbreak attempts. But asked about Minecraft, it produced a roughly 1,800-word monologue that is a rewrite of the Minecraft "End Poem" by Julian Gough, and the chatbot also states that Joe Biden won the 2020 election. In a speech, Trump named twenty-year-old programmer Edward Coristine, previously known as "Big Balls" from his DOGE involvement, as a lead engineer on the project.

Why it matters

The guardrails held against direct jailbreaks but not against off-topic pop-culture prompts, which is the failure mode most teams under-test: if you ship a public-facing LLM, your launch story is whatever a random off-topic prompt makes it emit. The article does not say which model was used, whether Google or SpaceXAI trained or only integrated it, or how the End Poem text got into the response, so there is no reusable technical takeaway here - only a reminder to red-team trivia and pop-culture inputs, not just adversarial ones, before launch.

Discussion angle

What does your team test for before shipping a public chatbot - adversarial jailbreaks only, or off-topic and pop-culture prompts too? The interesting failure here isn't that it broke, it's that it didn't break the way anyone tested for.

Top