Terminal X matches senior investor judgment 88.6% with GPT-6.1
- ID
- 37661
- Status
- summarized
- Published
- 20 Oct 2026, 3:00 PM
- Fetched
- 21 Oct 2026, 9:03 AM
- Provider
- OpenAI News
- Category
- ai-labs
- Original URL
- https://openai.com/index/terminal-x
- Source URL
- https://openai.com/news/rss.xml
Summary
- Score
- 5.0
- Created
- 21 Oct 2026, 9:03 AM
- Tags
- Audience
- ai_ml_learnersai_agent_userssaas_foundersdevelopers
What happened
OpenAI published a customer story on Terminal X, a North American finance startup whose "Capital Memory" system encodes an investment firm's decision process into hundreds of agents, with an Eval Agent grading outputs against a 54-criterion rubric. On OpenAI's GPT-6.1 Sol, the Eval Agent reportedly caught ~25% more recommendations that strayed from a fund's mandate, showed +220bps higher agreement with human reviewers, and ran at ~30% lower cost per query than the next-best model; Terminal X cites $2.4M annualized savings for one customer. The piece is written by the vendor and reports its own benchmark numbers with no methodology, dataset, or baseline model named.
Why it matters
The reusable pattern here is the eval-agent-as-grader idea: encode your domain standard as an explicit rubric (here 54 criteria) and run a second model over agent output, rather than trusting the agent's own answer. The model-tiering detail is also actionable — GPT-6.1 Sol is positioned for judgment-heavy stages with large context, Luna for cheaper stages, and Terminal X claims 30% lower cost per query by switching. Treat the 88.6%, +220bps, and $2.4M figures as vendor claims: no baseline model is named, no rubric is published, and no holdout set is described, so do not cite them as evidence your own eval agent will behave the same way.
Discussion angle
If an eval agent agrees with a senior expert 88.6% of the time, what does the remaining 11.4% cost you — and how would you even measure that agreement rate on your own workflow without a labelled set of expert judgments to compare against?