← Back to the blog AI Briefing · Morning Edition

AI has a judgment problem

Three fresh research releases expose the gap between producing a plausible answer and doing the disciplined work that makes an answer dependable.

A realistic present-day research and operations team comparing printed AI evidence, source notes and evaluation results in natural morning light

AI can produce a roomful of good-looking answers before it finds one worth acting on. Three preprints released on August 4 point to the same operating weakness: models can generate plausible ideas, rewrite information fluently and search across media, yet still fail at selection, source fidelity and evidence use.

That is the most useful signal in AI news today. The next enterprise advantage may not come from a model that says more. It may come from a system that knows what to discard, keeps uncertainty attached to a claim and proves it inspected the evidence it was given.

10 of 40Real Formula 1 innovations matched by the best tested model after 166 ideas across runs.
5 of 8Hedged-hearsay memory writes flagged in one small mem0 2.0.7 run.
64.0%Author-reported average accuracy for the strongest Video-DeepResearch variant.
3 gapsSelection, source fidelity and evidence-channel use.

Idea generation is outrunning selection

University of Oxford researchers William Bolton and Philip Torr tested AI systems in two fast-moving domains where expert answers appeared only later: Formula 1 design under new 2026 rules and competitive Magic: The Gathering deck construction. The setup is useful because it reduces the chance that a model merely recalls an answer from its training data.

In Formula 1, the authors report that the best model, GPT-5.2, matched 10 of 40 real innovations after producing 166 ideas across runs. In the card-game test, models also found some valuable patterns, but they missed much of the context that made expert combinations coherent. The paper’s conclusion is sharper than a generic creativity score: the central gap was filtering and prioritisation, not the ability to propose something plausible.

That distinction belongs in every enterprise AI evaluation. A system that proposes 20 workable campaign ideas, diagnoses or process changes may look productive. If a human must spend more time separating the useful three from the plausible 17, the automation has moved labour rather than removed it.

For evaluation teams: Measure precision among the model’s top recommendations, not just whether a correct idea appears somewhere in a long list.

AI memory can wash away uncertainty

Independent researcher Alex Kwon names a second failure “factwashing”: an AI rewrite keeps the core claim but drops who said it, how certain they were or when it applied. A rumour can therefore enter memory as an asserted fact without a classic hallucination ever occurring.

Kwon’s preprint releases an open-source write-time gate that compares a proposed memory with its source. In one small run on unmodified mem0 2.0.7, it flagged five of eight hedged-hearsay writes. The paper explicitly warns that this is one configuration and one sampled run, with a wide uncertainty interval and a known false positive among five controls. A flag is a request for review, not proof of corruption.

The business risk is still concrete. AI automation increasingly turns calls, email and chat into stored facts that later agents use for access, customer service or approvals. Conventional factuality tests can miss a rewrite that preserves the words but changes the status of the information. Provenance, certainty and time scope need first-class fields, not a hope that fluent prose will preserve them.

Multimodal agents still take shortcuts

A separate team behind Video-DeepResearch tested agents that must combine evidence from continuous video with open-web research. The authors found a modality bias: general models often preferred text search over visual tools, even when the question required inspecting frames. They also found signs of models leaning on internal knowledge rather than performing the requested tool-based investigation.

The team trained specialised 30B and 35B variants with staged access to visual and text tools. On its new 200-question benchmark, it reports 64.0% average accuracy for the stronger model, compared with 59.0% for Claude 4.5 Sonnet, 57.5% for Gemini 2.5 Pro and 52.5% for GPT-5 under the authors’ test conditions. Those are results on a new, author-built benchmark judged partly by another model; they need independent replication.

The operating lesson does not depend on accepting the leaderboard. When a task requires a contract, image, recording or spreadsheet to be inspected, a correct-looking answer is not enough. Logs should show that the agent opened the relevant evidence, used the right tool and linked its conclusion back to the source.

Reliable automation needs an evidence contract

Together, the papers suggest a practical design for generative AI systems: define what evidence must be consulted, what metadata must survive every rewrite and how options will be ranked before any action is taken. That can be expressed as an evidence contract for each workflow.

For a sales agent, the contract might require the current price sheet, the customer’s signed terms and a ranked recommendation with disqualifying conditions. For a compliance workflow, it might require source attribution, confidence, effective dates and an audit trail. For visual inspection, it should record the frames examined rather than accepting an answer assembled from nearby text.

This also matters for AI regulation. Rules increasingly require transparency, traceability and human oversight, but compliance cannot be added as a label after the model responds. Evidence retention and tool-use receipts have to live inside the workflow. That is where the latest AI business trends meet governance: buyers will need proof of how an answer was formed, not just a polished answer.

The real upgrade is disciplined judgment

The latest AI news often rewards larger context windows, higher benchmark scores and longer autonomous runs. These results point in a less glamorous direction. Reliability depends on controlling what enters memory, forcing the right evidence path and making the system choose well under constraints.

None of the three preprints settles the question. Their benchmarks are new, the results are author-reported and the factwashing production sample is deliberately small. But their shared warning is hard to ignore: fluency hides process failures exceptionally well.

The next useful leap in artificial intelligence news will not be an agent that produces more. It will be one that can show why its chosen answer survived.