AI Weekly Malaysia

A Hugging Face blog post from MultiverseComputingCAI (Antonio Tiene, Ander Alvarez Sanz, Oliver Wirjadi) introduces ProvenanceGuard, a factuality verifier for MCP-based LLM agents that checks not just whether a claim is supported by pooled evidence but whether the supporting source matches the source the answer names. It targets a failure mode the authors call 'cross-source conflation' — e.g. a 30-day refund window that is real but stated in a policy document while the answer attributes it to the account record, or a patient-history detail presented as a medical-literature finding. The post argues existing checkers (RAGAS faithfulness, MiniCheck, AlignScore, SummaC) pool evidence and therefore pass such claims, and points to a paper on Hugging Face and arXiv, though the excerpt cuts off before any accuracy numbers or benchmarks.

Why: If you ship an MCP agent that writes citations like 'according to the account record', RAGAS-style faithfulness scoring will not catch a claim that is true in some other tool output but attributed to the wrong one — and in support, clinical, or financial contexts that misattribution is as damaging as a wrong fact. The practical decision is to add a per-source check (does the cited tool output actually contain the claim?) rather than a pooled-evidence score; note the post publishes no measured improvement over the existing checkers, so treat it as a design pattern to prototype, not a drop-in library to adopt.