Skip to content

Computational Provenance: How to Trust What an AI System Claims

A signature proves who signed an AI system output, not that it is true. See what computational provenance and causal-state attestation can prove.

5 min readEvaluation and assurance

Research area 80: Computational provenance and causal-state attestation

In brief

  • A signature or watermark proves endorsement or origin, never that the claim inside is true.
  • Use the claim-scope chain: byte identity, issuer and lineage, forking into tested causal reliance or an unproven overclaim of semantic truth.
  • Fund evidence capture and causal-reliance tests now, but no study yet supports a return figure or a universal verified-origin badge.

A hash proves bytes match. A signature proves who endorsed them. A causal intervention proves a specific internal state shaped an answer. None of the three proves the answer is true. Executives funding one all-purpose verified-origin badge for AI output are funding a claim wider than the evidence under it, and the 2026 research assembled here shows exactly where that gap opens.

What it is

Provenance and attestation cover at least seven distinct claims, and none subsumes another: data provenance (where information came from), artifact lineage (what was done to it), execution attestation (a measured environment or event), model identity, watermarking (a statistical attribution signal), internal causal tracing (whether a computation depended on a given state), and output attribution (an issuer or process under its own stated assumptions). Treating a narrow one as if it covers a broader one is the most common and most expensive mistake in how enterprises talk about trustworthy AI today.

A claim is only as strong as the specific proposition it certifies: an authorized issuer can sign a false number, such as a stated balance of 100 when the authoritative balance is 80, without the signature ever breaking. Showing evidence was available to a system is not showing the system relied on it, since a shared upstream cause can make two things move together with no dependence between them. Every mechanism here also rests on a trust boundary, some component assumed honest, the logger, the issuer, the instrumentation, and that boundary has to be named out loud.

Three 2026 studies mark the edge of what is proven. A causal-state construction tested 128 public and 128 protected pairs per architecture across multiple seeds inside purpose-built small arithmetic networks, forcing computation through discrete states whose authenticated observations controlled the output. It depends on trusted instrumentation, and answer-only probing of ordinary transformers at the same sites found no equivalent state, so the result stays confined to constrained architectures, not open natural-language generation. A second, on application-layer attestation for multi-hop API pipelines, is graded lower because it stops at trusted-issuer commitments and prototype-scale timings, not wide-area measurements. A third tested six watermark schemes against five attacker models, using 100 training pairs and 400 evaluation examples standardized to 500 tokens, and found spoofing resilience varies by scheme and attacker. None of the three shows a signed, watermarked or attested output is true.

The architecture

The clearest way I have found to run this is what I call the claim-scope chain: a claim about an AI output earns each additional word of trust only through its own new, specific evidence, never by borrowing the evidence already spent one link back.

The animation opens on a single node labeled Output, an AI result with no claim attached yet. A line draws into a three-link chain, byte identity, issuer and lineage, each one lighting in turn as a dot travels through them, showing how a scoped claim is built one piece of fresh evidence at a time. From the last link, the diagram forks into two paths. One leads to a node labeled Causal reliance, reached only through a real intervention test. The other leads to a node labeled Semantic truth, reached by skipping straight to an assumption and marked as an overclaim. A traveling dot follows each path before the whole diagram fades to an empty stage and repeats.
The claim-scope chain: what an AI provenance claim actually proves

The chain starts with byte identity, a hash supporting only that the captured bytes are the bytes in question. The next link is issuer, a signature supporting only that a specific key holder endorsed those bytes under the verification protocol. The next is lineage, a signed record of the transformations and environment an artifact passed through, supporting only that the recorded hops happened as logged, not that every hop that mattered was logged. From lineage the chain forks. One path is causal reliance: a controlled intervention, such as randomizing a private fact after the evidence path is fixed and checking whether the output moves, supporting that a specific state actually shaped the answer. The other path is semantic truth, the proposition that the content itself is correct, which nothing upstream can supply. Treating it as reached the moment lineage is established is the overclaim this discipline exists to catch.

A stage's output guarantee has to actually satisfy the next stage's input assumption, not merely exist alongside it. And a chain with a gap should report that gap as one of four honest states, a complete chain, a verified prefix, an explicit truncation or an absent attestation, rather than rounding a partial chain up.

What it is worth

Ownership belongs with a function structurally separate from whoever builds the system being attested, because the chain's core requirement, evidence a claimant cannot quietly upgrade, fails the moment one team controls both the claim and its label. That function owns the claim taxonomy, the signing keys kept outside any model's editable workspace, and the language used to describe what was actually checked. Fund three things first: signed request and output bindings with freshness and nonce policies, transformation lineage and execution receipts captured at each hop, and a standing program of causal-reliance tests rather than treating an evidence log as proof of reliance. Measure the share of claims landing at each of the four honest states and the share of causal-reliance claims actually intervention-tested.

Two decisions belong to the executive alone: naming the trust boundary for each class of claim, since that sets the ceiling on every claim built above it, and setting retention and access policy for private evidence, since prompts and traces can be re-identified even after hashing, so a receipt kept indefinitely for audit is also a privacy liability kept indefinitely.

Money and risk concentrate in three places: the engineering cost of capture, key management and causal experiments, the downstream cost when a false but signed claim passes silently into a decision, and the exposure when an irreversible action runs on semantic truth assumed rather than tested. The scale of the middle risk is easy to underestimate from one flagged case. At a realistic low prevalence, a detector with 95 percent sensitivity and a 1 percent false-positive rate can still leave the true share of its flagged cases under 9 percent, an illustrative calculation, not a measured result from any study here. The 2026 evidence supports that authenticity is not truth and availability is not reliance. It does not yet support a return figure, since no study here executed a cryptographic implementation, a spoofing experiment or an internal causal intervention, and it does not yet support a general, privacy-preserving causal-attestation capability for open natural-language computation under untrusted intermediaries, an unresolved bridge, not a delivered result.

Questions leaders ask

Does a digital signature prove that an AI system's answer is true?
No. A valid signature only supports that a key holder endorsed the exact bytes under the verification protocol, not that the statement inside those bytes is correct. An authorized issuer can sign a false claim, such as a stated account balance of 100 when the authoritative balance is 80, and the signature stays valid the entire time. Treat a signature as proof of endorsement, never as proof of truth.
What is the real difference between provenance and causal-state attestation?
Provenance records who issued an artifact and what happened to it through signatures, transformation logs and execution receipts. Causal-state attestation goes further and tests whether a specific internal state actually shaped the output, using a controlled intervention rather than observation alone. A 2026 study built this kind of causal-state evidence inside purpose-built small arithmetic architectures with trusted instrumentation, a result that does not yet extend to open natural-language generation.
Can a watermark reliably tell you which model produced a piece of text?
It gives a statistical signal, not a certificate. A 2026 evaluation tested six watermark schemes against five attacker models and found spoofing resilience varies by scheme and by attacker. At a realistic low prevalence, even a detector with 95 percent sensitivity and a 1 percent false-positive rate can leave the true share of its flagged cases under 9 percent, an illustrative calculation rather than a measured study result. Calibrate before acting on a flag.
If a retrieval log shows the right evidence was available, does that prove the system used it?
No. Availability and causal reliance are different claims. Redundant evidence makes this concrete: if two sources carry the same decisive fact, removing either one may leave the answer unchanged, and that does not prove the system never draws on that source. Testing reliance takes a controlled intervention, such as randomizing a private fact after the evidence path is fixed, not a log showing the evidence was merely present.
Is the research ready to support one universal verified-origin badge for AI output?
Not yet. The evidence behind this area is explicit that scalable, privacy-conscious causal attestation for distributed natural-language computation under untrusted intermediaries remains an open research problem, not a deployed capability. What is ready now is narrower and still valuable: signed request and output bindings, transformation lineage, fresh execution receipts and auditable evidence references, each labeled for exactly what it covers.

Want this thinking applied to your organization?