Skip to content
Protean LabsDocs

Claim QA

Claim QA is a conservative evidence-boundary layer for generated explanations and assessment papers. It checks whether generated statements are supported, weakly supported, contradicted, or unsupported by local evidence records.

The primary entailment route is tasksource/ModernBERT-base-nli. If the model is unavailable, Protean falls back to deterministic claim checks and explicit warnings.

Classifications

  • Supported: aligned with local evidence under the configured entailment or heuristic checks.
  • Weakly supported: plausible context exists, but the evidence is not strong enough for confident language.
  • Unsupported: no sufficient evidence was found.
  • Contradicted: retrieved evidence conflicts with the generated statement.

Unsupported or contradicted statements downgrade confidence and appear in artifacts. They do not automatically rewrite scoring, mutate learning rules, or block the runtime unless a downstream operator chooses to act.

Guardrails

Claim QA prevents generated materials from quietly drifting into:

  • biological efficacy claims
  • safety claims
  • clinical readiness claims
  • patentability claims
  • legal conclusions

Computational assessments remain computational assessments until external validation exists.

Artifacts

data/results/claim_qa_latest.jsonl
data/results/claim_qa_summary_latest.json

These artifacts provide reviewable claim discipline for candidate papers, explanation briefs, and scientific handoff.