EXAMPLES / EVIDENCE FIRST
A demonstration you
can inspect.
Our launch sample is being prepared using original, fictional product documentation.
What the sample will contain
The internal kit contains 30 draft cases: 20 intended for publication after review and ten reserved as a private holdout. The case mix includes straightforward, multi-document, ambiguous, and unsupported questions.
| Dimension | Reviewer question |
|---|---|
| Answer correctness | Does the response meet the reference answer and expected behavior? |
| Evidence support | Do the cited passages support the response’s claims? |
| Citation validity | Are citations resolvable, relevant, and attached to the right claim? |
Review before release
Two named human reviewers must assess each response and record their reasoning. Disagreements require an explicit resolution. Automated checks verify file integrity and evidence references but cannot approve cases for publication.
METHOD DOCUMENT · DRAFT v0.2
Evaluation method and report outline
How we review a RAG assistant, from agreeing scope to a finding your team can reproduce.
- 5-stage workflow
- 3 review dimensions
- 4 failure categories
- Example finding record
- Report structure
This download is a method document, not a reviewed sample report. Completed examples will replace this status after approval.
Discuss a relevant demonstration
Tell us the workflow you need to evaluate. We can scope examples around your authorized documentation and acceptance criteria.
Discuss a pilot →