The AI answer cites a document that does not support its advice. What should I change?

Citation without grounded support

A citation is useful only when the cited passage actually supports the statement. Evaluate answer-to-source alignment, show the relevant passage, and allow the assistant to say the evidence is insufficient. Review retrieval quality separately from the quality of the generated wording.

What to do now

  1. Inspect the cited source passages
  2. Check support for each important claim
  3. Improve retrieval and evidence display
  4. Reject or revise unsupported answers
Recommended action flow for citation without grounded support: Inspect the cited source passages then Check support for each important claim then Improve retrieval and evidence display then Reject or revise unsupported answers. Escalate when unsupported guidance affects a high-impact project decision.

When to escalate

Escalate when

Unsupported guidance affects a high-impact project decision.

Who decides

The AI service owner and relevant authorized reviewer

Example

The assistant cites a procurement policy but the cited section does not authorize the proposed purchase.

Mistake to avoid

Counting the number of citations instead of checking their relevance.

Prevent a repeat

Re-evaluate after changes to models, prompts, tools or source data; keep important decisions accountable to people.

Suggested ApprovedFlow setup

  • Tasks
  • Documents
  • Approvals

Track evaluation and review tasks, and keep approved evidence with the work; do not claim the platform provides an unverified AI agent or automated diagnosis. See the platform

Related cases

Practice references