Explainer
Groundedness and correctness
An answer can follow its source faithfully even when that source is wrong or incomplete.
Groundedness, also called faithfulness, checks whether an answer's claims follow from supplied evidence. Correctness asks whether the answer is right for the task. If an old notice gives outdated opening hours, repeating it faithfully can still mislead a visitor. ARES evaluates evidence relevance, answer faithfulness and answer relevance separately.
Completeness adds another question. An answer can correctly explain Sunday returns but omit a question about late fees. Every claim it makes can be supported while a required answer is missing. The library example shows this with invented answers.
Going deeper
A citation needs to support the claim attached to it. A correct fee statement that cites the returns passage, D1, instead of the fees passage, D2, has a citation problem. Checking that a URL opens does not check its evidence. ALCE separates correctness and citation quality. A system that fetches documents also needs a check that it found the required evidence.
Read next: Grade an AI answer