Deterministic Evals

Deterministic evals use fixed, rule-based checks to score model outputs. Examples include checking whether a response contains a required keyword, matches an expected format, or equals a known correct answer exactly. They are fast, cheap, and fully reproducible, making them a good first layer of evaluation for any system. Their limitation is that they cannot assess open-ended or subjective output quality.