Human Evals

Human evals involve people directly reviewing and scoring model outputs against defined criteria. They are the most accurate form of evaluation for nuanced or subjective quality dimensions, and serve as the ground truth that other eval methods are validated against. Human evals are slower and more expensive than automated approaches, so they are typically used for high-stakes decisions, calibrating automated evals, or reviewing edge cases flagged by other methods.