RAGAS

RAGAS is an open-source framework specifically designed for evaluating retrieval-augmented generation pipelines. It provides a suite of reference-free metrics, meaning it does not require hand-labeled ground truth answers, which makes it practical to run on real production data. Its core metrics cover the main ways a RAG system can fail: retrieving the wrong context, generating answers that are not supported by the retrieved context, and producing responses that do not actually address the user's question.