Ragas

Ragas is an open-source evaluation framework specifically designed for RAG (Retrieval Augmented Generation) pipelines. It provides metrics like faithfulness, answer relevancy, context precision, and context recall to quantify RAG quality. Ragas can generate synthetic test sets and evaluate both the retrieval and generation components independently.