RAGProbe: A Novel Approach for Evaluating RAG Pipelines

This contains the dataset of the manual execution results of evaluation scenarios, the list of RAG repositories, the automatic generation of question answer pairs and execution of evaluation scenarios across 5 open-source RAG pipelines using our approach and RAGAS approach, and automation scripts for generating question-answer pairs and execution of generated questions across the selected RAG pipelines.