InfiniQA: A Large-Scale French Question-Answering Dataset with Comprehensive Evaluation

We introduce InfiniQA, a large-scale French question-answering dataset containing 101,084 manually validated question-answer pairs. Unlike existing French QA datasets that rely on extraction or translation, InfiniQA focuses on direct, factual Q&A pairs created natively in French. Our comprehensive evaluation framework demonstrates the efficiency of metric computation through ground truth vs modified response comparisons across multiple metrics including Exact Match, BLEU scores, and ROUGE metrics. The dataset covers diverse domains including culture, history, geography, and sports, with a vocabulary of 83,592 unique words. InfiniQA establishes a new benchmark for French QA evaluation and provides a valuable resource for training and evaluating French language models.