lance-format/squad-v2-lance

这是一个Lance格式的SQuAD v2（斯坦福问答数据集版本2）数据集，包含基于维基百科段落的可回答和故意不可回答的问题。数据集具有预计算的384维问题嵌入（使用sentence-transformers/all-MiniLM-L6-v2模型，余弦归一化），并内置了IVF_PQ索引以支持语义问题检索。此外，数据集还包含问题和上下文的全文本倒排索引，用于关键词搜索。数据以列式存储，集成了问题、上下文、答案范围、嵌入等信息，支持按需投影列。数据集分为训练集（130,319行）和验证集（11,873行），适用于问答、文本检索和阅读理解任务。A Lance-formatted version of SQuAD v2 — the Stanford Question Answering Dataset with both answerable and deliberately unanswerable questions over Wikipedia passages — with MiniLM question embeddings stored inline and ready for retrieval. It includes pre-computed 384-dim question embeddings, built-in IVF_PQ index for semantic retrieval, full-text inverted indices for keyword search, and columnar storage integrating questions, contexts, answer spans, and embeddings. The dataset is split into train (130,319 rows) and validation (11,873 rows) and is suitable for question-answering, text-retrieval, and reading-comprehension tasks.