SPRA 2026 — Supplementary S1: RAG Evaluation Results for Scope-Gated Retrieval (Elevator Maintenance, Schindler 3300/5500)
收藏资源简介:
Summary. This repository contains Supplementary S1 for our SPRA 2026 submission: an anonymized evaluation dataset with results collected from 10 queries executed against a scope-gated RAG system for elevator maintenance manuals. The artifact includes the consolidated results (S1_RAG_Eval_Results.xlsx), a data dictionary, and a README describing provenance, ethics, and usage.Provenance. The underlying corpus consists of proprietary technical documentation owned by an industrial partner (HTL Elevadores S.A.C.). Documents were processed via OCR, cleaned, deduplicated, and chunked into component/procedure-level segments with metadata. No proprietary text is included here; only derived evaluation outputs.Contents. (i) S1_RAG_Eval_Results.xlsx (sheet results)Intended use. Reproducibility of aggregate metrics (answer-with-evidence@k, refusal correctness, scope-hit distribution, token/cost stats).Ethics & Availability. The source corpus is under NDA and not publicly available; this supplement shares non-sensitive derivatives only.Related work. Scope-gated retrieval policies for domain-constrained RAG; industrial maintenance and safety documentation.



