nepbench

# NEPbench This repository contains NEPbench annotations and the corresponding videos used in the evaluation. Files: - `data/NEPbench.jsonl`: original JSONL, preserving the source video paths. - `data/NEPbench_modelscope.jsonl`: JSONL with `videos` rewritten to relative paths under `videos/<source>/<video>.mp4`. - `videos_*.tar`: corresponding videos grouped by source dataset. Extract them at the repository root so paths match `NEPbench_modelscope.jsonl`. - `manifests/*.tsv`: source path to repository-relative path mapping. Rows: 3000 Video counts: - charades: 635 - vidsitu: 1391 - youcook2: 974 Gold mapping note: for rows whose assistant message is a JSON mapping, the mapping is current option -> original option. The mapped gold is the current option whose value is original `A`. Rows whose assistant message is already a single option letter use that letter directly.