FoleySet: A MultiI-Level Human-Annotated Foley Sound Dataset

In audiovisual post-production, Foley refers to synchronous sound effects associated with human actions, such as footsteps, cloth rustle, and prop handling, that are recreated to match the on-screen movements and interactions of characters. These sounds are often recorded by professional Foley artists using physical props. This resource-intensive workflow has motivated data-driven research on Foley, including tasks such as classification, retrieval, and generation; however, high-quality annotated Foley datasets for training remain scarce. To address this gap, we present FoleySet, a publicly available Foley dataset of 10,000 audio clips annotated with a two-level Foley taxonomy. This dataset provides a standardized, Creative Commons–licensed resource for data-driven Foley classification, retrieval, and generation.在视听后期制作领域，拟音（Foley）指与人类动作相关的同步音效，例如脚步声、衣物摩擦声、道具操作声，这类音效会被重新创作以匹配角色在银幕上的动作与互动。这些音效通常由专业拟音师使用实体道具录制完成。这种资源密集型的工作流程推动了拟音领域的数据驱动研究，涵盖分类、检索与生成等任务；但目前用于模型训练的高质量带标注拟音数据集仍较为稀缺。为填补这一研究空白，我们推出FoleySet：一个公开可用的拟音数据集，包含10000条音频片段，并采用两级拟音分类体系进行标注。该数据集为数据驱动的拟音分类、检索与生成任务提供了标准化且采用知识共享（Creative Commons）许可的研究资源。

搜集汇总

背景与挑战

背景概述

FoleySet是一个包含10,000个音频片段的Foley声音数据集，采用两级分类法进行人工标注，专门用于解决高质量标注Foley数据稀缺的问题。该数据集以Creative Commons许可证公开，支持Foley分类、检索和生成等数据驱动研究。