Pipaset preview: A multimodal dataset for AMT and EA tasks dedicated to Chinese music instrument Pipa

Yuancheng Wang, Yuyang Jing , Wei Wei, Dorian Cazau, Olivier Adam, Qiao Wang Accompanying Website here. If you make use of PipaSet for academic purposes, please cite the following publication: PipaSet and TEAS: A Multimodal Dataset and Annotation Platform for Automatic Music Transcription and Expressive Analysis dedicated to Chinese Traditional Plucked String Instrument Pipa. IEEE ACCESS 2022. This project was led by Yuancheng Wang at Information School of Information Science and Engineering, Southeast University, China, along with my supervisor Prof. Qiao Wang from same school and Dr. Yuyang Jing from Nanjing University of the Arts, Wei Wei form Xiaozhuang University, Dr. Dorian Cazau from Institute of Mines-Télécom Atlantique in Brest France, Prof. Olivier Adam from Sorbonne University. We present PipaSet, a dataset that provides multimodal pipa recordings alongside a high diversity of annotations for Automatic Music Transcription and Expressive Analysis tasks, including note, pitch contours, string and fret positions, and playing techniques. More information will be coming soon to cover more pieces of music played by pipa.

王远城、荆雨阳、魏伟、多里安·卡佐（Dorian Cazau）、奥利维耶·亚当（Olivier Adam）、王桥。配套网站见此处。若将PipaSet用于学术研究，请引用如下文献：《PipaSet与TEAS：面向中国传统弹拨乐器琵琶的自动音乐记谱（Automatic Music Transcription）与音乐表达分析（Expressive Analysis）多模态数据集（Multimodal Dataset）及标注平台（Annotation Platform）》，发表于《IEEE 接入》2022年。本项目由中国东南大学信息科学与工程学院的王远城牵头，其合作导师为同校的王桥教授，此外团队成员包括南京艺术学院的荆雨阳博士、晓庄学院的魏伟、法国布雷斯特矿业电信大西洋学院的多里安·卡佐博士，以及索邦大学的奥利维耶·亚当教授。本研究发布PipaSet数据集，该数据集包含多模态的琵琶录音，并针对自动音乐记谱与音乐表达分析任务提供了丰富多样的标注信息，涵盖音符、音高轮廓、弦位与品位以及演奏技法等内容。后续将新增更多琵琶演奏曲目相关的数据集内容。

搜集汇总

背景与挑战

背景概述

Pipaset preview是一个专门针对中国传统乐器琵琶的多模态数据集，旨在支持自动音乐转录和表达分析任务。它提供多模态录音以及音符、音高轮廓、弦和品位置、演奏技巧等多种注释，由东南大学等机构的研究团队于2022年发布，遵循开放许可协议。