Skip to main content
    Publications

    Two Web Toolkits for Multimodal Piano Performance Dataset Acquisition and Fingering Annotation

    Y. Kim, J. Park, Joonhyung Bae, K. Kim, T. Kwon, A. Lerch, J. Nam

    Proc. 26th Int. Soc. for Music Inf. Retrieval Conf. (ISMIR), Daejeon, Korea, Sep. 21–25, 2025

    2025 · Abstract/Demo · Published

    arXiv:2509.15222PDF

    In one sentence

    PiaRec (synchronized audio/video/MIDI recording) and ASDF (video-based fingering annotation): two web GUIs for building multimodal piano datasets.

    Abstract

    Piano performance is a multimodal activity that intrinsically combines physical actions with the acoustic rendition. Despite growing research interest in analyzing the multimodal nature of piano performance, the laborious process of acquiring large-scale multimodal data remains a significant bottleneck, hindering further progress in this field. To overcome this barrier, we present an integrated web toolkit comprising two graphical user interfaces (GUIs): (i) PiaRec, which supports the synchronized acquisition of audio, video, MIDI, and performance metadata. (ii) ASDF, which enables the efficient annotation of performer fingering from the visual data. Collectively, this system can streamline the acquisition of multimodal piano performance datasets.

    Source: arXiv:2509.15222

    When this paper is relevant

    • You need tooling to record and synchronise piano performance data at scale
    • You need a GUI to annotate fingering from video efficiently

    Related

    Cite

    Y. Kim, J. Park, Joonhyung Bae, K. Kim, T. Kwon, A. Lerch, J. Nam (2025). Two Web Toolkits for Multimodal Piano Performance Dataset Acquisition and Fingering Annotation. Proc. 26th Int. Soc. for Music Inf. Retrieval Conf. (ISMIR), Daejeon, Korea, Sep. 21–25, 2025. https://arxiv.org/abs/2509.15222

    @inproceedings{Kim2025two,
  title = {Two Web Toolkits for Multimodal Piano Performance Dataset Acquisition and Fingering Annotation},
  author = {Y. Kim and J. Park and Joonhyung Bae and K. Kim and T. Kwon and A. Lerch and J. Nam},
  booktitle = {Proc. 26th Int. Soc. for Music Inf. Retrieval Conf. (ISMIR), Daejeon, Korea, Sep. 21–25, 2025},
  year = {2025},
  eprint = {2509.15222},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2509.15222}
}

    Machine-readable copy: /papers/two-web-toolkits-2025.md