# Two Web Toolkits for Multimodal Piano Performance Dataset Acquisition and Fingering Annotation

- Authors: Y. Kim, J. Park, Joonhyung Bae, K. Kim, T. Kwon, A. Lerch, J. Nam
- Venue: Proc. 26th Int. Soc. for Music Inf. Retrieval Conf. (ISMIR), Daejeon, Korea, Sep. 21–25, 2025
- Year: 2025
- Type: Abstract/Demo
- arXiv: https://arxiv.org/abs/2509.15222
- PDF: https://drive.google.com/file/d/1hAMDnqXYLKOBA2iPVXBJ2TL9xgSAJnRs/view?usp=drive_link
- Keywords: web toolkits, piano performance, dataset acquisition, fingering annotation, music technology
- Page: https://joonhyungbae.com/publication/two-web-toolkits-2025

## In one sentence

PiaRec (synchronized audio/video/MIDI recording) and ASDF (video-based fingering annotation): two web GUIs for building multimodal piano datasets.

멀티모달 피아노 데이터 수집용 PiaRec(오디오·영상·MIDI 동기 녹화)과 영상 기반 운지 주석 도구 ASDF.

## Abstract

Piano performance is a multimodal activity that intrinsically combines physical actions with the acoustic rendition. Despite growing research interest in analyzing the multimodal nature of piano performance, the laborious process of acquiring large-scale multimodal data remains a significant bottleneck, hindering further progress in this field. To overcome this barrier, we present an integrated web toolkit comprising two graphical user interfaces (GUIs): (i) PiaRec, which supports the synchronized acquisition of audio, video, MIDI, and performance metadata. (ii) ASDF, which enables the efficient annotation of performer fingering from the visual data. Collectively, this system can streamline the acquisition of multimodal piano performance datasets.

(Source: arXiv:2509.15222)

## When this paper is relevant

- You need tooling to record and synchronise piano performance data at scale / 피아노 연주 데이터를 대규모로 수집할 녹화·동기화 도구가 필요할 때
- You need a GUI to annotate fingering from video efficiently / 영상에서 운지를 효율적으로 주석하는 GUI가 필요할 때

## Related

- PianoVAM: A multimodal piano performance dataset (2025): https://joonhyungbae.com/papers/pianovam-2025.md
- PiAnnotate: A Web Annotation Tool for Piano Fingering, with a Diagnostic Probe (2026): https://joonhyungbae.com/papers/piannotate-2026.md

## How to cite

Y. Kim, J. Park, Joonhyung Bae, K. Kim, T. Kwon, A. Lerch, J. Nam (2025). Two Web Toolkits for Multimodal Piano Performance Dataset Acquisition and Fingering Annotation. Proc. 26th Int. Soc. for Music Inf. Retrieval Conf. (ISMIR), Daejeon, Korea, Sep. 21–25, 2025. https://arxiv.org/abs/2509.15222

```bibtex
@inproceedings{Kim2025two,
  title = {Two Web Toolkits for Multimodal Piano Performance Dataset Acquisition and Fingering Annotation},
  author = {Y. Kim and J. Park and Joonhyung Bae and K. Kim and T. Kwon and A. Lerch and J. Nam},
  booktitle = {Proc. 26th Int. Soc. for Music Inf. Retrieval Conf. (ISMIR), Daejeon, Korea, Sep. 21–25, 2025},
  year = {2025},
  eprint = {2509.15222},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2509.15222}
}
```