Skip to main content
    Publications

    Designing a Multimodal Viewer for Piano Performance Analysis - a Pedagogy-First Approach

    Joonhyung Bae, H. Cho, K. Kim, D. Park, T. Kwon, Y. Choi, H. Hur, S. Kai, Y. Wada, S. Obata, A. Maezawa, J. Park, J. Park, J. Nam

    Proc. 26th Int. Soc. for Music Inf. Retrieval Conf. (ISMIR), Daejeon, Korea, Sep. 21–25, 2025

    2025 · Abstract/Demo · Published

    arXiv:2511.21693Publisher pagePDF

    In one sentence

    Pedagogy-first design of a web dashboard combining video, motion capture and scores, so piano teachers can replace abstract verbal cues ('raise your wrist') with concrete visual feedback.

    Abstract

    Abstract instructions in piano education, such as "raise your wrist" and "relax your tension," lead to varying interpretations among learners, preventing instructors from effectively conveying their intended pedagogical guidance. To address this problem, this study conducted systematic interviews with a piano professor with 18 years teaching experience, and two researchers derived seven core need groups through cross-validation. Based on these findings, we developed a web-based dashboard prototype integrating video, motion capture, and musical scores, enabling instructors to provide concrete, visual feedback instead of relying solely on abstract verbal instructions. Technical feasibility was validated through 109 performance datasets.

    Source: arXiv:2511.21693

    Key facts

    • Interviews with a piano professor (18 years of teaching); 7 core need groups derived
    • Feasibility validated on 109 performance recordings

    When this paper is relevant

    • You use motion capture or video for instrument-teaching feedback
    • You gather requirements for a music-education visualization dashboard
    • You address how abstract verbal instructions are interpreted differently by learners

    Related

    Cite

    Joonhyung Bae, H. Cho, K. Kim, D. Park, T. Kwon, Y. Choi, H. Hur, S. Kai, Y. Wada, S. Obata, A. Maezawa, J. Park, J. Park, J. Nam (2025). Designing a Multimodal Viewer for Piano Performance Analysis - a Pedagogy-First Approach. Proc. 26th Int. Soc. for Music Inf. Retrieval Conf. (ISMIR), Daejeon, Korea, Sep. 21–25, 2025. https://arxiv.org/abs/2511.21693

    @inproceedings{Bae2025multimodal,
  title = {Designing a Multimodal Viewer for Piano Performance Analysis - a Pedagogy-First Approach},
  author = {Joonhyung Bae and H. Cho and K. Kim and D. Park and T. Kwon and Y. Choi and H. Hur and S. Kai and Y. Wada and S. Obata and A. Maezawa and J. Park and J. Park and J. Nam},
  booktitle = {Proc. 26th Int. Soc. for Music Inf. Retrieval Conf. (ISMIR), Daejeon, Korea, Sep. 21–25, 2025},
  year = {2025},
  eprint = {2511.21693},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2511.21693}
}

    Machine-readable copy: /papers/multimodal-viewer-piano-pedagogy-2025.md