Mixed scape: Development of framework and artwork for auditory correspondence in mixed reality

In one sentence

A soundscape-centred framework ('mixed scapes') for auditory correspondence in mixed reality, with four installation works.

Abstract

In this paper, we introduce mixed scapes which builds on mixed reality (MR) concepts through the lens of a soundscape-focused research framework. We summarize (1) research activities that focus on relationships between environmental sound and various forms of realities, (2) a research framework for auditory responses to MR studies, and (3) artwork examples that demonstrate key concepts outlined in this paper. We also discuss integration of research modules where soundscape studies, musique concrète research, sound analysis, and artificial intelligence are combined into a single framework that, we believe, facilitates exploration, study, and expansion of mixed reality systems. The four installation works that are briefly presented here demonstrate potential pathways for a research-led-practice and practice-led-research model that blends technical research and artistic research within the realm of mixed reality domains.

Source: ICMC 2021 paper (author PDF)

When this paper is relevant

• You need a framework for environmental sound / soundscape in mixed reality
• You look for sound installations combining musique concrète, sound analysis and AI
• You need examples of research-led practice and practice-led research

Cite

S. Park, J. Lee, T. Kim, T.Park, Joonhyung Bae, J. Nam (2021). Mixed scape: Development of framework and artwork for auditory correspondence in mixed reality. Proc. 2021 Int. Computer Music Conf. (ICMC), Santiago, Chile, Jul. 25–31, 2021. https://drive.google.com/file/d/1q-WaCKr0pJYPW15_QWT1yDdJuRaTlllp/view?usp=sharing

@inproceedings{Park2021mixed,
  title = {Mixed scape: Development of framework and artwork for auditory correspondence in mixed reality},
  author = {S. Park and J. Lee and T. Kim and T.Park and Joonhyung Bae and J. Nam},
  booktitle = {Proc. 2021 Int. Computer Music Conf. (ICMC), Santiago, Chile, Jul. 25–31, 2021},
  year = {2021},
  url = {https://drive.google.com/file/d/1q-WaCKr0pJYPW15_QWT1yDdJuRaTlllp/view?usp=sharing}
}

Machine-readable copy: /papers/mixed-scape-2021.md