JoonHyung Bae was born in the Republic of Korea in 1995. He received B.F.A from Korea University as Formative Art major in 2019, and M.S from Korea Advanced Institute of Science and Technology(KAIST) as Culture Technology major in 2021. He has been attending the KAIST's Graduate School of Culture and Technology since 2021 as a Ph.D. program. He is currently researching/working in Seoul and Daejeon. [CV in English]   [CV in Korean]


Education


  • Ph.D. Student in Culture Technology, Graduate School of Culture Technology, KAIST, Daejeon, Korea 
  • M.S. in Culture Technology, Graduate School of Culture Technology, KAIST , Daejeon, Korea
  • B.F.A. in Art & Design , School of Art&Design, Korea University, Seoul, Korea

Research Interests


  • Music to Motion Generation, Multi-modal Visualization, Research-based Art

Publications


  • Joonhyung Bae, "Thief of Truth: VR comics about the relationship between AI and humans", PROCEEDING OF THE 29TH INTERNATIONAL SYMPOSIUM ON ELECTRONIC ART(ISEA), (2023)
  • Taegyun Kwon,Dawon Park,Joonhyung Bae,Jonghwa Park,Jaebum Park,Juhan Nam, "Automated Gap-filling Algorithm for Kinetic Data of Finger Movement: Pianist Hand Motion Cleaning Using Spatio-temporal Imputation", PROCEEDINGS OF THE 29TH CONGRESS OF INTERNATIONAL SOCIETY OF BIOMECHANICS, (2023)
  • Dawon Park,Taegyun Kwon,Joonhyung Bae,Jonghwa Park,Juhan Nam,Jaebum Park, "Multivariate Kinematic Analysis of Piano Performance: a Case Study of a Professional Pianist", PROCEEDINGS OF THE 29TH CONGRESS OF INTERNATIONAL SOCIETY OF BIOMECHANICS, (2023)
  • Joonhyung Bae, Karam Eum,Haram Kwon,Seolhee Lee,Juhan Nam,Young Yim Doh, "Classy Trash Monster: An Educational Game for Teaching Machine Learning to Non-major Students", CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS EXTENDED ABSTRACTS, (2022)   [Paper]  [Project Page]  [Presentation]  [Video List]  [Text]  [Phone Wallpaper]  [News1]  [News2]  [News3]  [News4] 
  • Seungsoon Park,Jongpil Lee,Taewan Kim,Tae Hong Park,Joonhyung Bae,Juhan Nam, "Mixed Scape: Development of Framework and Artwork for Auditory Correspondence in Mixed Reality", PROCEEDINGS OF INTERNATIONAL COMPUTER MUSIC CONFERENCE (ICMC), 2021, (2021)   [Paper]  [Project Page]  [Text]

Publications(Domestic)



Solo Exhibitions


  • 2022 Thief of Truth, Move.Mov, Seoul, Korea

Team Exhibitions 


  • 2022 Showcase: Sense of Convergence, KAIST GSCT XR Studio, Daejeon, Korea

Group Exhibitions 


  • 2022 Unfold X, SFactory, Seoul, Korea
  • 2022 Daejeon Art and Science Biennale : The Future City Associated Program - Game and Art: Future City of Fantasy, Daejeon Museum of Art, Daejeon, Korea
  • 2020 Mixed Scape, Yeonnamjang, Seoul, Korea

Projects


  • Real-Time Audio-Visual Music Information Processing for Interactive AI Performance System, Korea Advanced Institute of Science and Technology, Korea / Research Assistant (Mar. 2023 ~ Present)
  • Virtual Space Environmental Sound Matching Data, Korea Advanced Institute of Science and Technology, Korea Advanced Institute of Science and Technology, Korea (Aug. 2021 ~ Oct. 2022 )
  • Multimodal Approach on AI-Based Piano Performance Visualization and Generation, Seoul University, Korea (Aug. 2021 ~ Oct. 2022 )
  • Post-AI culture technology imagination study, Korea Advanced Institute of Science and Technology, Korea (Aug. 2021 ~ Dec. 2021)
  • Musicking in the age of post-AI, Korea Advanced Institute of Science and Technology, Korea (May. 2021 ~ Dec. 2021)   [Text]
  • Auto triggering sound for animation sequences in the game, Korea Advanced Institute of Science and Technology, Korea (Jul. 2020 ~ Dec. 2020)
  • Implementing New media art based on AI soundscapes from Inter-Reality perspective, Korea Institute For Advanced Study, Korea (Jul. 2020 ~ Dec. 2020)   [Paper]  [Project Page]  [Text]
  • Alternative Pigments·Medium·Painting Techniques of Traditional Color materials R&D, Korea University, Korea (Apr. 2016 ~ Mar. 2017)

Awards and Honors


  • 2022 'Art Change-up', an online media art activity support project, Arts Council Korea, Korea (May. 2022)
  • 2022 Arts and Technology Convergence Support Project, Arts Council Korea, Korea (May. 2022)

  • Winner of CHI2022 Student Game Competition in the Category of Transformative and Transgressive Play, 2022 Conference on Human Factors in Computing Systems, Korea (May. 2022) [Certificate]
  • Top prize in Game Design Project, Korea Advanced Institute of Science and Technology & NCSOFT, Korea (Jan. 2022)
  • 2nd prize in the LG Sciencepark Goods Contest, LG Sciencepark, Korea (Dec. 2020)
  • Small Research Good Seoul Research Grants, The Seoul Institute, Korea (Nov. 2020)
  • Venture Research Program for Graduate and PhD Students Research Grants, Korea Advanced Institute of Science and Technology, Korea (Apr. 2020)
  • CPR Contest(2019 Piction Creation Grants), Piction Network, Korea (Dec. 2019)
  • Korea University Presidential Award(9th Creative Challenger Program), Korea University, Korea (Feb. 2018)   [Video]
  • Award of Excellence(Korea University Peer Tutoring Program), Korea University, Korea (Jun. 2017)
  • 9th Creative Challenger Program, Korea University, Korea (Jun. 2017)
  • CheongNyeonHwal Research Grants, Seoul Youth Hub(Seoul Metropolitan Government), Korea (Apr. 2017)
  • Korea University Presidential Award(8th Creative Challenger Program), Korea University, Korea (Mar. 2017)
  • Social Innovator Lookie Research Grants, SK, Korea (May. 2017)
  • Korea University Presidential Award(7th Creative Challenger Program), Korea University, Korea (Mar. 2016)
  • Semester High Honors, Korea University, Korea (Jul. 2016)
  • 8th Creative Challenger Program, Korea University, Korea (Jun. 2016)
  • Semester High Honors, Korea University, Korea (Jan. 2016)
  • Semester High Honors, Korea University, Korea (Jul. 2015)
  • 7th Creative Challenger Program Research Grants, Korea University, Korea (Jun. 2015)

Invited Talks


  • “The Making Process of The Classy Trash Monster”, Korea Advanced Institute of Science and Technology (Sep. 2022)

Design


  • 2023 Sumi Jo Performing Arts Research Center Talk Series - Prof.Dasaem Jung Seminar Poster, Sumi Jo Performing Arts Research Center Talk Series, Daejeon, Korea
  • 2022 Daejeon Art and Science Biennale: The Future City Associated Program - Game and Art: Future City of Fantasy <Cutting Kim> Poster, Daejeon Museum of Art, Daejeon, Korea

Teaching Experiences


  • TA, KAIST Graduate School of Culture Technology CTPRESS Editor(Spring, 2020, Fall, 2020)

Skills and Techniques


  • Machine Learning
    • Tensorflow, Pytorch, Scikit-learn, Weights&Biases
  •  Data Analysis
    • Pandas, Numpy, Matplotlib
  • Signal Processing
    • Librosa, Scipy
  • Front-End
    • Vue, Vuetify
  • Game Engine
    • Unity
  • Digital Visualization
    • Clip Studio, Photoshop, Illustrator, Premiere, Blender, Touch Designer
  • Analog Visualization
    • Traditional Asian Painting