Supporting Dance Motor Skill Training in Multisensory VR Experience

초록

Acquiring motor skills, such as dance, is considered a difficult task, as novice learners frequently encounter challenges in promptly comprehending and adjusting their movements in learning contexts. In this study, we present a virtual environment training system that incorporates haptic feedback and generative AI to support novices’ learning of body movements in dance. The system guides the user through haptic feedback in VR, generated from dance sequence data captured from professional choreographers. User studies with novice participants were conducted to 1) establish effective feedback for guidance and 2) evaluate the user's training experiences using the system. We also conducted comprehensive interviews with participants and experts to confirm the design strategies and seek insights regarding the perception and utilization of virtual environments, along with haptic and visual feedback in dance learning processes. Based on the outcomes, we established the design guidelines for virtual environment training systems that facilitate learning bodily movement regulation, including in dance education.