Research on the Application of Sound in Virtual Reality

Authors

  • Jiwen Tang

DOI:

https://doi.org/10.54097/hset.v44i.7323

Keywords:

Virtual reality, Sound, Music, Spatial sound.

Abstract

Immersive sound is an essential element of any Virtual Reality (VR) experience. In recent years, increasing popularity of VR devices and numerous advancements in hardware and software technologies, the development of immersive interactive sound has become more potent. This article explores VR through the sonic perception, presents a review of the Method of combining and applying sound and VR, with the goal of providing more references and suggestions for the sound of VR. This includes the creative and technical work of music and spatial sound in practical projects in recent years. Some examples of musical VR are provided in this article to compare their characteristics. A review of the state of the art of sound simulations, focusing on the various factors that ensure a complete and immersive audio experience, while trying to strike an appropriate balance between realism and accuracy. This article finally discusses the future and challenges of sound in VR.

Downloads

Download data is not yet available.

References

B. Kenwright, There's More to Sound Than Meets the Ear: Sound in Interactive Environments, in IEEE Computer Graphics and Applications, vol. 40, no. 4, 2020, pp. 62-70, 1. doi: 10.1109/ MCG. 2020.2996371.

W Brinkman, A.R. Hoekstra, The Effect Of 3D Audio and Other Audio Techniques on Virtual Reality Experience. Studies in health technology and informatics, 2019, pp.44-48. https:// doi.org/10.1016/j.jbtep.2016.03.004

V Best, R Baumgartner, M Lavandier. Sound Externalization: A Review of Recent Research. Trends in Hearing. January 2020. doi:10.1177/ 2331216520948390.

L. Turchet, R. Hamilton and A. Çamci, Music in Extended Realities, in IEEE Access, vol. 9, 2021, pp. 15810-15832, doi: 10.1109/ACCESS.2021 1.3052 931.

D. Mills, F. Schroeder, J. D’Arcy, GIVME: Guided Interactions in Virtual Musical Environments: In NIME 2021. https://doi.org/10.21428/92fbeb44. 5443652c

A. Hofmann, Study for virtual keyboard instrument and hand tracking in a VR environment. In NIME 2021. pp. 261-267. https://doi.org/10.21428 /92fbeb44.2e31abfe.

W. Costa et al., Songverse: A Music-Loop Authoring Tool Based on Virtual Reality, 2019 21st Symposium on Virtual and Augmented Reality, 2019, pp. 216-222, doi: 10.1109/SVR.2019.00046.

I. Findlay-Walsh, Virtual auditory reality: Inhabiting digital pop music as simulated space. Sound Effects - An Interdisciplinary Journal of Sound and Sound Experience, 10(1), 2020, pp.71–90. https://doi.org/10.7146/se.v10i1.124199

A. Çam, R. Hamilton, Audio-first VR: New perspectives on musical experiences in virtual environments, Journal of New Music Research, 2019 49, 1, pp.1-7, DOI: 10.1080/0929821 5.2019.1707234

A. Miskinis, Virtual Harmony: Music Interaction with Virtual Reality to Reduce Stress. https://oaks.kent.edu/node/10374

H Luo, G Li, Q Feng. Virtual reality in K-12 and higher education: A systematic review of the literature from 2000 to 2019. Computer Assist Learn. 2021, 37 pp.887–901. https: //doi.org/ 10.1111/jcal.12538

W. Chen Research on the Design of Intelligent Music Teaching System Based on Virtual Reality Technology. Comput Intell Neurosci. 2022 Apr 7; 2022:7832306. doi: 10.1155/2022/7832306.

S. Doganyigit, Islim O. F., Virtual reality in vocal training: a case study, Music Education Research, 2021, pp. 465-471. DOI: 10.1080/146138 08.2021.1879035

Downloads

Published

13-04-2023