Interaction Methods and Modalities of Wearable Robots Based on VR Technology
DOI:
https://doi.org/10.54097/qjf0w362Keywords:
VR, wearable robots, human-computer interaction.Abstract
With the rapid development of wearable robots, their interaction with humans is being applied in various fields, such as medical rehabilitation training, daily life assistance, or as a haptic enhancement device. Simultaneous wearable robotic rehabilitation training can effectively maintain patients' motivation and interest in treating upper or lower limb injuries. As VR technology advances, customizable games or their combinations have been introduced, helping robotic therapy retain or increase patient interest so they continue exercising. This review focuses on the interaction of wearable robots based on VR technology in a VR environment, summarizing their interaction methods and modalities. These interaction methods include visual interaction, haptic feedback, and auditory interaction. The review covers both wearable robots and multimodal interactions involving wearable robots based on VR technology. Furthermore, the literature related to interaction methods and modalities is analyzed in detail. By integrating multiple sensory channels, this interaction method can provide a more immersive experience, helping users to perform complex tasks more accurately, while also stimulating neural responses and promoting functional recovery. In addition, multimodal interaction methods can compensate for the shortcomings of single interaction modes, improving the accuracy and safety of operations. Future research could explore further integration applications of these interaction methods with VR.
Downloads
References
[1] Schultheis, M., & Rizzo, A. The application of virtual reality technology in rehabilitation. Rehabilitation Psychology, 2001, 46(3): 296-311.
[2] Katz, N., Ring, H., Naveh, Y., Kizony, R., Feintuch, U., & Weiss, P. L. Interactive virtual environment training for safe street crossing of right hemisphere stroke patients with unilateral spatial neglect. Disability and Rehabilitation, 2005, 27(20-21): 1235-1244.
[3] Sveistrup, H. Motor rehabilitation using virtual reality. Journal of NeuroEngineering and Rehabilitation, 2004.
[4] Xie, P. Research on rehabilitation training strategies using multimodal virtual scene stimulation. Frontiers in Aging Neuroscience, 2022, 14.
[5] Tang, Z. C. An upper-limb rehabilitation exoskeleton system controlled by MI recognition model with deep stressed informative features in a VR scene. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2023, 31: 4390-4401.
[6] Tiboni, M., Borboni, A., Vérité, F., Bregoli, C., & Amici, C. Sensors and actuation technologies in exoskeletons: A review. Sensors, 2022.
[7] Shneiderman, B. Direct manipulation: A step beyond programming languages. IEEE Computer, 1983, 16(8): 57-69.
[8] Lv, Z., Poiesi, F., Dong, Q., Lloret, J., & Song, H. Deep learning for intelligent human–computer interaction. Applied Sciences, 2022.
[9] Baltrusaitis, T., Ahuja, C., & Morency, L. P. Multimodal machine learning: A survey and taxonomy. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2019, 41(2): 423-443.
[10] D'Mello, S., & Kory, J. A review and meta-analysis of multimodal affect detection systems. ACM Computing Surveys (CSUR), 2015, 47(3): 1-36.
[11] Lin, C.-J., & Sie, T.-Y. Integration of virtual reality-enhanced motor imagery and brain-computer interface for a lower-limb rehabilitation exoskeleton robot. Actuators, 2024.
[12] Delisa, J. A., & Gans, B. M. Rehabilitation of individuals with spinal cord injuries. Archives of Physical Medicine and Rehabilitation, 2009, 90(10): 1604-1609.
[13] Hoffman, L., Mathews, H., Murray, S., Perez, J., & Schmidt, S. A review of remote cognitive assessment using the telephone or internet. Journal of Medical Internet Research, 2020, 22(8): e17216.
[14] Li, Y., Wang, X., Zhang, Z., Chen, H., & Wu, J. Enhanced virtual reality systems with haptic feedback for improved hazard perception and safety. Research, 2023.
[15] Liu, Y., et al. Multisensory integration in VR environments for enhanced interaction. Frontiers in Robotics and AI, 2022.
[16] Kim, S. W., Kim, S. H., Kim, C. S., Yi, K., Kim, J. S., Cho, B. J., & Cha, Y. Thermal display glove for interacting with virtual reality. Scientific Reports, 2020.
[17] Kaczmarek, W., Panasiuk, J., Borys, S., & Banach, P. Industrial robot control by means of gestures and voice commands in off-line and on-line mode. Sensors, 2020.
[18] Smith, J., Liu, M., & García, R. Voice-controlled wearable robotics for enhanced interaction in virtual environments. Mechatronics, 2022.
[19] Park, S., Meeker, C., Weber, L. M., Bishop, L., Stein, J., & Ciocarlie, M. Multimodal sensing and interaction for a robotic hand orthosis. IEEE Robotics and Automation Letters, 2019.
[20] Gao, X., Zhang, P., Peng, X., Zhao, J., Liu, K., Miao, M., Zhao, P., Luo, D., & Li, Y. Autonomous motion and control of lower limb exoskeleton rehabilitation robot. Frontiers in Bioengineering and Biotechnology, 2023, 11: 1223831.
[21] Kohli, V., Tripathi, U., Chamola, V., Rout, B. K., & Kanhere, S. A review on virtual reality and augmented reality use-cases of brain-computer interface-based applications for smart cities. Microprocessors and Microsystems, 2022, 88: 104392.
[22] Mirelman, A., Maidan, I., & Deutsch, J. E. Virtual reality and motor imagery: Promising tools for assessment and therapy in Parkinson’s disease. Movement Disorders, 2013, 28: 1597-1608.
[23] Lin, C.-J., & Sie, T.-Y. Integration of virtual reality-enhanced motor imagery and brain-computer interface for a lower-limb rehabilitation exoskeleton robot. Actuators, 2024.
[24] Khan, M. M. R., et al. Development of a robot-assisted telerehabilitation system with integrated IIoT and digital twin. IEEE Access, 2023, 11: 70174-70189.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Highlights in Science, Engineering and Technology
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
