Enhancing Gesture-Based Interactions for Individuals with Disabilities through Dual-Attention Wireless Sensing Networks

Jingzhi Pan

doi:10.54097/vsjbt578

Authors

Jingzhi Pan

DOI:

https://doi.org/10.54097/vsjbt578

Keywords:

Wireless Sensing; Gesture Interaction; Dual-attention CSI networks; ResNet.

Abstract

This paper investigates the application of wireless sensing technology to develop a more natural and intuitive gesture-based interaction framework for individuals with disabilities. The study begins by identifying the primary challenges faced by this demographic when interacting with conventional devices. It then introduces a novel approach for WiFi-enabled gesture recognition and interpretation using dual attention networks. This methodology comprises two essential components: Channel State Information (CSI) preprocessing and a gesture recognition module. The paper details the implementation of these modules and elucidates their roles in enhancing gesture detection accuracy. Furthermore, the discussion extends to the future prospects of wireless sensing technologies, envisioning their integration into smart home systems, public services, and enhanced social interactions. The research underscores the transformative potential of integrating gesture-based interactions with wireless sensing to significantly elevate the quality of life for people with disabilities, suggesting a paradigm shift in how assistive technologies are developed and utilized.

Downloads

Download data is not yet available.

References

[1] Y. Gu, X. Zhang, Y. Wang, M. Wang, H. Yan, Y. Ji, M. Dong, WiGRUNT: WiFi-enabled gesture recognition using dual-attention network, IEEE Trans. Hum. -Mach. Syst. 52 (2022) 736-746.

[2] Y. Gu, H. Yan, X. Zhang, Attention-based gesture recognition using commodity WiFi devices, IEEE Sens. J. 23 (2023) 9685-9696.

[3] X. Zhu, Y. Zhang, Z. Zhao, et al., Radio frequency sensing based environmental monitoring technology, in: Fourth International Workshop on Pattern Recognition, Vol. 11198, SPIE, 2019, pp. 187-191.

[4] C. Li, M. Liu, Z. Cao, WiHF: Gesture and user recognition with WiFi, IEEE Trans. Mobile Comput. 21 (2020) 757-768.

[5] R. Gao, M. Zhang, J. Zhang, Y. Li, E. Yi, D. Wu, D. Zhang, Towards position-independent sensing for gesture recognition with Wi-Fi, Proc. ACM Interact. Mobile Wearable Ubiquitous Technol. 5 (2021) 1-28.

[6] X. Zhu, H. Xu, Z. Zhao, X. Wang, X. Wei, Y. Zhang, J. Zuo, An environmental intrusion detection technology based on WiFi, Wireless Personal Communications, 119 (2) (2021) 1425-1436.

[7] R. Zhang, C. Jiang, S. Wu, Q. Zhou, X. Jing, J. Mu, Wi-Fi sensing for joint gesture recognition and human identification from few samples in human-computer interaction, IEEE J. Sel. Areas Commun. 40 (2022) 2193-2205.

[8] M. Yang, H. Zhu, R. Zhu, F. Wu, L. Yin, Y. Yang, Witransformer: A novel robust gesture recognition sensing model with WiFi, Sensors 23 (2023) 2612.

[9] R. Xiao, J. Liu, J. Han, K. Ren, Onefi: One-shot recognition for unseen gesture via cots wifi, in: Proc. 19th ACM Conf. Embedded Networked Sens. Syst., ACM, New York, 2021, pp. 206-219.

[10] X. Zhu, Z. Zhao, X. Wei, et al., Action recognition method based on wavelet transform and neural network in wireless network, in: 2021 5th International Conference on Digital Signal Processing, 2021, pp. 60-65..

[11] S. Tan, J. Yang, Y. Chen, Enabling fine-grained finger gesture recognition on commodity WiFi devices, IEEE Trans. Mobile Comput. 21 (2020) 2789-2802.