Image Feature Selection based on Attention Mechanism

Authors

  • Zuyong Lu

DOI:

https://doi.org/10.54097/9mz68c78

Keywords:

Attention; Neural Network; Feature Extraction.

Abstract

In the field of deep learning, the selection and extraction of image features are the key factors affecting model performance. Traditional image feature selection methods often rely on artificially designed features, which is not only time-consuming but also difficult to capture complex patterns in the image. In recent years, attention mechanism, as a technique that enables models to automatically focus on key parts of input data, has shown significant advantages in many fields such as natural language processing and image recognition. In this paper, an attention-mechanism-based image feature selection method is proposed to improve the accuracy and efficiency of image classification and object detection tasks. First, we introduce the basic principles of the attention mechanism, and then we design a convolutional neural network (CNN) framework with integrated attention modules that can adaptively adjust the weights during training to highlight important areas in the image and ignore irrelevant backgrounds. By introducing the attention mechanism, our model can learn the key features in the image more effectively, reduce the waste of computing resources, and improve the generalization ability of the model. Finally, we verify the reliability of the model on several data sets.

Downloads

Download data is not yet available.

References

Muruganantham, Priyanga, et al. "A systematic literature review on crop yield prediction with deep learning and remote sensing." Remote Sensing 14.9 (2022): 1990.

Xu, Yonghao, and Pedram Ghamisi. "Universal adversarial examples in remote sensing: Methodology and benchmark." IEEE Transactions on Geoscience and Remote Sensing 60 (2022): 1-15.

KATTENBORN, Teja, et al. Spatially autocorrelated training and validation samples inflate performance assessment of convolutional neural networks. ISPRS Open Journal of Photogrammetry and Remote Sensing, 2022, 5: 100018.

Graves, Alex, and Jürgen Schmidhuber. "Framewise phoneme classification with bidirectional LSTM and other neural network architectures." Neural networks 18.5-6 (2005): 602-610.

Zhu, Jiawei, et al. "AST-GCN: Attribute-augmented spatiotemporal graph convolutional network for traffic forecasting." IEEE Access 9 (2021): 35973-35983.

Wen, Guangqi, et al. "MVS-GCN: A prior brain structure learning-guided multi-view graph convolution network for autism spectrum disorder diagnosis." Computers in Biology and Medicine 142 (2022): 105239.

Hou, Jialu, Hang Wei, and Bin Liu. "iPiDA-GCN: Identification of piRNA-disease associations based on Graph Convolutional Network." PLOS Computational Biology 18.10 (2022): e1010671.

Eliasof, Moshe, Eldad Haber, and Eran Treister. "Pde-gcn: Novel architectures for graph neural networks motivated by partial differential equations." Advances in neural information processing systems 34 (2021): 3836-3849.

Peng, Shaowen, Kazunari Sugiyama, and Tsunenori Mine. "SVD-GCN: A simplified graph convolution paradigm for recommendation." Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 2022.

Downloads

Published

12-07-2024

Issue

Section

Articles

How to Cite

Lu, Z. (2024). Image Feature Selection based on Attention Mechanism. Academic Journal of Science and Technology, 11(3), 85-88. https://doi.org/10.54097/9mz68c78