Exploiting Training Stage Reconstruction Instability for Image Anomaly Detection
DOI:
https://doi.org/10.54097/ffx4t765Keywords:
Anomaly detection, generative adversarial network, image reconstruction.Abstract
Image anomaly detection is an important and practically significant research area. Methods such as reconstruction and feature extraction are mainly utilized. For reconstruction methods, purely normal input images should be provided, which is close to supervised learning. For feature extraction methods, unsupervised learning ones without a designated feature learning orientation perform much worse than supervised learning ones. In this paper, the goal is to achieve anomaly detection based on unsupervised learning. Generative Adversarial Network (GAN) is used as the approach, similar to unsupervised learning feature extraction methods, but it focuses more on the feature variation rate rather than using the feature outputs for further classification. The results show an innovative phenomenon in the GAN training process and achieve clear anomaly detection in unsupervised learning. The feature variations reflect the learning state of the model. The feature variations of similar images will converge in the certain learning state, while anomalies will appear as outliers. This phenomenon reveals how the model is learning, particularly about the details. The learning process of the model is intermittent and tries to learn the main features before the details. A more difficult task makes the fluctuations more significant.
Downloads
References
[1] Schlegl, Thomas, et al. Unsupervised anomaly detection with generative adversarial networks to guide marker discovery. International conference on information processing in medical imaging, 2017: 146-157.
[2] Ho Jonathan, Ajay Jain, Pieter Abbeel. Denoising diffusion probabilistic models. Advances in neural information processing systems, 2020, 33: 6840-6851.
[3] Wyatt Julian, Leach Adam, Schmon Sebastian M, et al. Anoddpm: Anomaly detection with denoising diffusion probabilistic models using simplex noise. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022: 650-656.
[4] Kingma Diederik P., Max Welling. Auto-encoding variational bayes. arXiv preprint, 2013: 1312.6114.
[5] Mukherjee Sudipto, Asnani Himanshu, Lin Eugene, Kannan, Sreeram Clustergan: Latent space clustering in generative adversarial networks. Proceedings of the AAAI conference on artificial intelligence. 2019, 33 (1): 4610-4617.
[6] Yang Bo, Fu Xiao, Sidiropoulos Nicholas D, et al. Towards k-means-friendly spaces: Simultaneous deep learning and clustering. international conference on machine learning, 2017: 3861-3870.
[7] Szandała Tomasz. Review and comparison of commonly used activation functions for deep neural networks. Bio-inspired neurocomputing, 2021: 203-224.
[8] Radford Alec, Luke Metz, Soumith Chintala. Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint, 2015: 1511.06434.
[9] Salimans Tim, Goodfellow Ian, Zaremba Wojciech, et al. Improved techniques for training gans. Advances in neural information processing systems, 2016, (29):1-8.
[10] Huang Xun, Serge Belongie. Theoretical Analysis of Feature Matching in GANs. arXiv preprint, 2017: 1705.04740.
[11] Liu Shaohui, Wei Yi, Lu Jiwen, et al. An improved evaluation framework for generative adversarial networks. arXiv preprint, 2018: 1803.07474.
[12] Martin Arjovsky, Soumith Chintala, Léon Bottou, Wasserstein GAN. arXiv preprint, 2017: 1701.07875.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Highlights in Science, Engineering and Technology

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.







