Object Removing via Multi-Column Gate Convolutional Neutral Network
DOI:
https://doi.org/10.54097/hset.v41i.6748Keywords:
Gate convolution, Multi-convolution network, Implicit diversified MRF loss.Abstract
Object removal is to remove unwanted objects in a photograph. It can be realized by the inpainting technique with irregular mask. Generative Image Inpainting with Contextual Attention [n] and Partial convolution cannot work well with irregular mask,so we present a Multi-column Gate Convolutional Neutral Network. It can work well with both regular and irregular mask. Our model adopts gate convolution which is more suitable in inpainting task than traditional convolution. Special context loss, semantics loss and spatial reconstruction loss are used for better performance. We train the model with CelebA and Landscape. A comparison is made between our model and some models published on CVPR etc, our model’s results can generate more realistic images than existing ones for object removal.
Downloads
References
Yi Wang Xin Tao Xiaojuan Qi Xiaoyong Shen Jiaya Jia: Image Inpainting via Generative Multi-column Convolutional Neural Networks In: arXiv:1810.08771v1 [cs.CV] 20 Oct 2018
K. He and J. Sun. Image completion approaches using the statistics of similar patches. TPAMI, 36(12): 2423–2435, 2014.
Jiahui Yu, Zhe Lin, Jimei Yang, Xiaohui Shen, Xin Lu, Thomas S. Huang: Generative Image Inpainting with Contextual Attention In: arXiv:1801.07892v2 [cs.CV] 21 Mar 2018
Guilin Liu Fitsum A. Reda Kevin J. Shih Ting-Chun Wang Andrew Tao Bryan Catanzaro: Image Inpainting for Irregular Holes Using Partial Convolutions In: arXiv:1804.07723v2 [cs.CV] 15 Dec 2018
SATOSHI IIZUKA, EDGAR SIMO-SERRA, HIROSHI ISHIKAWA: Globally and Locally Consistent Image Completion in ACM Transactions on Graphics, Vol. 36, No. 4, Article 107. Publication date: July 2017
Jiahui Yu Zhe Lin Jimei Yang Xiaohui Shen Xin Lu Thomas Huang: Free-Form Image Inpainting with Gated Convolution In: arXiv:1806.03589v2 [cs.CV] 22 Oct 2019
K. He and J. Sun. Statistics of patch offsets for image completion. In ECCV, pages 16–29. Springer, 2012
J. Jia and C.-K. Tang. Inference of segmented color and texture description by tensor voting. TPAMI, 26(6): 771–786, 2004.
J. Sun, L. Yuan, J. Jia, and H.-Y. Shum. Image completion with structure propagation. In TOG, volume 24, pages 861–868. ACM, 2005.
K. He and J. Sun. Image completion approaches using the statistics of similar patches. TPAMI, 36(12): 2423–2435, 2014.
Downloads
Published
Issue
Section
License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.







