21 December 2022 Three-stage image forgery localization with shallow feature enhancement and attention
Xiuli Chai, Shiping Song, Yong Tan, Yan Lei, Ziqing Huang, Yang Lu, Tongtong Wei
Author Affiliations +
Abstract

With the development of technology, it is becoming easier and easier for people to generate tampered images that are indistinguishable from the human eye, and the malicious use of these photos in news, academic papers, and criminal crimes has brought great harm to society. This paper proposes a deep convolutional neural network-based image forgery localization method to uncover the subtle differences between doctored images and real images. Specifically, the network achieves tampering localization through a three-stage enhancement scheme. First, the dilated convolution in the deep layer of the network is used to keep the feature map resolution constant, and the number of shallow convolutions is decreased to reduce the perceptual field, so the network focuses on local regions. Second, the feature enhancement module is used to fuse shallow features with deep features to effectively filter content information and highlight tampering features, making full use of local and global information to improve the generalization ability. Finally, the attention enhancement module reweights the convolutional feature maps in terms of channels and locations, respectively, to highlight the information regions around the forgery boundaries, thus guiding the network to capture more intrinsic features for image forgery. Extensive experimental results on several public datasets show that this method outperforms other state-of-the-art methods in image forgery localization.

© 2022 SPIE and IS&T
Xiuli Chai, Shiping Song, Yong Tan, Yan Lei, Ziqing Huang, Yang Lu, and Tongtong Wei "Three-stage image forgery localization with shallow feature enhancement and attention," Journal of Electronic Imaging 31(6), 063051 (21 December 2022). https://doi.org/10.1117/1.JEI.31.6.063051
Received: 14 July 2022; Accepted: 2 November 2022; Published: 21 December 2022
Lens.org Logo
CITATIONS
Cited by 2 scholarly publications.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Image enhancement

Convolution

Feature extraction

Education and training

Image forensics

Quantization

Semantics

Back to Top