Skip to main content

Research Repository

Advanced Search

IR-capsule: two-stream network for face forgery detection.

Lin, Kaihan; Han, Weihong; Li, Shudong; Gu, Zhaoquan; Zhao, Huimin; Ren, Jinchang; Zhu, Li; Lv, Jujian

Authors

Kaihan Lin

Weihong Han

Shudong Li

Zhaoquan Gu

Huimin Zhao

Jinchang Ren

Li Zhu

Jujian Lv



Abstract

Background: With the emergence of deep learning, generating forged images or videos has become much easier in recent years. Face forgery detection, as a way to detect forgery, is an important topic in digital media forensics. Despite previous works having made remarkable progress, the spatial relationships of each part of the face that has significant forgery clues are seldom explored. Methods: To overcome this shortcoming, a two-stream face forgery detection network that fuses Inception ResNet stream and capsule network stream (IR-Capsule) is proposed in this paper, which can learn both conventional facial features and hierarchical pose relationships and angle features between different parts of the face. Furthermore, part of the Inception ResNet V1 model pre-trained on the VGGFACE2 dataset is utilized as an initial feature extractor to reduce overfitting and training time, and a modified capsule loss is proposed for the IR-Capsule network. Results: Experimental results on the challenging FaceForensics++ benchmark show that the proposed IR-Capsule improves accuracy by more than 3% compared with several recently published methods. Conclusions: The proposed method provides a new solution for face forgery detection, which has outperformed a few state-of-the-art models.

Citation

LIN, K., HAN, W., LI, S., GU, Z., ZHAO, H., REN, J., ZHU, L. and LV, J. [2022] IR-capsule: two-stream network for face forgery detection. Cognitive computation [online], Latest articles. Available from: https://doi.org/10.1007/s12559-022-10008-4

Journal Article Type Article
Acceptance Date Mar 6, 2022
Online Publication Date Jun 2, 2022
Deposit Date Jun 30, 2022
Publicly Available Date Jun 3, 2023
Journal Cognitive computation
Print ISSN 1866-9956
Electronic ISSN 1866-9964
Publisher Springer
Peer Reviewed Peer Reviewed
DOI https://doi.org/10.1007/s12559-022-10008-4
Keywords Facial recognition; Face forgery detection; Machine learning; Artificial intelligence; Two-stream network; IR-capsule; Capsule network; Inception ResNet
Public URL https://rgu-repository.worktribe.com/output/1688273