4.6 Article

A comprehensive overview of Deepfake: Generation, detection, datasets, and opportunities

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Computer Science, Artificial Intelligence

DeepFake Detection Based on Discrepancies Between Faces and Their Context

Yuval Nirkin et al.

Summary: The proposed method utilizes two networks to detect face swapping and other identity manipulations in single images, achieving state of the art results in detection accuracy.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2022)

Article Computer Science, Theory & Methods

The Creation and Detection of Deepfakes: A Survey

Yisroel Mirsky et al.

Summary: Generative deep learning algorithms have advanced to a stage where distinguishing between real and fake has become increasingly challenging. The unethical and malicious applications of this technology, such as the creation of deepfakes for spreading misinformation and impersonating individuals, have raised concerns. This article delves into the creation, detection, current trends, shortcomings in defense solutions, and areas requiring further research and attention in the realm of deepfakes.

ACM COMPUTING SURVEYS (2021)

Article Computer Science, Artificial Intelligence

Fake face detection via adaptive manipulation traces extraction network

Zhiqing Guo et al.

Summary: The proliferation of FIM techniques poses challenges to public confidence as fake face images spread over the internet. While face image forgery detection has progressed, there is a need for a robust detector. The proposed AMTEN effectively suppresses image content and enhances manipulation traces, achieving desirable pre-processing results and outperforming state-of-the-art works in detecting fake face images.

COMPUTER VISION AND IMAGE UNDERSTANDING (2021)

Article Computer Science, Artificial Intelligence

URCA-GAN: UpSample Residual Channel-wise Attention Generative Adversarial Network for image-to-image translation

Xuan Nie et al.

Summary: This paper introduces a novel deep-learning-based image-to-image translation method called URCA-GAN, which can generate images of higher quality and diversity compared to existing methods. Experimental results show that our model outperforms current state-of-the-art methods in both quality and diversity.

NEUROCOMPUTING (2021)

Proceedings Paper Computer Science, Artificial Intelligence

Deepfake Detection using Capsule Networks and Long Short-Term Memory Networks

Akul Mehra et al.

Summary: This study introduces a hybrid model combining Capsule Networks and LSTM networks for detecting face tampering in videos. It is found that frame selection techniques significantly impact model performance. The combined Capsule and LSTM network shows comparable performance to state-of-the-art models with fewer parameters, leading to reduced computational cost.

VISAPP: PROCEEDINGS OF THE 16TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL. 4: VISAPP (2021)

Article Computer Science, Theory & Methods

High-Fidelity Face Manipulation With Extreme Poses and Expressions

Chaoyou Fu et al.

Summary: The research introduces a novel framework for face manipulation, divided into two stages: boundary prediction and disentangled face synthesis. The method is validated using the new high-quality database MVF-HQ, and experiments demonstrate a significant improvement in synthesis quality.

IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY (2021)

Article Computer Science, Theory & Methods

Detection of Fake and Fraudulent Faces via Neural Memory Networks

Tharindu Fernando et al.

Summary: Advances in computer vision have enabled the synthesis of realistic fake content, leading to concerns about the spread of disinformation and mistrust. While Convolutional Neural Networks show promising results in detecting fake images, there is still a significant gap in defense against unseen types of manipulation. Researchers propose a Hierarchical Attention Memory Network for fake face detection, inspired by social cognition processes in the human brain, which demonstrates superior performance in detecting fake and fraudulent faces.

IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY (2021)

Article Computer Science, Theory & Methods

Preventing DeepFake Attacks on Speaker Authentication by Dynamic Lip Movement Analysis

Chen-Zhao Yang et al.

Summary: This paper proposes a new visual speaker authentication scheme based on deep convolutional neural network to defend against DeepFake attacks. The proposed network utilizes two functional parts for lip feature extraction and authentication, achieving good results against human imposters and demonstrating better robustness compared to other algorithms.

IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY (2021)

Article Computer Science, Artificial Intelligence

Two birds with one stone: Transforming and generating facial images with iterative GAN

Dan Ma et al.

NEUROCOMPUTING (2020)

Article Computer Science, Artificial Intelligence

Attributes guided facial image completion

Jingtao Guo et al.

NEUROCOMPUTING (2020)

Article Engineering, Multidisciplinary

Adversarial Attacks and Defenses in Deep Learning

Kui Ren et al.

ENGINEERING (2020)

Article Chemistry, Multidisciplinary

Deep Fake Image Detection Based on Pairwise Learning

Chih-Chung Hsu et al.

APPLIED SCIENCES-BASEL (2020)

Article Computer Science, Artificial Intelligence

Facial Image Synthesis and Super-Resolution With Stacked Generative Adversarial Network

Jijun He et al.

NEUROCOMPUTING (2020)

Article Computer Science, Hardware & Architecture

Generative Adversarial Networks

Ian Goodfellow et al.

COMMUNICATIONS OF THE ACM (2020)

Article Engineering, Electrical & Electronic

GANprintR: Improved Fakes and Evaluation of the State of the Art in Face Manipulation Detection

Joao C. Neves et al.

IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING (2020)

Article Engineering, Electrical & Electronic

Media Forensics and DeepFakes: An Overview

Luisa Verdoliva

IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING (2020)

Article Computer Science, Artificial Intelligence

Adversarial-learning-based image-to-image transformation: A survey

Yuan Chen et al.

NEUROCOMPUTING (2020)

Article Engineering, Electrical & Electronic

Identification of deep network generated images using disparities in color components

Haodong Li et al.

SIGNAL PROCESSING (2020)

Article Computer Science, Artificial Intelligence

Deepfakes and beyond: A Survey of face manipulation and fake detection

Ruben Tolosana et al.

INFORMATION FUSION (2020)

Article Computer Science, Artificial Intelligence

Person image synthesis through siamese generative adversarial network

Ying Chen et al.

NEUROCOMPUTING (2020)

Proceedings Paper Computer Science, Information Systems

Fighting Against Deepfake: Patch&Pair Convolutional Neural Networks (PPCNN)

Xurong Li et al.

WWW'20: COMPANION PROCEEDINGS OF THE WEB CONFERENCE 2020 (2020)

Article Computer Science, Theory & Methods

Facial Age and Expression Synthesis Using Ordinal Ranking Adversarial Networks

Yunlian Sun et al.

IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY (2020)

Article Computer Science, Artificial Intelligence

Representation Learning by Rotating Your Faces

Luan Tran et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2019)

Article Computer Science, Software Engineering

Deferred Neural Rendering: Image Synthesis using Neural Textures

Justus Thies et al.

ACM TRANSACTIONS ON GRAPHICS (2019)

Article Computer Science, Software Engineering

Text-based Editing of Talking-head Video

Ohad Fried et al.

ACM TRANSACTIONS ON GRAPHICS (2019)

Article Computer Science, Software Engineering

Deep Video-Based Performance Cloning

K. Aberman et al.

COMPUTER GRAPHICS FORUM (2019)

Article Computer Science, Artificial Intelligence

Photo-realistic face age progression/regression using a single generative adversarial network

Jiangfeng Zeng et al.

NEUROCOMPUTING (2019)

Article Computer Science, Software Engineering

Neural Rendering and Reenactment of Human Actor Videos

Lingjie Liu et al.

ACM TRANSACTIONS ON GRAPHICS (2019)

Article Computer Science, Artificial Intelligence

AttGAN: Facial Attribute Editing by Only Changing What You Want

Zhenliang He et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2019)

Article Computer Science, Information Systems

No One Can Escape: A General Approach to Detect Tampered and Generated Image

Kejun Zhang et al.

IEEE ACCESS (2019)

Proceedings Paper Imaging Science & Photographic Technology

DETECTING GENERATED IMAGE BASED ON A COUPLED NETWORK WITH TWO-STEP PAIRWISE LEARNING

Yi-Xiu Zhuang et al.

2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) (2019)

Article Computer Science, Theory & Methods

Distinguishing Between Natural and Computer-Generated Images Using Convolutional Neural Networks

Weize Quan et al.

IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY (2018)

Article Computer Science, Software Engineering

Looking to Listen at the Cocktail Party: A Speaker-Independent Audio-Visual Model for Speech Separation

Ariel Ephrat et al.

ACM TRANSACTIONS ON GRAPHICS (2018)

Article Computer Science, Software Engineering

Deep Video Portraits

Hyeongwoo Kim et al.

ACM TRANSACTIONS ON GRAPHICS (2018)

Proceedings Paper Computer Science, Theory & Methods

Learning to Detect Fake Face Images in the Wild

Chih-Chung Hsu et al.

2018 INTERNATIONAL SYMPOSIUM ON COMPUTER, CONSUMER AND CONTROL (IS3C 2018) (2018)

Article Computer Science, Software Engineering

Synthesizing Obama: Learning Lip Sync from Audio

Supasorn Suwajanakorn et al.

ACM TRANSACTIONS ON GRAPHICS (2017)

Proceedings Paper Computer Science, Artificial Intelligence

Image-to-Image Translation with Conditional Adversarial Networks

Phillip Isola et al.

30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017) (2017)

Proceedings Paper Computer Science, Artificial Intelligence

Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization

Xun Huang et al.

2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV) (2017)

Article Computer Science, Artificial Intelligence

Image Super-Resolution Using Deep Convolutional Networks

Chao Dong et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2016)

Article Computer Science, Software Engineering

Real-time Expression Transfer for Facial Reenactment

Justus Thies et al.

ACM TRANSACTIONS ON GRAPHICS (2015)

Review Multidisciplinary Sciences

Deep learning

Yann LeCun et al.

NATURE (2015)

Article Computer Science, Artificial Intelligence

CREMA-D: Crowd-Sourced Emotional Multimodal Actors Dataset

Houwei Cao et al.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2014)

Article Computer Science, Theory & Methods

Rich Models for Steganalysis of Digital Images

Jessica Fridrich et al.

IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY (2012)

Article Computer Science, Software Engineering

Exchanging faces in images

V Blanz et al.

COMPUTER GRAPHICS FORUM (2004)