The most powerful deepfake detection methods developed so far are based on deep learning, requiring that large amounts of training data representative of the specific task are available to the trainer. In this paper, we propose a feature-based method for video deepfake detection that can work in data scarcity conditions, that is, when only very few examples are available to the forensic analyst. The proposed method is based on video coding analysis and relies on a simple footprint obtained from the motion prediction modes in the video sequence. The footprint is extracted from video sequences and used to train a simple linear Support Vector Machine classifier. The effectiveness of the proposed method is validated experimentally on three different datasets, namely, a synthetic street video dataset and two datasets of Deepfake face videos.

Wang, J., Alamayreh, O., Tondi, B., Costanzo, A., Barni, M. (2022). Detecting Deepfake Videos in Data Scarcity Conditions by Means of Video Coding Features. APSIPA TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING, 11(2) [10.1561/116.00000032].

Detecting Deepfake Videos in Data Scarcity Conditions by Means of Video Coding Features

Wang, J
;
Alamayreh, O;Tondi, B;Barni, M
2022-01-01

Abstract

The most powerful deepfake detection methods developed so far are based on deep learning, requiring that large amounts of training data representative of the specific task are available to the trainer. In this paper, we propose a feature-based method for video deepfake detection that can work in data scarcity conditions, that is, when only very few examples are available to the forensic analyst. The proposed method is based on video coding analysis and relies on a simple footprint obtained from the motion prediction modes in the video sequence. The footprint is extracted from video sequences and used to train a simple linear Support Vector Machine classifier. The effectiveness of the proposed method is validated experimentally on three different datasets, namely, a synthetic street video dataset and two datasets of Deepfake face videos.
2022
Wang, J., Alamayreh, O., Tondi, B., Costanzo, A., Barni, M. (2022). Detecting Deepfake Videos in Data Scarcity Conditions by Means of Video Coding Features. APSIPA TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING, 11(2) [10.1561/116.00000032].
File in questo prodotto:
File Dimensione Formato  
116.00000032.pdf

accesso aperto

Tipologia: PDF editoriale
Licenza: Creative commons
Dimensione 2.05 MB
Formato Adobe PDF
2.05 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11365/1229937