Lie Detection Technology of Bimodal Feature Fusion Based on Domain Adversarial Neural Networks
In the domain of lie detection, a common challenge arises from the dissimilar distributions of training and testing datasets. This causes a model mismatch, leading to a performance decline of the pretrained deep learning model. To solve this problem, we propose a lie detection technique based on a d...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2024-01-01
|
| Series: | IET Signal Processing |
| Online Access: | http://dx.doi.org/10.1049/2024/7914185 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832558647503224832 |
|---|---|
| author | Yan Zhou Feng Bu |
| author_facet | Yan Zhou Feng Bu |
| author_sort | Yan Zhou |
| collection | DOAJ |
| description | In the domain of lie detection, a common challenge arises from the dissimilar distributions of training and testing datasets. This causes a model mismatch, leading to a performance decline of the pretrained deep learning model. To solve this problem, we propose a lie detection technique based on a domain adversarial neural network employing a dual-mode state feature. First, a deep learning neural network was used as a feature extractor to isolate speech and facial expression features exhibited by the liars. The data distributions of the source and target domain signals must be aligned. Second, a domain-antagonistic transfer-learning mechanism is introduced to build a neural network. The objective is to facilitate feature migration from the training to the testing domain, that is, the migration of lie-related features from the source to the target domain. This method results in improved lie detection accuracy. Simulations conducted on two professional lying databases with different distributions show the superiority of the detection rate of the proposed method compared to an unimodal feature detection algorithm. The maximum improvement in detection rate was 23.3% compared to the traditional neural network-based detection method. Therefore, the proposed method can learn features unrelated to domain categories, effectively mitigating the problem posed by different distributions in the training and testing of lying data. |
| format | Article |
| id | doaj-art-4208f1115dbb42d09cdd5212aeb6b799 |
| institution | Kabale University |
| issn | 1751-9683 |
| language | English |
| publishDate | 2024-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | IET Signal Processing |
| spelling | doaj-art-4208f1115dbb42d09cdd5212aeb6b7992025-02-03T01:31:53ZengWileyIET Signal Processing1751-96832024-01-01202410.1049/2024/7914185Lie Detection Technology of Bimodal Feature Fusion Based on Domain Adversarial Neural NetworksYan Zhou0Feng Bu1Suzhou Vocational UniversitySuzhou Vocational UniversityIn the domain of lie detection, a common challenge arises from the dissimilar distributions of training and testing datasets. This causes a model mismatch, leading to a performance decline of the pretrained deep learning model. To solve this problem, we propose a lie detection technique based on a domain adversarial neural network employing a dual-mode state feature. First, a deep learning neural network was used as a feature extractor to isolate speech and facial expression features exhibited by the liars. The data distributions of the source and target domain signals must be aligned. Second, a domain-antagonistic transfer-learning mechanism is introduced to build a neural network. The objective is to facilitate feature migration from the training to the testing domain, that is, the migration of lie-related features from the source to the target domain. This method results in improved lie detection accuracy. Simulations conducted on two professional lying databases with different distributions show the superiority of the detection rate of the proposed method compared to an unimodal feature detection algorithm. The maximum improvement in detection rate was 23.3% compared to the traditional neural network-based detection method. Therefore, the proposed method can learn features unrelated to domain categories, effectively mitigating the problem posed by different distributions in the training and testing of lying data.http://dx.doi.org/10.1049/2024/7914185 |
| spellingShingle | Yan Zhou Feng Bu Lie Detection Technology of Bimodal Feature Fusion Based on Domain Adversarial Neural Networks IET Signal Processing |
| title | Lie Detection Technology of Bimodal Feature Fusion Based on Domain Adversarial Neural Networks |
| title_full | Lie Detection Technology of Bimodal Feature Fusion Based on Domain Adversarial Neural Networks |
| title_fullStr | Lie Detection Technology of Bimodal Feature Fusion Based on Domain Adversarial Neural Networks |
| title_full_unstemmed | Lie Detection Technology of Bimodal Feature Fusion Based on Domain Adversarial Neural Networks |
| title_short | Lie Detection Technology of Bimodal Feature Fusion Based on Domain Adversarial Neural Networks |
| title_sort | lie detection technology of bimodal feature fusion based on domain adversarial neural networks |
| url | http://dx.doi.org/10.1049/2024/7914185 |
| work_keys_str_mv | AT yanzhou liedetectiontechnologyofbimodalfeaturefusionbasedondomainadversarialneuralnetworks AT fengbu liedetectiontechnologyofbimodalfeaturefusionbasedondomainadversarialneuralnetworks |