Masked face recognition: Human versus machine

Abstract The recent COVID‐19 pandemic has increased the focus on hygienic and contactless identity verification methods. However, the pandemic led to the wide use of face masks, essential to keep the pandemic under control. The effect of wearing a mask on face recognition (FR) in a collaborative env...

Full description

Saved in:
Bibliographic Details
Main Authors: Naser Damer, Fadi Boutros, Marius Süßmilch, Meiling Fang, Florian Kirchbuchner, Arjan Kuijper
Format: Article
Language:English
Published: Wiley 2022-09-01
Series:IET Biometrics
Online Access:https://doi.org/10.1049/bme2.12077
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832559642352287744
author Naser Damer
Fadi Boutros
Marius Süßmilch
Meiling Fang
Florian Kirchbuchner
Arjan Kuijper
author_facet Naser Damer
Fadi Boutros
Marius Süßmilch
Meiling Fang
Florian Kirchbuchner
Arjan Kuijper
author_sort Naser Damer
collection DOAJ
description Abstract The recent COVID‐19 pandemic has increased the focus on hygienic and contactless identity verification methods. However, the pandemic led to the wide use of face masks, essential to keep the pandemic under control. The effect of wearing a mask on face recognition (FR) in a collaborative environment is a currently sensitive yet understudied issue. Recent reports have tackled this by evaluating the masked probe effect on the performance of automatic FR solutions. However, such solutions can fail in certain processes, leading to the verification task being performed by a human expert. This work provides a joint evaluation and in‐depth analyses of the face verification performance of human experts in comparison to state‐of‐the‐art automatic FR solutions. This involves an extensive evaluation by human experts and 4 automatic recognition solutions. The study concludes with a set of take‐home messages on different aspects of the correlation between the verification behaviour of humans and machines.
format Article
id doaj-art-a4a1d908434548f696dad37f39b59f35
institution Kabale University
issn 2047-4938
2047-4946
language English
publishDate 2022-09-01
publisher Wiley
record_format Article
series IET Biometrics
spelling doaj-art-a4a1d908434548f696dad37f39b59f352025-02-03T01:29:41ZengWileyIET Biometrics2047-49382047-49462022-09-0111551252810.1049/bme2.12077Masked face recognition: Human versus machineNaser Damer0Fadi Boutros1Marius Süßmilch2Meiling Fang3Florian Kirchbuchner4Arjan Kuijper5Fraunhofer Institute for Computer Graphics Research IGD Darmstadt GermanyFraunhofer Institute for Computer Graphics Research IGD Darmstadt GermanyFraunhofer Institute for Computer Graphics Research IGD Darmstadt GermanyFraunhofer Institute for Computer Graphics Research IGD Darmstadt GermanyFraunhofer Institute for Computer Graphics Research IGD Darmstadt GermanyFraunhofer Institute for Computer Graphics Research IGD Darmstadt GermanyAbstract The recent COVID‐19 pandemic has increased the focus on hygienic and contactless identity verification methods. However, the pandemic led to the wide use of face masks, essential to keep the pandemic under control. The effect of wearing a mask on face recognition (FR) in a collaborative environment is a currently sensitive yet understudied issue. Recent reports have tackled this by evaluating the masked probe effect on the performance of automatic FR solutions. However, such solutions can fail in certain processes, leading to the verification task being performed by a human expert. This work provides a joint evaluation and in‐depth analyses of the face verification performance of human experts in comparison to state‐of‐the‐art automatic FR solutions. This involves an extensive evaluation by human experts and 4 automatic recognition solutions. The study concludes with a set of take‐home messages on different aspects of the correlation between the verification behaviour of humans and machines.https://doi.org/10.1049/bme2.12077
spellingShingle Naser Damer
Fadi Boutros
Marius Süßmilch
Meiling Fang
Florian Kirchbuchner
Arjan Kuijper
Masked face recognition: Human versus machine
IET Biometrics
title Masked face recognition: Human versus machine
title_full Masked face recognition: Human versus machine
title_fullStr Masked face recognition: Human versus machine
title_full_unstemmed Masked face recognition: Human versus machine
title_short Masked face recognition: Human versus machine
title_sort masked face recognition human versus machine
url https://doi.org/10.1049/bme2.12077
work_keys_str_mv AT naserdamer maskedfacerecognitionhumanversusmachine
AT fadiboutros maskedfacerecognitionhumanversusmachine
AT mariussußmilch maskedfacerecognitionhumanversusmachine
AT meilingfang maskedfacerecognitionhumanversusmachine
AT floriankirchbuchner maskedfacerecognitionhumanversusmachine
AT arjankuijper maskedfacerecognitionhumanversusmachine