Adaptive Weighted Face Alignment by Multi-Scale Feature and Offset Prediction
Traditional heatmap regression methods have some problems such as the lower limit of theoretical error and the lack of global constraints, which may lead to the collapse of the results in practical application. In this paper, we develop a facial landmark detection model aided by offset prediction to...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2023-01-01
|
| Series: | IET Biometrics |
| Online Access: | http://dx.doi.org/10.1049/2023/6636386 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832546698376773632 |
|---|---|
| author | Jingwen Li Jiuzhen Liang Hao Liu Zhenjie Hou |
| author_facet | Jingwen Li Jiuzhen Liang Hao Liu Zhenjie Hou |
| author_sort | Jingwen Li |
| collection | DOAJ |
| description | Traditional heatmap regression methods have some problems such as the lower limit of theoretical error and the lack of global constraints, which may lead to the collapse of the results in practical application. In this paper, we develop a facial landmark detection model aided by offset prediction to constrain the global shape. First, the hybrid detection model is used to roughly locate the initial coordinates predicted by the backbone network. At the same time, the head rotation attitude prediction module is added to the backbone network, and the Euler angle is used as the adaptive weight to modify the loss function so that the model has better robustness to the large pose image. Then, we introduce an offset prediction network. It uses the heatmap corresponding to the initial coordinates as an attention mask to fuze with the features, so the network can focus on the area around landmarks. This model shares the global features and regresses the offset relative to the real coordinates based on the initial coordinates to further enhance the continuity. In addition, we also add a multi-scale feature pre-extraction module to preprocess features so that we can increase feature scales and receptive fields. Experiments on several challenging public datasets show that our method gets better performance than the existing detection methods, confirming the effectiveness of our method. |
| format | Article |
| id | doaj-art-cc9484fac25c4ac1a7bc9fcf04b3fd8a |
| institution | Kabale University |
| issn | 2047-4946 |
| language | English |
| publishDate | 2023-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | IET Biometrics |
| spelling | doaj-art-cc9484fac25c4ac1a7bc9fcf04b3fd8a2025-02-03T06:47:27ZengWileyIET Biometrics2047-49462023-01-01202310.1049/2023/6636386Adaptive Weighted Face Alignment by Multi-Scale Feature and Offset PredictionJingwen Li0Jiuzhen Liang1Hao Liu2Zhenjie Hou3School of Computer Science and Artificial IntelligenceSchool of Computer Science and Artificial IntelligenceSchool of Computer Science and Artificial IntelligenceSchool of Computer Science and Artificial IntelligenceTraditional heatmap regression methods have some problems such as the lower limit of theoretical error and the lack of global constraints, which may lead to the collapse of the results in practical application. In this paper, we develop a facial landmark detection model aided by offset prediction to constrain the global shape. First, the hybrid detection model is used to roughly locate the initial coordinates predicted by the backbone network. At the same time, the head rotation attitude prediction module is added to the backbone network, and the Euler angle is used as the adaptive weight to modify the loss function so that the model has better robustness to the large pose image. Then, we introduce an offset prediction network. It uses the heatmap corresponding to the initial coordinates as an attention mask to fuze with the features, so the network can focus on the area around landmarks. This model shares the global features and regresses the offset relative to the real coordinates based on the initial coordinates to further enhance the continuity. In addition, we also add a multi-scale feature pre-extraction module to preprocess features so that we can increase feature scales and receptive fields. Experiments on several challenging public datasets show that our method gets better performance than the existing detection methods, confirming the effectiveness of our method.http://dx.doi.org/10.1049/2023/6636386 |
| spellingShingle | Jingwen Li Jiuzhen Liang Hao Liu Zhenjie Hou Adaptive Weighted Face Alignment by Multi-Scale Feature and Offset Prediction IET Biometrics |
| title | Adaptive Weighted Face Alignment by Multi-Scale Feature and Offset Prediction |
| title_full | Adaptive Weighted Face Alignment by Multi-Scale Feature and Offset Prediction |
| title_fullStr | Adaptive Weighted Face Alignment by Multi-Scale Feature and Offset Prediction |
| title_full_unstemmed | Adaptive Weighted Face Alignment by Multi-Scale Feature and Offset Prediction |
| title_short | Adaptive Weighted Face Alignment by Multi-Scale Feature and Offset Prediction |
| title_sort | adaptive weighted face alignment by multi scale feature and offset prediction |
| url | http://dx.doi.org/10.1049/2023/6636386 |
| work_keys_str_mv | AT jingwenli adaptiveweightedfacealignmentbymultiscalefeatureandoffsetprediction AT jiuzhenliang adaptiveweightedfacealignmentbymultiscalefeatureandoffsetprediction AT haoliu adaptiveweightedfacealignmentbymultiscalefeatureandoffsetprediction AT zhenjiehou adaptiveweightedfacealignmentbymultiscalefeatureandoffsetprediction |