Multi-phase attention network for face super-resolution.
Previous general super-resolution methods do not perform well in restoring the details structure information of face images. Prior and attribute-based face super-resolution methods have improved performance with extra trained results. However, they need an additional network and extra training data...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2023-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0280986&type=printable |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832589884428124160 |
|---|---|
| author | Tao Hu Yunzhi Chen |
| author_facet | Tao Hu Yunzhi Chen |
| author_sort | Tao Hu |
| collection | DOAJ |
| description | Previous general super-resolution methods do not perform well in restoring the details structure information of face images. Prior and attribute-based face super-resolution methods have improved performance with extra trained results. However, they need an additional network and extra training data are challenging to obtain. To address these issues, we propose a Multi-phase Attention Network (MPAN). Specifically, our proposed MPAN builds on integrated residual attention groups (IRAG) and a concatenated attention module (CAM). The IRAG consists of residual channel attention blocks (RCAB) and an integrated attention module (IAM). Meanwhile, we use IRAG to bootstrap the face structures. We utilize the CAM to concentrate on informative layers, hence improving the network's ability to reconstruct facial texture features. We use the IAM to focus on important positions and channels, which makes the network more effective at restoring key face structures like eyes and mouths. The above two attention modules form the multi-phase attention mechanism. Extensive experiments show that our MPAN has a significant competitive advantage over other state-of-the-art networks on various scale factors using various metrics, including PSNR and SSIM. Overall, our proposed Multi-phase Attention mechanism significantly improves the network for recovering face HR images without using additional information. |
| format | Article |
| id | doaj-art-05d5180f751e40f1af0b2177c1d5c488 |
| institution | Kabale University |
| issn | 1932-6203 |
| language | English |
| publishDate | 2023-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj-art-05d5180f751e40f1af0b2177c1d5c4882025-01-24T05:31:10ZengPublic Library of Science (PLoS)PLoS ONE1932-62032023-01-01182e028098610.1371/journal.pone.0280986Multi-phase attention network for face super-resolution.Tao HuYunzhi ChenPrevious general super-resolution methods do not perform well in restoring the details structure information of face images. Prior and attribute-based face super-resolution methods have improved performance with extra trained results. However, they need an additional network and extra training data are challenging to obtain. To address these issues, we propose a Multi-phase Attention Network (MPAN). Specifically, our proposed MPAN builds on integrated residual attention groups (IRAG) and a concatenated attention module (CAM). The IRAG consists of residual channel attention blocks (RCAB) and an integrated attention module (IAM). Meanwhile, we use IRAG to bootstrap the face structures. We utilize the CAM to concentrate on informative layers, hence improving the network's ability to reconstruct facial texture features. We use the IAM to focus on important positions and channels, which makes the network more effective at restoring key face structures like eyes and mouths. The above two attention modules form the multi-phase attention mechanism. Extensive experiments show that our MPAN has a significant competitive advantage over other state-of-the-art networks on various scale factors using various metrics, including PSNR and SSIM. Overall, our proposed Multi-phase Attention mechanism significantly improves the network for recovering face HR images without using additional information.https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0280986&type=printable |
| spellingShingle | Tao Hu Yunzhi Chen Multi-phase attention network for face super-resolution. PLoS ONE |
| title | Multi-phase attention network for face super-resolution. |
| title_full | Multi-phase attention network for face super-resolution. |
| title_fullStr | Multi-phase attention network for face super-resolution. |
| title_full_unstemmed | Multi-phase attention network for face super-resolution. |
| title_short | Multi-phase attention network for face super-resolution. |
| title_sort | multi phase attention network for face super resolution |
| url | https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0280986&type=printable |
| work_keys_str_mv | AT taohu multiphaseattentionnetworkforfacesuperresolution AT yunzhichen multiphaseattentionnetworkforfacesuperresolution |