Open-world barely-supervised learning via augmented pseudo labels

Open-world semi-supervised learning (OWSSL) has received significant attention since it addresses the issue of unlabeled data containing classes not present in the labeled data. Unfortunately, existing OWSSL methods still rely on a large amount of labeled data from seen classes, overlooking the real...

Full description

Saved in:
Bibliographic Details
Main Authors: Zhongnian Li, Yanyan Ding, Meng Wei, Xinzheng Xu
Format: Article
Language:English
Published: AIMS Press 2024-10-01
Series:Electronic Research Archive
Subjects:
Online Access:https://www.aimspress.com/article/doi/10.3934/era.2024268
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832590765133398016
author Zhongnian Li
Yanyan Ding
Meng Wei
Xinzheng Xu
author_facet Zhongnian Li
Yanyan Ding
Meng Wei
Xinzheng Xu
author_sort Zhongnian Li
collection DOAJ
description Open-world semi-supervised learning (OWSSL) has received significant attention since it addresses the issue of unlabeled data containing classes not present in the labeled data. Unfortunately, existing OWSSL methods still rely on a large amount of labeled data from seen classes, overlooking the reality that a substantial amount of labels is difficult to obtain in real scenarios. In this paper, we explored a new setting called open-world barely-supervised learning (OWBSL), where only a single label was provided for each seen class, greatly reducing labeling costs. To tackle the OWBSL task, we proposed a novel framework that leveraged augmented pseudo-labels generated for the unlabeled data. Specifically, we first generated initial pseudo-labels for the unlabeled data using visual-language models. Subsequently, to ensure that the pseudo-labels remained reliable while being updated during model training, we enhanced them using predictions from weak data augmentation. This way, we obtained the augmented pseudo-labels. Additionally, to fully exploit the information from unlabeled data, we incorporated consistency regularization based on strong and weak augmentations into our framework. Our experimental results on multiple benchmark datasets demonstrated the effectiveness of our method.
format Article
id doaj-art-a6bc09847b904b989630192a6ef988f3
institution Kabale University
issn 2688-1594
language English
publishDate 2024-10-01
publisher AIMS Press
record_format Article
series Electronic Research Archive
spelling doaj-art-a6bc09847b904b989630192a6ef988f32025-01-23T07:52:53ZengAIMS PressElectronic Research Archive2688-15942024-10-0132105804581810.3934/era.2024268Open-world barely-supervised learning via augmented pseudo labelsZhongnian Li0Yanyan Ding1Meng Wei2Xinzheng Xu3School of Computer Science and Technology, China University of Mining and Technology, Xuzhou 221116, ChinaSchool of Computer Science and Technology, China University of Mining and Technology, Xuzhou 221116, ChinaSchool of Computer Science and Technology, China University of Mining and Technology, Xuzhou 221116, ChinaSchool of Computer Science and Technology, China University of Mining and Technology, Xuzhou 221116, ChinaOpen-world semi-supervised learning (OWSSL) has received significant attention since it addresses the issue of unlabeled data containing classes not present in the labeled data. Unfortunately, existing OWSSL methods still rely on a large amount of labeled data from seen classes, overlooking the reality that a substantial amount of labels is difficult to obtain in real scenarios. In this paper, we explored a new setting called open-world barely-supervised learning (OWBSL), where only a single label was provided for each seen class, greatly reducing labeling costs. To tackle the OWBSL task, we proposed a novel framework that leveraged augmented pseudo-labels generated for the unlabeled data. Specifically, we first generated initial pseudo-labels for the unlabeled data using visual-language models. Subsequently, to ensure that the pseudo-labels remained reliable while being updated during model training, we enhanced them using predictions from weak data augmentation. This way, we obtained the augmented pseudo-labels. Additionally, to fully exploit the information from unlabeled data, we incorporated consistency regularization based on strong and weak augmentations into our framework. Our experimental results on multiple benchmark datasets demonstrated the effectiveness of our method.https://www.aimspress.com/article/doi/10.3934/era.2024268open-worldbarely-supervised learningsemi-supervised learningclippseudo-label
spellingShingle Zhongnian Li
Yanyan Ding
Meng Wei
Xinzheng Xu
Open-world barely-supervised learning via augmented pseudo labels
Electronic Research Archive
open-world
barely-supervised learning
semi-supervised learning
clip
pseudo-label
title Open-world barely-supervised learning via augmented pseudo labels
title_full Open-world barely-supervised learning via augmented pseudo labels
title_fullStr Open-world barely-supervised learning via augmented pseudo labels
title_full_unstemmed Open-world barely-supervised learning via augmented pseudo labels
title_short Open-world barely-supervised learning via augmented pseudo labels
title_sort open world barely supervised learning via augmented pseudo labels
topic open-world
barely-supervised learning
semi-supervised learning
clip
pseudo-label
url https://www.aimspress.com/article/doi/10.3934/era.2024268
work_keys_str_mv AT zhongnianli openworldbarelysupervisedlearningviaaugmentedpseudolabels
AT yanyanding openworldbarelysupervisedlearningviaaugmentedpseudolabels
AT mengwei openworldbarelysupervisedlearningviaaugmentedpseudolabels
AT xinzhengxu openworldbarelysupervisedlearningviaaugmentedpseudolabels