Robust and Sparse Kernel-Free Quadratic Surface LSR via L<sub>2,p</sub>-Norm With Feature Selection for Multi-Class Image Classification

Robust and Sparse Kernel-Free Quadratic Surface LSR via L<sub>2,p</sub>-Norm With Feature Selection for Multi-Class Image Classification

Least Squares Regression (LSR) is a powerful machine learning method for image classification and feature selection. In this study, a framework approach is introduced for the multi-classification problem based on the <inline-formula> <tex-math notation="LaTeX">$L_{2,p}$ </te...

Full description

Saved in:
Bibliographic Details
Main Authors: Yongqi Zhu, Zhixia Yang, Junyou Ye, Yongxing Hu
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Multi-class classification learning
Manifold regularization
Sparse learning
Kernel-free
L2,p-norm
Online Access:https://ieeexplore.ieee.org/document/10848070/
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Least Squares Regression (LSR) is a powerful machine learning method for image classification and feature selection. In this study, a framework approach is introduced for the multi-classification problem based on the <inline-formula> <tex-math notation="LaTeX">$L_{2,p}$ </tex-math></inline-formula>-norm, utilizing more general loss functions and regularization terms, which is a robust sparse kernel-free quadratic surface least squares regression (RSQSLSR). The nonlinear relationship between features is addressed using a quadratic kernel-free technique combined with <inline-formula> <tex-math notation="LaTeX">$\epsilon $ </tex-math></inline-formula>-dragging technology and manifold regularization to learn soft labels, which can achieve the goal of feature selection and classification, simultaneously. This model utilizes K quadratic surfaces mapping samples from the input space to the label space, preserving the local structure of the samples. To enhance practical applications, such as image classification, a simplified version of the method is proposed. An iterative algorithm for RSQSLSR is designed and its convergence is proved theoretically. The salient features and theoretical analysis of our proposed method are comprehensively discussed in this paper. Extensive experiments on synthetic and real datasets validate the effectiveness of our method, surpassing other state-of-the-art methods in terms of classification accuracy and feature selection performance.
ISSN:2169-3536

Similar Items