A Complete Subspace Analysis of Linear Discriminant Analysis and Its Robust Implementation
Linear discriminant analysis has been widely studied in data mining and pattern recognition. However, when performing the eigen-decomposition on the matrix pair (within-class scatter matrix and between-class scatter matrix) in some cases, one can find that there exist some degenerated eigenvalues, t...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2016-01-01
|
| Series: | Journal of Electrical and Computer Engineering |
| Online Access: | http://dx.doi.org/10.1155/2016/3919472 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832551906890743808 |
|---|---|
| author | Zhicheng Lu Zhizheng Liang |
| author_facet | Zhicheng Lu Zhizheng Liang |
| author_sort | Zhicheng Lu |
| collection | DOAJ |
| description | Linear discriminant analysis has been widely studied in data mining and pattern recognition. However, when performing the eigen-decomposition on the matrix pair (within-class scatter matrix and between-class scatter matrix) in some cases, one can find that there exist some degenerated eigenvalues, thereby resulting in indistinguishability of information from the eigen-subspace corresponding to some degenerated eigenvalue. In order to address this problem, we revisit linear discriminant analysis in this paper and propose a stable and effective algorithm for linear discriminant analysis in terms of an optimization criterion. By discussing the properties of the optimization criterion, we find that the eigenvectors in some eigen-subspaces may be indistinguishable if the degenerated eigenvalue occurs. Inspired from the idea of the maximum margin criterion (MMC), we embed MMC into the eigen-subspace corresponding to the degenerated eigenvalue to exploit discriminability of the eigenvectors in the eigen-subspace. Since the proposed algorithm can deal with the degenerated case of eigenvalues, it not only handles the small-sample-size problem but also enables us to select projection vectors from the null space of the between-class scatter matrix. Extensive experiments on several face images and microarray data sets are conducted to evaluate the proposed algorithm in terms of the classification performance, and experimental results show that our method has smaller standard deviations than other methods in most cases. |
| format | Article |
| id | doaj-art-d0a75cbc742a4da598e6b1f6b286c095 |
| institution | Kabale University |
| issn | 2090-0147 2090-0155 |
| language | English |
| publishDate | 2016-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | Journal of Electrical and Computer Engineering |
| spelling | doaj-art-d0a75cbc742a4da598e6b1f6b286c0952025-02-03T06:00:13ZengWileyJournal of Electrical and Computer Engineering2090-01472090-01552016-01-01201610.1155/2016/39194723919472A Complete Subspace Analysis of Linear Discriminant Analysis and Its Robust ImplementationZhicheng Lu0Zhizheng Liang1School of Computer Science and Technology, China University of Mining and Technology, Xuzhou 221116, ChinaSchool of Computer Science and Technology, China University of Mining and Technology, Xuzhou 221116, ChinaLinear discriminant analysis has been widely studied in data mining and pattern recognition. However, when performing the eigen-decomposition on the matrix pair (within-class scatter matrix and between-class scatter matrix) in some cases, one can find that there exist some degenerated eigenvalues, thereby resulting in indistinguishability of information from the eigen-subspace corresponding to some degenerated eigenvalue. In order to address this problem, we revisit linear discriminant analysis in this paper and propose a stable and effective algorithm for linear discriminant analysis in terms of an optimization criterion. By discussing the properties of the optimization criterion, we find that the eigenvectors in some eigen-subspaces may be indistinguishable if the degenerated eigenvalue occurs. Inspired from the idea of the maximum margin criterion (MMC), we embed MMC into the eigen-subspace corresponding to the degenerated eigenvalue to exploit discriminability of the eigenvectors in the eigen-subspace. Since the proposed algorithm can deal with the degenerated case of eigenvalues, it not only handles the small-sample-size problem but also enables us to select projection vectors from the null space of the between-class scatter matrix. Extensive experiments on several face images and microarray data sets are conducted to evaluate the proposed algorithm in terms of the classification performance, and experimental results show that our method has smaller standard deviations than other methods in most cases.http://dx.doi.org/10.1155/2016/3919472 |
| spellingShingle | Zhicheng Lu Zhizheng Liang A Complete Subspace Analysis of Linear Discriminant Analysis and Its Robust Implementation Journal of Electrical and Computer Engineering |
| title | A Complete Subspace Analysis of Linear Discriminant Analysis and Its Robust Implementation |
| title_full | A Complete Subspace Analysis of Linear Discriminant Analysis and Its Robust Implementation |
| title_fullStr | A Complete Subspace Analysis of Linear Discriminant Analysis and Its Robust Implementation |
| title_full_unstemmed | A Complete Subspace Analysis of Linear Discriminant Analysis and Its Robust Implementation |
| title_short | A Complete Subspace Analysis of Linear Discriminant Analysis and Its Robust Implementation |
| title_sort | complete subspace analysis of linear discriminant analysis and its robust implementation |
| url | http://dx.doi.org/10.1155/2016/3919472 |
| work_keys_str_mv | AT zhichenglu acompletesubspaceanalysisoflineardiscriminantanalysisanditsrobustimplementation AT zhizhengliang acompletesubspaceanalysisoflineardiscriminantanalysisanditsrobustimplementation AT zhichenglu completesubspaceanalysisoflineardiscriminantanalysisanditsrobustimplementation AT zhizhengliang completesubspaceanalysisoflineardiscriminantanalysisanditsrobustimplementation |