A New Robust Classifier on Noise Domains: Bagging of Credal C4.5 Trees
The knowledge extraction from data with noise or outliers is a complex problem in the data mining area. Normally, it is not easy to eliminate those problematic instances. To obtain information from this type of data, robust classifiers are the best option to use. One of them is the application of ba...
Saved in:
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Wiley
2017-01-01
|
Series: | Complexity |
Online Access: | http://dx.doi.org/10.1155/2017/9023970 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
_version_ | 1832548535233413120 |
---|---|
author | Joaquín Abellán Javier G. Castellano Carlos J. Mantas |
author_facet | Joaquín Abellán Javier G. Castellano Carlos J. Mantas |
author_sort | Joaquín Abellán |
collection | DOAJ |
description | The knowledge extraction from data with noise or outliers is a complex problem in the data mining area. Normally, it is not easy to eliminate those problematic instances. To obtain information from this type of data, robust classifiers are the best option to use. One of them is the application of bagging scheme on weak single classifiers. The Credal C4.5 (CC4.5) model is a new classification tree procedure based on the classical C4.5 algorithm and imprecise probabilities. It represents a type of the so-called credal trees. It has been proven that CC4.5 is more robust to noise than C4.5 method and even than other previous credal tree models. In this paper, the performance of the CC4.5 model in bagging schemes on noisy domains is shown. An experimental study on data sets with added noise is carried out in order to compare results where bagging schemes are applied on credal trees and C4.5 procedure. As a benchmark point, the known Random Forest (RF) classification method is also used. It will be shown that the bagging ensemble using pruned credal trees outperforms the successful bagging C4.5 and RF when data sets with medium-to-high noise level are classified. |
format | Article |
id | doaj-art-4a0d320edbcf40b5a79f991916783e92 |
institution | Kabale University |
issn | 1076-2787 1099-0526 |
language | English |
publishDate | 2017-01-01 |
publisher | Wiley |
record_format | Article |
series | Complexity |
spelling | doaj-art-4a0d320edbcf40b5a79f991916783e922025-02-03T06:13:49ZengWileyComplexity1076-27871099-05262017-01-01201710.1155/2017/90239709023970A New Robust Classifier on Noise Domains: Bagging of Credal C4.5 TreesJoaquín Abellán0Javier G. Castellano1Carlos J. Mantas2Department of Computer Science and Artificial Intelligence, University of Granada, Granada, SpainDepartment of Computer Science and Artificial Intelligence, University of Granada, Granada, SpainDepartment of Computer Science and Artificial Intelligence, University of Granada, Granada, SpainThe knowledge extraction from data with noise or outliers is a complex problem in the data mining area. Normally, it is not easy to eliminate those problematic instances. To obtain information from this type of data, robust classifiers are the best option to use. One of them is the application of bagging scheme on weak single classifiers. The Credal C4.5 (CC4.5) model is a new classification tree procedure based on the classical C4.5 algorithm and imprecise probabilities. It represents a type of the so-called credal trees. It has been proven that CC4.5 is more robust to noise than C4.5 method and even than other previous credal tree models. In this paper, the performance of the CC4.5 model in bagging schemes on noisy domains is shown. An experimental study on data sets with added noise is carried out in order to compare results where bagging schemes are applied on credal trees and C4.5 procedure. As a benchmark point, the known Random Forest (RF) classification method is also used. It will be shown that the bagging ensemble using pruned credal trees outperforms the successful bagging C4.5 and RF when data sets with medium-to-high noise level are classified.http://dx.doi.org/10.1155/2017/9023970 |
spellingShingle | Joaquín Abellán Javier G. Castellano Carlos J. Mantas A New Robust Classifier on Noise Domains: Bagging of Credal C4.5 Trees Complexity |
title | A New Robust Classifier on Noise Domains: Bagging of Credal C4.5 Trees |
title_full | A New Robust Classifier on Noise Domains: Bagging of Credal C4.5 Trees |
title_fullStr | A New Robust Classifier on Noise Domains: Bagging of Credal C4.5 Trees |
title_full_unstemmed | A New Robust Classifier on Noise Domains: Bagging of Credal C4.5 Trees |
title_short | A New Robust Classifier on Noise Domains: Bagging of Credal C4.5 Trees |
title_sort | new robust classifier on noise domains bagging of credal c4 5 trees |
url | http://dx.doi.org/10.1155/2017/9023970 |
work_keys_str_mv | AT joaquinabellan anewrobustclassifieronnoisedomainsbaggingofcredalc45trees AT javiergcastellano anewrobustclassifieronnoisedomainsbaggingofcredalc45trees AT carlosjmantas anewrobustclassifieronnoisedomainsbaggingofcredalc45trees AT joaquinabellan newrobustclassifieronnoisedomainsbaggingofcredalc45trees AT javiergcastellano newrobustclassifieronnoisedomainsbaggingofcredalc45trees AT carlosjmantas newrobustclassifieronnoisedomainsbaggingofcredalc45trees |