Improving Predictions of Multiple Binary Models in ILP
Despite the success of ILP systems in learning first-order rules from small number of examples and complexly structured data in various domains, they struggle in dealing with multiclass problems. In most cases they boil down a multiclass problem into multiple black-box binary problems following the...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2014-01-01
|
| Series: | The Scientific World Journal |
| Online Access: | http://dx.doi.org/10.1155/2014/739062 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832567628838731776 |
|---|---|
| author | Tarek Abudawood |
| author_facet | Tarek Abudawood |
| author_sort | Tarek Abudawood |
| collection | DOAJ |
| description | Despite the success of ILP systems in learning first-order rules from small number of examples and complexly structured data in various domains, they struggle in dealing with multiclass problems. In most cases they boil down a multiclass problem into multiple black-box binary problems following the one-versus-one or one-versus-rest binarisation techniques and learn a theory for each one. When evaluating the learned theories of multiple class problems in one-versus-rest paradigm particularly, there is a bias caused by the default rule toward the negative classes leading to an unrealistic high performance beside the lack of prediction integrity between the theories. Here we discuss the problem of using one-versus-rest binarisation technique when it comes to evaluating multiclass data and propose several methods to remedy this problem. We also illustrate the methods and highlight their link to binary tree and Formal Concept Analysis (FCA). Our methods allow learning of a simple, consistent, and reliable multiclass theory by combining the rules of the multiple one-versus-rest theories into one rule list or rule set theory. Empirical evaluation over a number of data sets shows that our proposed methods produce coherent and accurate rule models from the rules learned by the ILP system of Aleph. |
| format | Article |
| id | doaj-art-fbaa852d573a4eb2b071888b79b36221 |
| institution | Kabale University |
| issn | 2356-6140 1537-744X |
| language | English |
| publishDate | 2014-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | The Scientific World Journal |
| spelling | doaj-art-fbaa852d573a4eb2b071888b79b362212025-02-03T01:01:10ZengWileyThe Scientific World Journal2356-61401537-744X2014-01-01201410.1155/2014/739062739062Improving Predictions of Multiple Binary Models in ILPTarek Abudawood0Machine Learning & Medical Informatics Lab, Computer Research Institute, King Abdulaziz City for Science and Technology (KACST), Riyadh 11442, Saudi ArabiaDespite the success of ILP systems in learning first-order rules from small number of examples and complexly structured data in various domains, they struggle in dealing with multiclass problems. In most cases they boil down a multiclass problem into multiple black-box binary problems following the one-versus-one or one-versus-rest binarisation techniques and learn a theory for each one. When evaluating the learned theories of multiple class problems in one-versus-rest paradigm particularly, there is a bias caused by the default rule toward the negative classes leading to an unrealistic high performance beside the lack of prediction integrity between the theories. Here we discuss the problem of using one-versus-rest binarisation technique when it comes to evaluating multiclass data and propose several methods to remedy this problem. We also illustrate the methods and highlight their link to binary tree and Formal Concept Analysis (FCA). Our methods allow learning of a simple, consistent, and reliable multiclass theory by combining the rules of the multiple one-versus-rest theories into one rule list or rule set theory. Empirical evaluation over a number of data sets shows that our proposed methods produce coherent and accurate rule models from the rules learned by the ILP system of Aleph.http://dx.doi.org/10.1155/2014/739062 |
| spellingShingle | Tarek Abudawood Improving Predictions of Multiple Binary Models in ILP The Scientific World Journal |
| title | Improving Predictions of Multiple Binary Models in ILP |
| title_full | Improving Predictions of Multiple Binary Models in ILP |
| title_fullStr | Improving Predictions of Multiple Binary Models in ILP |
| title_full_unstemmed | Improving Predictions of Multiple Binary Models in ILP |
| title_short | Improving Predictions of Multiple Binary Models in ILP |
| title_sort | improving predictions of multiple binary models in ilp |
| url | http://dx.doi.org/10.1155/2014/739062 |
| work_keys_str_mv | AT tarekabudawood improvingpredictionsofmultiplebinarymodelsinilp |