Loughborough University
Leicestershire, UK
LE11 3TU
+44 (0)1509 263171
Loughborough University

Loughborough University Institutional Repository

Please use this identifier to cite or link to this item: https://dspace.lboro.ac.uk/2134/25432

Title: Exploiting diversity for optimizing margin distribution in ensemble learning
Authors: Hu, Qinghua
Li, Leijun
Wu, Xiangqian
Schaefer, Gerald
Yu, Daren
Keywords: Ensemble learning
Margin distribution
Diversity
Fusion strategy
Rotation
Issue Date: 2014
Publisher: © Elsevier
Citation: HU, Q. ... et al, 2014. Exploiting diversity for optimizing margin distribution in ensemble learning. Knowledge-Based Systems, 67, pp. 90-104.
Abstract: Margin distribution is acknowledged as an important factor for improving the generalization performance of classifiers. In this paper, we propose a novel ensemble learning algorithm named Double Rotation Margin Forest (DRMF), that aims to improve the margin distribution of the combined system over the training set. We utilise random rotation to produce diverse base classifiers, and optimize the margin distribution to exploit the diversity for producing an optimal ensemble. We demonstrate that diverse base classifiers are beneficial in deriving large-margin ensembles, and that therefore our proposed technique will lead to good generalization performance. We examine our method on an extensive set of benchmark classification tasks. The experimental results confirm that DRMF outperforms other classical ensemble algorithms such as Bagging, AdaBoostM1 and Rotation Forest. The success of DRMF is explained from the viewpoints of margin distribution and diversity.
Description: This paper was accepted for publication in the journal Knowledge-Based Systems and the definitive published version is available at http://dx.doi.org/10.1016/j.knosys.2014.06.005
Sponsor: This work is supported by the National Program on Key Basic Research Project under Grant 2013CB329304, National Natural Science Foundation of China under Grants 61222210, 61170107, 61073125, 61350004 and 11078010, the Program for New Century Excellent Talents in University (No. NCET-12-0399), and the Fundamental Research Funds for the Central Universities (Grant No. HIT.NSRIF.2013091 and HIT.HSS.201407).
Version: Accepted for publication
DOI: 10.1016/j.knosys.2014.06.005
URI: https://dspace.lboro.ac.uk/2134/25432
Publisher Link: http://dx.doi.org/10.1016/j.knosys.2014.06.005
ISSN: 0950-7051
Appears in Collections:Published Articles (Computer Science)

Files associated with this item:

File Description SizeFormat
kbs14.pdfAccepted version363.57 kBAdobe PDFView/Open

 

SFX Query

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.