Comparison of fuzzy integral-fuzzy measure based ensemble algorithms with state-of-the-art ensemble algorithms
Document Type
Conference Proceeding
Publication Date
5-18-2018
Department
Center for Data Sciences; Department of Electrical and Computer Engineering; Department of Computer Science
Abstract
The Fuzzy Integral (FI) is a non-linear aggregation operator which enables the fusion of information from multiple sources in respect to a Fuzzy Measure (FM) which captures the worth of both the individual sources and all their possible combinations. Based on the expected potential of non-linear aggregation offered by the FI, its application to decision-level fusion in ensemble classifiers, i.e. to fuse multiple classifiers outputs towards one superior decision level output, has recently been explored. A key example of such a FI-FM ensemble classification method is the Decision-level Fuzzy Integral Multiple Kernel Learning (DeFIMKL) algorithm, which aggregates the outputs of kernel based classifiers through the use of the Choquet FI with respect to a FM learned through a regularised quadratic programming approach. While the approach has been validated against a number of classifiers based on multiple kernel learning, it has thus far not been compared to the state-of-the-art in ensemble classification. Thus, this paper puts forward a detailed comparison of FI-FM based ensemble methods, specifically the DeFIMKL algorithm, with state-of-the art ensemble methods including Adaboost, Bagging, Random Forest and Majority Voting over 20 public datasets from the UCI machine learning repository. The results on the selected datasets suggest that the FI based ensemble classifier performs both well and efficiently, indicating that it is a viable alternative when selecting ensemble classifiers and indicating that the non-linear fusion of decision level outputs offered by the FI provides expected potential and warrants further study.
Publication Title
IPMU 2018: Information Processing and Management of Uncertainty in Knowledge-Based Systems
Recommended Citation
Agrawal, U.,
Pinar, A.,
Wagner, C.,
Havens, T. C.,
Soria, D.,
&
Gribaldi, J. M.
(2018).
Comparison of fuzzy integral-fuzzy measure based ensemble algorithms with state-of-the-art ensemble algorithms.
IPMU 2018: Information Processing and Management of Uncertainty in Knowledge-Based Systems, 329-341.
http://doi.org/10.1007/978-3-319-91473-2_29
Retrieved from: https://digitalcommons.mtu.edu/michigantech-p/980
Publisher's Statement
© Springer International Publishing AG, part of Springer Nature 2018. Publisher's version of record: https://doi.org/10.1007/978-3-319-91473-2_29