SWITCH: A novel approach to ensemble learning for heterogeneous data

Rong Jin, Huan Liu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

The standard framework of machine learning problems assumes that the available data is independent and identically distributed (i.i.d.). However, in some applications such as image classification, the training data are often collected from multiple sources and heterogeneous. Ensemble learning is a proven effective approach to heterogeneous data, which uses multiple classification models to capture the diverse aspects of heterogeneous data. If an ensemble can learn the relationship between different portions of data and their corresponding models, the ensemble can selectively apply models to unseen data according to the learned relationship. We propose a novel approach to enable the learning of the relationships between data and models by creating a set of 'switches' that can route a testing instance to appropriate classification models in an ensemble. Our empirical study on both real-world data and benchmark data shows that the proposed approach to ensemble learning can achieve significant performance improvement for heterogeneous data.

Original languageEnglish (US)
Title of host publicationLecture Notes in Artificial Intelligence (Subseries of Lecture Notes in Computer Science)
EditorsJ.-F. Boulicaut, F. Esposito, D. Pedreschi, F. Giannotti
Pages560-562
Number of pages3
Volume3201
StatePublished - 2004
Event15th European Conference on Machine Learning, ECML 2004 - Pisa, Italy
Duration: Sep 20 2004Sep 24 2004

Other

Other15th European Conference on Machine Learning, ECML 2004
CountryItaly
CityPisa
Period9/20/049/24/04

ASJC Scopus subject areas

  • Hardware and Architecture

Fingerprint Dive into the research topics of 'SWITCH: A novel approach to ensemble learning for heterogeneous data'. Together they form a unique fingerprint.

  • Cite this

    Jin, R., & Liu, H. (2004). SWITCH: A novel approach to ensemble learning for heterogeneous data. In J-F. Boulicaut, F. Esposito, D. Pedreschi, & F. Giannotti (Eds.), Lecture Notes in Artificial Intelligence (Subseries of Lecture Notes in Computer Science) (Vol. 3201, pp. 560-562)