MI2LS: Multi-instance learning from multiple information sources

Dan Zhang, Jingrui He, Richard D. Lawrence

Research output: Chapter in Book/Report/Conference proceedingConference contribution

23 Scopus citations

Abstract

In Multiple Instance Learning (MIL), each entity is normally expressed as a set of instances. Most of the current MIL methods only deal with the case when each instance is represented by one type of features. However, in many real world applications, entities are often described from several different information sources/views. For example, when applying MIL to image categorization, the characteristics of each image can be derived from both its RGB features and SIFT features. Previous research work has shown that, in traditional learning methods, leveraging the consistencies between different information sources could improve the classification performance drastically. Out of a similar motivation, to incorporate the consistencies between different information sources into MIL, we propose a novel research framework - Multi-Instance Learning from Multiple Information Sources (MI2LS). Based on this framework, an algorithm - Fast MI2LS (FMI2LS) is designed, which combines Constraint Concave-Convex Programming (CCCP) method and an adapted Stoachastic Gradient Descent (SGD) method. Some theoretical analysis on the optimality of the adapted SGD method and the generalized error bound of the formulation are given based on the proposed method. Experimental results on document classification and a novel application - Insider Threat Detection (ITD), clearly demonstrate the superior performance of the proposed method over state-of-The-Art MIL methods.

Original languageEnglish (US)
Title of host publicationKDD 2013 - 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
PublisherAssociation for Computing Machinery
Pages149-157
Number of pages9
VolumePart F128815
ISBN (Electronic)9781450321747
DOIs
StatePublished - Aug 11 2013
Externally publishedYes
Event19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2013 - Chicago, United States
Duration: Aug 11 2013Aug 14 2013

Other

Other19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2013
CountryUnited States
CityChicago
Period8/11/138/14/13

Keywords

  • Multi-instance learning
  • Multi-view learning
  • Stoachastic gradient descent

ASJC Scopus subject areas

  • Software
  • Information Systems

Fingerprint Dive into the research topics of 'MI2LS: Multi-instance learning from multiple information sources'. Together they form a unique fingerprint.

  • Cite this

    Zhang, D., He, J., & Lawrence, R. D. (2013). MI2LS: Multi-instance learning from multiple information sources. In KDD 2013 - 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (Vol. Part F128815, pp. 149-157). [2487651] Association for Computing Machinery. https://doi.org/10.1145/2487575.2487651