Abstract

Dynamic topic models (DTM) are commonly used for mining latent topics in evolving web corpora. In this paper, we note that a major limitation of the conventional DTM based models is that they assume a predetermined and fixed scale of topics. In reality, however, topics may have varying spans and topics of multiple scales can co-exist in a single web or social media data stream. Therefore, DTMs that assume a fixed epoch length may not be able to effectively capture latent topics and thus negatively affect accuracy. In this paper, we propose a Multi-Scale Dynamic Topic Model (MS-DTM) and a complementary Incremental Multi-Scale Dynamic Topic Model (IMS-DTM) inference method that can be used to capture latent topics and their dynamics simultaneously, at different scales. In this model, topic specific feature distributions are generated based on a multi-scale feature distribution of the previous epochs; moreover, multiple scales of the current epoch are analyzed together through a novel multi-scale incremental Gibbs sampling technique. We show that the proposed model significantly improves efficiency and effectiveness compared to the single scale dynamic DTMs and prior models that consider only multiple scales of the past.

Original languageEnglish (US)
Title of host publication32nd AAAI Conference on Artificial Intelligence, AAAI 2018
PublisherAAAI press
Pages5078-5085
Number of pages8
ISBN (Electronic)9781577358008
StatePublished - Jan 1 2018
Event32nd AAAI Conference on Artificial Intelligence, AAAI 2018 - New Orleans, United States
Duration: Feb 2 2018Feb 7 2018

Other

Other32nd AAAI Conference on Artificial Intelligence, AAAI 2018
CountryUnited States
CityNew Orleans
Period2/2/182/7/18

Fingerprint

Dynamic models
Sampling

ASJC Scopus subject areas

  • Artificial Intelligence

Cite this

Chen, X., Candan, K., & Sapino, M. L. (2018). IMS-DTM: Incremental multi-scale dynamic topic models . In 32nd AAAI Conference on Artificial Intelligence, AAAI 2018 (pp. 5078-5085). AAAI press.

IMS-DTM : Incremental multi-scale dynamic topic models . / Chen, Xilun; Candan, Kasim; Sapino, Maria Luisa.

32nd AAAI Conference on Artificial Intelligence, AAAI 2018. AAAI press, 2018. p. 5078-5085.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Chen, X, Candan, K & Sapino, ML 2018, IMS-DTM: Incremental multi-scale dynamic topic models . in 32nd AAAI Conference on Artificial Intelligence, AAAI 2018. AAAI press, pp. 5078-5085, 32nd AAAI Conference on Artificial Intelligence, AAAI 2018, New Orleans, United States, 2/2/18.
Chen X, Candan K, Sapino ML. IMS-DTM: Incremental multi-scale dynamic topic models . In 32nd AAAI Conference on Artificial Intelligence, AAAI 2018. AAAI press. 2018. p. 5078-5085
Chen, Xilun ; Candan, Kasim ; Sapino, Maria Luisa. / IMS-DTM : Incremental multi-scale dynamic topic models . 32nd AAAI Conference on Artificial Intelligence, AAAI 2018. AAAI press, 2018. pp. 5078-5085
@inproceedings{be940e72e3ed4563881e9a493ee83c82,
title = "IMS-DTM: Incremental multi-scale dynamic topic models ∗",
abstract = "Dynamic topic models (DTM) are commonly used for mining latent topics in evolving web corpora. In this paper, we note that a major limitation of the conventional DTM based models is that they assume a predetermined and fixed scale of topics. In reality, however, topics may have varying spans and topics of multiple scales can co-exist in a single web or social media data stream. Therefore, DTMs that assume a fixed epoch length may not be able to effectively capture latent topics and thus negatively affect accuracy. In this paper, we propose a Multi-Scale Dynamic Topic Model (MS-DTM) and a complementary Incremental Multi-Scale Dynamic Topic Model (IMS-DTM) inference method that can be used to capture latent topics and their dynamics simultaneously, at different scales. In this model, topic specific feature distributions are generated based on a multi-scale feature distribution of the previous epochs; moreover, multiple scales of the current epoch are analyzed together through a novel multi-scale incremental Gibbs sampling technique. We show that the proposed model significantly improves efficiency and effectiveness compared to the single scale dynamic DTMs and prior models that consider only multiple scales of the past.",
author = "Xilun Chen and Kasim Candan and Sapino, {Maria Luisa}",
year = "2018",
month = "1",
day = "1",
language = "English (US)",
pages = "5078--5085",
booktitle = "32nd AAAI Conference on Artificial Intelligence, AAAI 2018",
publisher = "AAAI press",

}

TY - GEN

T1 - IMS-DTM

T2 - Incremental multi-scale dynamic topic models ∗

AU - Chen, Xilun

AU - Candan, Kasim

AU - Sapino, Maria Luisa

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Dynamic topic models (DTM) are commonly used for mining latent topics in evolving web corpora. In this paper, we note that a major limitation of the conventional DTM based models is that they assume a predetermined and fixed scale of topics. In reality, however, topics may have varying spans and topics of multiple scales can co-exist in a single web or social media data stream. Therefore, DTMs that assume a fixed epoch length may not be able to effectively capture latent topics and thus negatively affect accuracy. In this paper, we propose a Multi-Scale Dynamic Topic Model (MS-DTM) and a complementary Incremental Multi-Scale Dynamic Topic Model (IMS-DTM) inference method that can be used to capture latent topics and their dynamics simultaneously, at different scales. In this model, topic specific feature distributions are generated based on a multi-scale feature distribution of the previous epochs; moreover, multiple scales of the current epoch are analyzed together through a novel multi-scale incremental Gibbs sampling technique. We show that the proposed model significantly improves efficiency and effectiveness compared to the single scale dynamic DTMs and prior models that consider only multiple scales of the past.

AB - Dynamic topic models (DTM) are commonly used for mining latent topics in evolving web corpora. In this paper, we note that a major limitation of the conventional DTM based models is that they assume a predetermined and fixed scale of topics. In reality, however, topics may have varying spans and topics of multiple scales can co-exist in a single web or social media data stream. Therefore, DTMs that assume a fixed epoch length may not be able to effectively capture latent topics and thus negatively affect accuracy. In this paper, we propose a Multi-Scale Dynamic Topic Model (MS-DTM) and a complementary Incremental Multi-Scale Dynamic Topic Model (IMS-DTM) inference method that can be used to capture latent topics and their dynamics simultaneously, at different scales. In this model, topic specific feature distributions are generated based on a multi-scale feature distribution of the previous epochs; moreover, multiple scales of the current epoch are analyzed together through a novel multi-scale incremental Gibbs sampling technique. We show that the proposed model significantly improves efficiency and effectiveness compared to the single scale dynamic DTMs and prior models that consider only multiple scales of the past.

UR - http://www.scopus.com/inward/record.url?scp=85060435965&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85060435965&partnerID=8YFLogxK

M3 - Conference contribution

SP - 5078

EP - 5085

BT - 32nd AAAI Conference on Artificial Intelligence, AAAI 2018

PB - AAAI press

ER -