Textual signatures: Identifying text-types using latent semantic analysis to measure the cohesion of text structures

Philip M. McCarthy, Stephen W. Briner, Vasile Rus, Danielle S. McNamara

Research output: Chapter in Book/Report/Conference proceedingChapter

21 Scopus citations

Abstract

Just as a sentence is far more than a mere concatenation of words, a text is far more than a mere concatenation of sentences. Texts contain pertinent information that co-refers across sentences and paragraphs [30]; texts contain relations between phrases, clauses, and sentences that are often causally linked [21], [51], [56]; and texts that depend on relating a series of chronological events contain temporal features that help the reader to build a coherent representation of the text [19], [55]. We refer to textual features such as these as cohesive elements, and they occur within paragraphs (locally), across paragraphs (globally), and in forms such as referential, causal, temporal, and structural [18], [22], [36]. But cohesive elements, and by consequence cohesion, does not simply feature in a text as dialogues tend to feature in narratives, or as cartoons tend to feature in newspapers. That is, cohesion is not present or absent in a binary or optional sense. Instead, cohesion in text exists on a continuum of presence, which is sometimes indicative of the text-type in question [12], [37], [41] and sometimes indicative of the audience for which the text was written [44], [47]. In this chapter, we discuss the nature and importance of cohesion; we demonstrate a computational tool that measures cohesion; and, most importantly, we demonstrate a novel approach to identifying text-types by incorporating contrasting rates of cohesion.

Original languageEnglish (US)
Title of host publicationNatural Language Processing and Text Mining
PublisherSpringer London
Pages107-122
Number of pages16
ISBN (Print)184628175X, 9781846281754
DOIs
StatePublished - Dec 1 2007
Externally publishedYes

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

McCarthy, P. M., Briner, S. W., Rus, V., & McNamara, D. S. (2007). Textual signatures: Identifying text-types using latent semantic analysis to measure the cohesion of text structures. In Natural Language Processing and Text Mining (pp. 107-122). Springer London. https://doi.org/10.1007/978-1-84628-754-1_7