Newness and givenness of information: Automated identification in written discourse

Philip M. McCarthy, David Dufty, Christian F. Hempelmann, Zhiqiang Cai, Danielle McNamara, Arthur C. Graesser

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

The identification of new versus given information within a text has been frequently investigated by researchers of language and discourse. Despite theoretical advances, an accurate computational method for assessing the degree to which a text contains new versus given information has not previously been implemented. This study discusses a variety of computational new/given systems and analyzes four typical expository and narrative texts against a widely accepted theory of new/given proposed by Prince (1981). Findings suggest that a latent semantic analysis (LSA) based measure called span outperforms standard LSA in detecting both new and given information in text. Further, the span measure outperforms standard LSA for distinguishing low versus high cohesion versions of text. Results suggest that span may be a useful variable in a wide array of discourse analyses.

Original languageEnglish (US)
Title of host publicationCross-Disciplinary Advances in Applied Natural Language Processing
Subtitle of host publicationIssues and Approaches
PublisherIGI Global
Pages202-224
Number of pages23
ISBN (Print)9781613504475
DOIs
StatePublished - Dec 1 2011
Externally publishedYes

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

McCarthy, P. M., Dufty, D., Hempelmann, C. F., Cai, Z., McNamara, D., & Graesser, A. C. (2011). Newness and givenness of information: Automated identification in written discourse. In Cross-Disciplinary Advances in Applied Natural Language Processing: Issues and Approaches (pp. 202-224). IGI Global. https://doi.org/10.4018/978-1-61350-447-5.ch014