Simulating expert clinical comprehension: Adapting latent semantic analysis to accurately extract clinical concepts from psychiatric narrative

Trevor Cohen, Brett Blatter, Vimla Patel

Research output: Contribution to journalArticlepeer-review

22 Scopus citations

Abstract

Cognitive studies reveal that less-than-expert clinicians are less able to recognize meaningful patterns of data in clinical narratives. Accordingly, psychiatric residents early in training fail to attend to information that is relevant to diagnosis and the assessment of dangerousness. This manuscript presents cognitively motivated methodology for the simulation of expert ability to organize relevant findings supporting intermediate diagnostic hypotheses. Latent Semantic Analysis is used to generate a semantic space from which meaningful associations between psychiatric terms are derived. Diagnostically meaningful clusters are modeled as geometric structures within this space and compared to elements of psychiatric narrative text using semantic distance measures. A learning algorithm is defined that alters components of these geometric structures in response to labeled training data. Extraction and classification of relevant text segments is evaluated against expert annotation, with system-rater agreement approximating rater-rater agreement. A range of biomedical informatics applications for these methods are suggested.

Original languageEnglish (US)
Pages (from-to)1070-1087
Number of pages18
JournalJournal of Biomedical Informatics
Volume41
Issue number6
DOIs
StatePublished - Dec 2008

Keywords

  • Cognition
  • Conceptual spaces
  • Expertise
  • Information extraction
  • Latent semantic analysis
  • Natural language processing
  • Text comprehension

ASJC Scopus subject areas

  • Computer Science Applications
  • Health Informatics

Fingerprint Dive into the research topics of 'Simulating expert clinical comprehension: Adapting latent semantic analysis to accurately extract clinical concepts from psychiatric narrative'. Together they form a unique fingerprint.

Cite this