Integrating non-invasive neuroimaging and computer log data to improve understanding of cognitive processes

Leah Friedman, Erin Walker, Ruixue Liu, Erin T. Solovey

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

As non-invasive neuroimaging techniques become less expensive and more portable, we have the capability to monitor brain activity during various computer activities. This provides an opportunity to integrate brain data with computer log data to develop models of cognitive processes. These models can be used to continually assess an individual’s changing cognitive state and develop adaptive human-computer interfaces. As a step in this direction, we have conducted a study using functional near-infrared spectroscopy (fNIRS) during the Sustained Attention to Response Task (SART) paradigm, which has been used in prior work to elicit mind wandering and to explore response inhibition. The goal with this is to determine whether fNIRS data can be used as a predictor of errors on the task. This would have implications for detecting similar cognitive processes in more realistic tasks, such as using a personal learning environment. Additionally, this study aims to test individual differences by correlating objective behavioral data and subjective self reports with activity in the medial prefrontal cortex (mPFC), associated with the brain’s default mode network (DMN). We observed significant differences in the mPFC between periods prior to task error and periods prior to a correct response. These differences were particularly apparent amongst those individuals who performed poorly on the SART task and those who reported drowsiness. In line with previous work, these findings indicate an opportunity to detect and correct attentional shifts in individuals who need it most.

Original languageEnglish (US)
Title of host publicationProceedings of the Workshop on Modeling Cognitive Processes from Multimodal Data, MCPMD 2018
PublisherAssociation for Computing Machinery, Inc
ISBN (Electronic)9781450360722
DOIs
StatePublished - Oct 16 2018
Event2018 Workshop on Modeling Cognitive Processes from Multimodal Data, MCPMD 2018 - Boulder, United States
Duration: Oct 16 2018 → …

Publication series

NameProceedings of the Workshop on Modeling Cognitive Processes from Multimodal Data, MCPMD 2018

Conference

Conference2018 Workshop on Modeling Cognitive Processes from Multimodal Data, MCPMD 2018
CountryUnited States
CityBoulder
Period10/16/18 → …

Keywords

  • FNIRS
  • Functional near-infrared spectroscopy
  • SART

ASJC Scopus subject areas

  • Modeling and Simulation

Fingerprint Dive into the research topics of 'Integrating non-invasive neuroimaging and computer log data to improve understanding of cognitive processes'. Together they form a unique fingerprint.

  • Cite this

    Friedman, L., Walker, E., Liu, R., & Solovey, E. T. (2018). Integrating non-invasive neuroimaging and computer log data to improve understanding of cognitive processes. In Proceedings of the Workshop on Modeling Cognitive Processes from Multimodal Data, MCPMD 2018 (Proceedings of the Workshop on Modeling Cognitive Processes from Multimodal Data, MCPMD 2018). Association for Computing Machinery, Inc. https://doi.org/10.1145/3279810.3279854