The design of a real-time, multimodal biofeedback system for stroke patient rehabilitation

Yinpeng Chen, He Huang, Weiwei Xu, Richard Isaac Wallis, Hari Sundaram, Thanassis Rikakis, Todd Ingalls, Loren Olson, Jiping He

Research output: Chapter in Book/Report/Conference proceedingConference contribution

31 Scopus citations

Abstract

This paper presents a novel real-time, multi-modal biofeedback system for stroke patient therapy. The problem is important as traditional mechanisms of rehabilitation are monotonous, and do not incorporate detailed quantitative assessment of recovery in addition to traditional clinical schemes. We have been working on developing an experiential media system that integrates task dependent physical therapy and cognitive stimuli within an interactive, multimodal environment. The environment provides a purposeful, engaging, visual and auditory scene in which patients can practice functional therapeutic reaching tasks, while receiving different types of simultaneous feedback indicating measures of both performance and results. There are three contributions of this paper - (a) identification of features and goals for the functional task (b) The development of sophisticated feedback (auditory and visual) mechanisms that match the semantics of action of the task. We additionally develop novel action-feedback coupling mechanisms. (c) New metrics to validate the ability of the system to promote learnability, stylization and engagement. We have validated the system for nine subjects with excellent results.

Original languageEnglish (US)
Title of host publicationProceedings of the 14th Annual ACM International Conference on Multimedia, MM 2006
Pages763-772
Number of pages10
DOIs
StatePublished - Dec 1 2006
Event14th Annual ACM International Conference on Multimedia, MM 2006 - Santa Barbara, CA, United States
Duration: Oct 23 2006Oct 27 2006

Publication series

NameProceedings of the 14th Annual ACM International Conference on Multimedia, MM 2006

Other

Other14th Annual ACM International Conference on Multimedia, MM 2006
CountryUnited States
CitySanta Barbara, CA
Period10/23/0610/27/06

Keywords

  • Action-feedback coupling
  • Analysis
  • Biofeedback
  • Validation

ASJC Scopus subject areas

  • Computer Science(all)
  • Media Technology

Fingerprint Dive into the research topics of 'The design of a real-time, multimodal biofeedback system for stroke patient rehabilitation'. Together they form a unique fingerprint.

  • Cite this

    Chen, Y., Huang, H., Xu, W., Wallis, R. I., Sundaram, H., Rikakis, T., Ingalls, T., Olson, L., & He, J. (2006). The design of a real-time, multimodal biofeedback system for stroke patient rehabilitation. In Proceedings of the 14th Annual ACM International Conference on Multimedia, MM 2006 (pp. 763-772). (Proceedings of the 14th Annual ACM International Conference on Multimedia, MM 2006). https://doi.org/10.1145/1180639.1180804