Virtual Reality Platform for Systematic Investigation of Multisensory Integration and Training of Closed-Loop Prosthetic Control

Kris Phataraphruk, Paul Vangilder, Christopher A. Buneo

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Multisensory integration is the process by which information from different sensory modalities is integrated by the nervous system. Understanding this process is important not only from a basic science perspective but also for translational reasons, e.g. for the development of closed-loop neural prosthetic systems. Here we describe a versatile virtual reality platform which can be used to study the neural mechanisms of multisensory integration for the upper limb and could potentially be incorporated into systems for training of robust neural prosthetic control. The platform involves the interaction of multiple computers and programs and allows for selection of different avatar arms and for modification of a selected arm's visual properties. The system was tested with two non-human primates (NHP) that were trained to reach to multiple targets on a tabletop. Reliability of arm visual feedback was altered by applying different levels of blurring to the arm. In addition, tactile feedback was altered by adding or removing physical targets from the environment. We observed differences in movement endpoint distributions that varied between animals and visual feedback conditions, as well as across targets. The results indicate that the system can be used to study multisensory integration in a well-controlled manner.

Original languageEnglish (US)
Title of host publication42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society
Subtitle of host publicationEnabling Innovative Technologies for Global Healthcare, EMBC 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages2942-2945
Number of pages4
ISBN (Electronic)9781728119908
DOIs
StatePublished - Jul 2020
Externally publishedYes
Event42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society, EMBC 2020 - Montreal, Canada
Duration: Jul 20 2020Jul 24 2020

Publication series

NameProceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
Volume2020-July
ISSN (Print)1557-170X

Conference

Conference42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society, EMBC 2020
CountryCanada
CityMontreal
Period7/20/207/24/20

ASJC Scopus subject areas

  • Signal Processing
  • Biomedical Engineering
  • Computer Vision and Pattern Recognition
  • Health Informatics

Fingerprint Dive into the research topics of 'Virtual Reality Platform for Systematic Investigation of Multisensory Integration and Training of Closed-Loop Prosthetic Control'. Together they form a unique fingerprint.

Cite this