Object discrimination using optimized multi-frequency auditory cross-modal haptic feedback

Alison Gibson, Panagiotis Artemiadis

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

As the field of brain-machine interfaces and neuro-prosthetics continues to grow, there is a high need for sensor and actuation mechanisms that can provide haptic feedback to the user. Current technologies employ expensive, invasive and often inefficient force feedback methods, resulting in an unrealistic solution for individuals who rely on these devices. This paper responds through the development, integration and analysis of a novel feedback architecture where haptic information during the neural control of a prosthetic hand is perceived through multi-frequency auditory signals. Through representing force magnitude with volume and force location with frequency, the feedback architecture can translate the haptic experiences of a robotic end effector into the alternative sensory modality of sound. Previous research with the proposed cross-modal feedback method confirmed its learnability, so the current work aimed to investigate which frequency map (i.e. frequency-specific locations on the hand) is optimal in helping users distinguish between hand-held objects and tasks associated with them. After short use with the cross-modal feedback during the electromyographic (EMG) control of a prosthetic hand, testing results show that users are able to use audial feedback alone to discriminate between everyday objects. While users showed adaptation to three different frequency maps, the simplest map containing only two frequencies was found to be the most useful in discriminating between objects. This outcome provides support for the feasibility and practicality of the cross-modal feedback method during the neural control of prosthetics.

Original languageEnglish (US)
Title of host publication2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2014
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages6505-6508
Number of pages4
ISBN (Print)9781424479290
DOIs
StatePublished - Nov 2 2014
Event2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2014 - Chicago, United States
Duration: Aug 26 2014Aug 30 2014

Other

Other2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2014
CountryUnited States
CityChicago
Period8/26/148/30/14

ASJC Scopus subject areas

  • Health Informatics
  • Computer Science Applications
  • Biomedical Engineering

Fingerprint Dive into the research topics of 'Object discrimination using optimized multi-frequency auditory cross-modal haptic feedback'. Together they form a unique fingerprint.

  • Cite this

    Gibson, A., & Artemiadis, P. (2014). Object discrimination using optimized multi-frequency auditory cross-modal haptic feedback. In 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2014 (pp. 6505-6508). [6945118] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/EMBC.2014.6945118