Object discrimination using optimized multi-frequency auditory cross-modal haptic feedback

Alison Gibson, Panagiotis Artemiadis

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

As the field of brain-machine interfaces and neuro-prosthetics continues to grow, there is a high need for sensor and actuation mechanisms that can provide haptic feedback to the user. Current technologies employ expensive, invasive and often inefficient force feedback methods, resulting in an unrealistic solution for individuals who rely on these devices. This paper responds through the development, integration and analysis of a novel feedback architecture where haptic information during the neural control of a prosthetic hand is perceived through multi-frequency auditory signals. Through representing force magnitude with volume and force location with frequency, the feedback architecture can translate the haptic experiences of a robotic end effector into the alternative sensory modality of sound. Previous research with the proposed cross-modal feedback method confirmed its learnability, so the current work aimed to investigate which frequency map (i.e. frequency-specific locations on the hand) is optimal in helping users distinguish between hand-held objects and tasks associated with them. After short use with the cross-modal feedback during the electromyographic (EMG) control of a prosthetic hand, testing results show that users are able to use audial feedback alone to discriminate between everyday objects. While users showed adaptation to three different frequency maps, the simplest map containing only two frequencies was found to be the most useful in discriminating between objects. This outcome provides support for the feasibility and practicality of the cross-modal feedback method during the neural control of prosthetics.

Original languageEnglish (US)
Title of host publication2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2014
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages6505-6508
Number of pages4
ISBN (Print)9781424479290
DOIs
StatePublished - Nov 2 2014
Event2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2014 - Chicago, United States
Duration: Aug 26 2014Aug 30 2014

Other

Other2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2014
CountryUnited States
CityChicago
Period8/26/148/30/14

Fingerprint

Feedback
Prosthetics
Hand
Brain-Computer Interfaces
Robotics
End effectors
Brain
Acoustic waves
Technology
Equipment and Supplies
Sensors
Testing
Research

ASJC Scopus subject areas

  • Health Informatics
  • Computer Science Applications
  • Biomedical Engineering

Cite this

Gibson, A., & Artemiadis, P. (2014). Object discrimination using optimized multi-frequency auditory cross-modal haptic feedback. In 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2014 (pp. 6505-6508). [6945118] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/EMBC.2014.6945118

Object discrimination using optimized multi-frequency auditory cross-modal haptic feedback. / Gibson, Alison; Artemiadis, Panagiotis.

2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2014. Institute of Electrical and Electronics Engineers Inc., 2014. p. 6505-6508 6945118.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Gibson, A & Artemiadis, P 2014, Object discrimination using optimized multi-frequency auditory cross-modal haptic feedback. in 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2014., 6945118, Institute of Electrical and Electronics Engineers Inc., pp. 6505-6508, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2014, Chicago, United States, 8/26/14. https://doi.org/10.1109/EMBC.2014.6945118
Gibson A, Artemiadis P. Object discrimination using optimized multi-frequency auditory cross-modal haptic feedback. In 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2014. Institute of Electrical and Electronics Engineers Inc. 2014. p. 6505-6508. 6945118 https://doi.org/10.1109/EMBC.2014.6945118
Gibson, Alison ; Artemiadis, Panagiotis. / Object discrimination using optimized multi-frequency auditory cross-modal haptic feedback. 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2014. Institute of Electrical and Electronics Engineers Inc., 2014. pp. 6505-6508
@inproceedings{862acb8edb234246a9264b84aa3c4800,
title = "Object discrimination using optimized multi-frequency auditory cross-modal haptic feedback",
abstract = "As the field of brain-machine interfaces and neuro-prosthetics continues to grow, there is a high need for sensor and actuation mechanisms that can provide haptic feedback to the user. Current technologies employ expensive, invasive and often inefficient force feedback methods, resulting in an unrealistic solution for individuals who rely on these devices. This paper responds through the development, integration and analysis of a novel feedback architecture where haptic information during the neural control of a prosthetic hand is perceived through multi-frequency auditory signals. Through representing force magnitude with volume and force location with frequency, the feedback architecture can translate the haptic experiences of a robotic end effector into the alternative sensory modality of sound. Previous research with the proposed cross-modal feedback method confirmed its learnability, so the current work aimed to investigate which frequency map (i.e. frequency-specific locations on the hand) is optimal in helping users distinguish between hand-held objects and tasks associated with them. After short use with the cross-modal feedback during the electromyographic (EMG) control of a prosthetic hand, testing results show that users are able to use audial feedback alone to discriminate between everyday objects. While users showed adaptation to three different frequency maps, the simplest map containing only two frequencies was found to be the most useful in discriminating between objects. This outcome provides support for the feasibility and practicality of the cross-modal feedback method during the neural control of prosthetics.",
author = "Alison Gibson and Panagiotis Artemiadis",
year = "2014",
month = "11",
day = "2",
doi = "10.1109/EMBC.2014.6945118",
language = "English (US)",
isbn = "9781424479290",
pages = "6505--6508",
booktitle = "2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2014",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Object discrimination using optimized multi-frequency auditory cross-modal haptic feedback

AU - Gibson, Alison

AU - Artemiadis, Panagiotis

PY - 2014/11/2

Y1 - 2014/11/2

N2 - As the field of brain-machine interfaces and neuro-prosthetics continues to grow, there is a high need for sensor and actuation mechanisms that can provide haptic feedback to the user. Current technologies employ expensive, invasive and often inefficient force feedback methods, resulting in an unrealistic solution for individuals who rely on these devices. This paper responds through the development, integration and analysis of a novel feedback architecture where haptic information during the neural control of a prosthetic hand is perceived through multi-frequency auditory signals. Through representing force magnitude with volume and force location with frequency, the feedback architecture can translate the haptic experiences of a robotic end effector into the alternative sensory modality of sound. Previous research with the proposed cross-modal feedback method confirmed its learnability, so the current work aimed to investigate which frequency map (i.e. frequency-specific locations on the hand) is optimal in helping users distinguish between hand-held objects and tasks associated with them. After short use with the cross-modal feedback during the electromyographic (EMG) control of a prosthetic hand, testing results show that users are able to use audial feedback alone to discriminate between everyday objects. While users showed adaptation to three different frequency maps, the simplest map containing only two frequencies was found to be the most useful in discriminating between objects. This outcome provides support for the feasibility and practicality of the cross-modal feedback method during the neural control of prosthetics.

AB - As the field of brain-machine interfaces and neuro-prosthetics continues to grow, there is a high need for sensor and actuation mechanisms that can provide haptic feedback to the user. Current technologies employ expensive, invasive and often inefficient force feedback methods, resulting in an unrealistic solution for individuals who rely on these devices. This paper responds through the development, integration and analysis of a novel feedback architecture where haptic information during the neural control of a prosthetic hand is perceived through multi-frequency auditory signals. Through representing force magnitude with volume and force location with frequency, the feedback architecture can translate the haptic experiences of a robotic end effector into the alternative sensory modality of sound. Previous research with the proposed cross-modal feedback method confirmed its learnability, so the current work aimed to investigate which frequency map (i.e. frequency-specific locations on the hand) is optimal in helping users distinguish between hand-held objects and tasks associated with them. After short use with the cross-modal feedback during the electromyographic (EMG) control of a prosthetic hand, testing results show that users are able to use audial feedback alone to discriminate between everyday objects. While users showed adaptation to three different frequency maps, the simplest map containing only two frequencies was found to be the most useful in discriminating between objects. This outcome provides support for the feasibility and practicality of the cross-modal feedback method during the neural control of prosthetics.

UR - http://www.scopus.com/inward/record.url?scp=84929485594&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84929485594&partnerID=8YFLogxK

U2 - 10.1109/EMBC.2014.6945118

DO - 10.1109/EMBC.2014.6945118

M3 - Conference contribution

C2 - 25571486

AN - SCOPUS:84929485594

SN - 9781424479290

SP - 6505

EP - 6508

BT - 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2014

PB - Institute of Electrical and Electronics Engineers Inc.

ER -