Neural closed-loop control of a hand prosthesis using cross-modal haptic feedback

Alison Gibson, Panagiotis Artemiadis

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

Due to the growing field of neuro-prosthetics and other brain-machine interfaces that employ human-like control schemes, it has become a priority to design sensor and actuation mechanisms that relay tactile information to the user. Unfortunately, most state of the art technology uses feedback techniques that are invasive, costly or inefficient for the general population. This paper proposes a feasible feedback method where tactile information during dexterous manipulation is perceived through multi-frequency auditory signals. In the interest of examining whether users are able to quickly learn and adapt to the audio-Tactile relationship and apply it to the neural control of a robot, an experimental protocol was formed. Users were instructed to grasp several objects of varying stiffness and weight using an electromyographically-controlled robotic hand, and tactile information was provided to them in real-Time through the proposed cross-modal feedback. Results show that users were able to adapt and learn the feedback technology after short use, and could eventually use auditory information alone to control the grasping forces of a robotic hand. This outcome suggests that the proposed feedback method could be a viable alternative for obtaining tactile feedback while staying non-invasive and practical to the user, with applications ranging from neuro-prosthetics to control interfaces for remotely operated devices.

Original languageEnglish (US)
Title of host publicationIEEE International Conference on Rehabilitation Robotics
PublisherIEEE Computer Society
Pages37-42
Number of pages6
Volume2015-September
ISBN (Print)9781479918072
DOIs
StatePublished - Sep 28 2015
Event14th IEEE/RAS-EMBS International Conference on Rehabilitation Robotics, ICORR 2015 - Singapore, Singapore
Duration: Aug 11 2015Aug 14 2015

Other

Other14th IEEE/RAS-EMBS International Conference on Rehabilitation Robotics, ICORR 2015
CountrySingapore
CitySingapore
Period8/11/158/14/15

Fingerprint

Touch
Prostheses and Implants
Hand
Feedback
Robotics
End effectors
Prosthetics
Technology
Brain-Computer Interfaces
Brain
Stiffness
Robots
Weights and Measures
Equipment and Supplies
Sensors
Population

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Electrical and Electronic Engineering
  • Rehabilitation

Cite this

Gibson, A., & Artemiadis, P. (2015). Neural closed-loop control of a hand prosthesis using cross-modal haptic feedback. In IEEE International Conference on Rehabilitation Robotics (Vol. 2015-September, pp. 37-42). [7281172] IEEE Computer Society. https://doi.org/10.1109/ICORR.2015.7281172

Neural closed-loop control of a hand prosthesis using cross-modal haptic feedback. / Gibson, Alison; Artemiadis, Panagiotis.

IEEE International Conference on Rehabilitation Robotics. Vol. 2015-September IEEE Computer Society, 2015. p. 37-42 7281172.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Gibson, A & Artemiadis, P 2015, Neural closed-loop control of a hand prosthesis using cross-modal haptic feedback. in IEEE International Conference on Rehabilitation Robotics. vol. 2015-September, 7281172, IEEE Computer Society, pp. 37-42, 14th IEEE/RAS-EMBS International Conference on Rehabilitation Robotics, ICORR 2015, Singapore, Singapore, 8/11/15. https://doi.org/10.1109/ICORR.2015.7281172
Gibson A, Artemiadis P. Neural closed-loop control of a hand prosthesis using cross-modal haptic feedback. In IEEE International Conference on Rehabilitation Robotics. Vol. 2015-September. IEEE Computer Society. 2015. p. 37-42. 7281172 https://doi.org/10.1109/ICORR.2015.7281172
Gibson, Alison ; Artemiadis, Panagiotis. / Neural closed-loop control of a hand prosthesis using cross-modal haptic feedback. IEEE International Conference on Rehabilitation Robotics. Vol. 2015-September IEEE Computer Society, 2015. pp. 37-42
@inproceedings{5d3b22f51acd4ccb80465789785320e1,
title = "Neural closed-loop control of a hand prosthesis using cross-modal haptic feedback",
abstract = "Due to the growing field of neuro-prosthetics and other brain-machine interfaces that employ human-like control schemes, it has become a priority to design sensor and actuation mechanisms that relay tactile information to the user. Unfortunately, most state of the art technology uses feedback techniques that are invasive, costly or inefficient for the general population. This paper proposes a feasible feedback method where tactile information during dexterous manipulation is perceived through multi-frequency auditory signals. In the interest of examining whether users are able to quickly learn and adapt to the audio-Tactile relationship and apply it to the neural control of a robot, an experimental protocol was formed. Users were instructed to grasp several objects of varying stiffness and weight using an electromyographically-controlled robotic hand, and tactile information was provided to them in real-Time through the proposed cross-modal feedback. Results show that users were able to adapt and learn the feedback technology after short use, and could eventually use auditory information alone to control the grasping forces of a robotic hand. This outcome suggests that the proposed feedback method could be a viable alternative for obtaining tactile feedback while staying non-invasive and practical to the user, with applications ranging from neuro-prosthetics to control interfaces for remotely operated devices.",
author = "Alison Gibson and Panagiotis Artemiadis",
year = "2015",
month = "9",
day = "28",
doi = "10.1109/ICORR.2015.7281172",
language = "English (US)",
isbn = "9781479918072",
volume = "2015-September",
pages = "37--42",
booktitle = "IEEE International Conference on Rehabilitation Robotics",
publisher = "IEEE Computer Society",

}

TY - GEN

T1 - Neural closed-loop control of a hand prosthesis using cross-modal haptic feedback

AU - Gibson, Alison

AU - Artemiadis, Panagiotis

PY - 2015/9/28

Y1 - 2015/9/28

N2 - Due to the growing field of neuro-prosthetics and other brain-machine interfaces that employ human-like control schemes, it has become a priority to design sensor and actuation mechanisms that relay tactile information to the user. Unfortunately, most state of the art technology uses feedback techniques that are invasive, costly or inefficient for the general population. This paper proposes a feasible feedback method where tactile information during dexterous manipulation is perceived through multi-frequency auditory signals. In the interest of examining whether users are able to quickly learn and adapt to the audio-Tactile relationship and apply it to the neural control of a robot, an experimental protocol was formed. Users were instructed to grasp several objects of varying stiffness and weight using an electromyographically-controlled robotic hand, and tactile information was provided to them in real-Time through the proposed cross-modal feedback. Results show that users were able to adapt and learn the feedback technology after short use, and could eventually use auditory information alone to control the grasping forces of a robotic hand. This outcome suggests that the proposed feedback method could be a viable alternative for obtaining tactile feedback while staying non-invasive and practical to the user, with applications ranging from neuro-prosthetics to control interfaces for remotely operated devices.

AB - Due to the growing field of neuro-prosthetics and other brain-machine interfaces that employ human-like control schemes, it has become a priority to design sensor and actuation mechanisms that relay tactile information to the user. Unfortunately, most state of the art technology uses feedback techniques that are invasive, costly or inefficient for the general population. This paper proposes a feasible feedback method where tactile information during dexterous manipulation is perceived through multi-frequency auditory signals. In the interest of examining whether users are able to quickly learn and adapt to the audio-Tactile relationship and apply it to the neural control of a robot, an experimental protocol was formed. Users were instructed to grasp several objects of varying stiffness and weight using an electromyographically-controlled robotic hand, and tactile information was provided to them in real-Time through the proposed cross-modal feedback. Results show that users were able to adapt and learn the feedback technology after short use, and could eventually use auditory information alone to control the grasping forces of a robotic hand. This outcome suggests that the proposed feedback method could be a viable alternative for obtaining tactile feedback while staying non-invasive and practical to the user, with applications ranging from neuro-prosthetics to control interfaces for remotely operated devices.

UR - http://www.scopus.com/inward/record.url?scp=84946058325&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84946058325&partnerID=8YFLogxK

U2 - 10.1109/ICORR.2015.7281172

DO - 10.1109/ICORR.2015.7281172

M3 - Conference contribution

AN - SCOPUS:84946058325

SN - 9781479918072

VL - 2015-September

SP - 37

EP - 42

BT - IEEE International Conference on Rehabilitation Robotics

PB - IEEE Computer Society

ER -