A Rhythm-Based Serious Game for Fine Motor Rehabilitation Using Leap Motion

Vatsal Shah, Miguel Cuen, Troy McDaniel, Ramin Tadayon

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a system to deliver automated and noninvasive fine motor rehabilitation through a rhythm-based game using a Leap Motion Controller. The platform is a rhythm game wherein hand gestures are used as input and must match the rhythm and gestures shown on screen, thus allowing a physical therapist to represent an exercise session as a series of patterns involving the user's hand and finger joints. Fine motor rehabilitation plays an important role in the recovery and improvement of the effects of diseases and conditions such as stroke, Parkinson's disease, multiple sclerosis, among many others. Individuals with these conditions possess a wide range of impairments such as fine motor movement. The proposed serious game is adaptive to the player to enable access to patients across a wide range of ability. In two pilot studies in collaboration with the South West Advanced Neurological Rehabilitation (SWAN Rehab) in Phoenix, Arizona, we compared the performance of individuals with fine motor impairment to individuals without impairment to determine the accessibility of the proposed serious game, i.e., to assess whether the platform is adaptive to a user's range of motion to allow an individual with fine motor impairment to perform at a similar level as a non-impaired user. We also separately evaluated the adaptive calibration algorithm to understand its impact on an individual's performance.

Original languageEnglish (US)
Title of host publication2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages737-742
Number of pages6
ISBN (Electronic)9784907764678
DOIs
StatePublished - Sep 2019
Externally publishedYes
Event58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019 - Hiroshima, Japan
Duration: Sep 10 2019Sep 13 2019

Publication series

Name2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019

Conference

Conference58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019
CountryJapan
CityHiroshima
Period9/10/199/13/19

Fingerprint

Serious Games
rhythm
Rehabilitation
games
Patient rehabilitation
impairment
Motion
Gesture
platforms
Range of data
Parkinson disease
Game
Multiple Sclerosis
Phoenix (AZ)
Parkinson's Disease
physical exercise
strokes
Stroke
Accessibility
Exercise

Keywords

  • Leap Motion
  • Rehabilitation
  • Serious Games

ASJC Scopus subject areas

  • Artificial Intelligence
  • Industrial and Manufacturing Engineering
  • Safety, Risk, Reliability and Quality
  • Control and Optimization
  • Instrumentation

Cite this

Shah, V., Cuen, M., McDaniel, T., & Tadayon, R. (2019). A Rhythm-Based Serious Game for Fine Motor Rehabilitation Using Leap Motion. In 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019 (pp. 737-742). [8859927] (2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.23919/SICE.2019.8859927

A Rhythm-Based Serious Game for Fine Motor Rehabilitation Using Leap Motion. / Shah, Vatsal; Cuen, Miguel; McDaniel, Troy; Tadayon, Ramin.

2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019. Institute of Electrical and Electronics Engineers Inc., 2019. p. 737-742 8859927 (2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Shah, V, Cuen, M, McDaniel, T & Tadayon, R 2019, A Rhythm-Based Serious Game for Fine Motor Rehabilitation Using Leap Motion. in 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019., 8859927, 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019, Institute of Electrical and Electronics Engineers Inc., pp. 737-742, 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019, Hiroshima, Japan, 9/10/19. https://doi.org/10.23919/SICE.2019.8859927
Shah V, Cuen M, McDaniel T, Tadayon R. A Rhythm-Based Serious Game for Fine Motor Rehabilitation Using Leap Motion. In 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019. Institute of Electrical and Electronics Engineers Inc. 2019. p. 737-742. 8859927. (2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019). https://doi.org/10.23919/SICE.2019.8859927
Shah, Vatsal ; Cuen, Miguel ; McDaniel, Troy ; Tadayon, Ramin. / A Rhythm-Based Serious Game for Fine Motor Rehabilitation Using Leap Motion. 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 737-742 (2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019).
@inproceedings{bd58dc10adc643db80c6fa6b2491e254,
title = "A Rhythm-Based Serious Game for Fine Motor Rehabilitation Using Leap Motion",
abstract = "This paper presents a system to deliver automated and noninvasive fine motor rehabilitation through a rhythm-based game using a Leap Motion Controller. The platform is a rhythm game wherein hand gestures are used as input and must match the rhythm and gestures shown on screen, thus allowing a physical therapist to represent an exercise session as a series of patterns involving the user's hand and finger joints. Fine motor rehabilitation plays an important role in the recovery and improvement of the effects of diseases and conditions such as stroke, Parkinson's disease, multiple sclerosis, among many others. Individuals with these conditions possess a wide range of impairments such as fine motor movement. The proposed serious game is adaptive to the player to enable access to patients across a wide range of ability. In two pilot studies in collaboration with the South West Advanced Neurological Rehabilitation (SWAN Rehab) in Phoenix, Arizona, we compared the performance of individuals with fine motor impairment to individuals without impairment to determine the accessibility of the proposed serious game, i.e., to assess whether the platform is adaptive to a user's range of motion to allow an individual with fine motor impairment to perform at a similar level as a non-impaired user. We also separately evaluated the adaptive calibration algorithm to understand its impact on an individual's performance.",
keywords = "Leap Motion, Rehabilitation, Serious Games",
author = "Vatsal Shah and Miguel Cuen and Troy McDaniel and Ramin Tadayon",
year = "2019",
month = "9",
doi = "10.23919/SICE.2019.8859927",
language = "English (US)",
series = "2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "737--742",
booktitle = "2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019",

}

TY - GEN

T1 - A Rhythm-Based Serious Game for Fine Motor Rehabilitation Using Leap Motion

AU - Shah, Vatsal

AU - Cuen, Miguel

AU - McDaniel, Troy

AU - Tadayon, Ramin

PY - 2019/9

Y1 - 2019/9

N2 - This paper presents a system to deliver automated and noninvasive fine motor rehabilitation through a rhythm-based game using a Leap Motion Controller. The platform is a rhythm game wherein hand gestures are used as input and must match the rhythm and gestures shown on screen, thus allowing a physical therapist to represent an exercise session as a series of patterns involving the user's hand and finger joints. Fine motor rehabilitation plays an important role in the recovery and improvement of the effects of diseases and conditions such as stroke, Parkinson's disease, multiple sclerosis, among many others. Individuals with these conditions possess a wide range of impairments such as fine motor movement. The proposed serious game is adaptive to the player to enable access to patients across a wide range of ability. In two pilot studies in collaboration with the South West Advanced Neurological Rehabilitation (SWAN Rehab) in Phoenix, Arizona, we compared the performance of individuals with fine motor impairment to individuals without impairment to determine the accessibility of the proposed serious game, i.e., to assess whether the platform is adaptive to a user's range of motion to allow an individual with fine motor impairment to perform at a similar level as a non-impaired user. We also separately evaluated the adaptive calibration algorithm to understand its impact on an individual's performance.

AB - This paper presents a system to deliver automated and noninvasive fine motor rehabilitation through a rhythm-based game using a Leap Motion Controller. The platform is a rhythm game wherein hand gestures are used as input and must match the rhythm and gestures shown on screen, thus allowing a physical therapist to represent an exercise session as a series of patterns involving the user's hand and finger joints. Fine motor rehabilitation plays an important role in the recovery and improvement of the effects of diseases and conditions such as stroke, Parkinson's disease, multiple sclerosis, among many others. Individuals with these conditions possess a wide range of impairments such as fine motor movement. The proposed serious game is adaptive to the player to enable access to patients across a wide range of ability. In two pilot studies in collaboration with the South West Advanced Neurological Rehabilitation (SWAN Rehab) in Phoenix, Arizona, we compared the performance of individuals with fine motor impairment to individuals without impairment to determine the accessibility of the proposed serious game, i.e., to assess whether the platform is adaptive to a user's range of motion to allow an individual with fine motor impairment to perform at a similar level as a non-impaired user. We also separately evaluated the adaptive calibration algorithm to understand its impact on an individual's performance.

KW - Leap Motion

KW - Rehabilitation

KW - Serious Games

UR - http://www.scopus.com/inward/record.url?scp=85073872578&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85073872578&partnerID=8YFLogxK

U2 - 10.23919/SICE.2019.8859927

DO - 10.23919/SICE.2019.8859927

M3 - Conference contribution

AN - SCOPUS:85073872578

T3 - 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019

SP - 737

EP - 742

BT - 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019

PB - Institute of Electrical and Electronics Engineers Inc.

ER -