SCEPTRE: A pervasive, non-invasive, and programmable gesture recognition technology

Prajwal Paudyal, Ayan Banerjee, Sandeep Gupta

Research output: Chapter in Book/Report/Conference proceedingConference contribution

26 Scopus citations

Abstract

Communication and collaboration between deaf people and hearing people is hindered by lack of a common language. Although there has been a lot of research in this domain, there is room for work towards a system that is ubiquitous, non-invasive, works in real-time and can be trained interactively by the user. Such a system will be powerful enough to translate gestures performed in real-time, while also being flexible enough to be fully personalized to be used as a platform for gesture based HCI. We propose SCEPTRE which utilizes two non-invasive wrist-worn devices to decipher gesture-based communication. The system uses a multitiered template based comparison system for classification on input data from accelerometer, gyroscope and electromyography (EMG) sensors. This work demonstrates that the system is very easily trained using just one to three training instances each for twenty randomly chosen signs from the American Sign Language(ASL) dictionary and also for user-generated custom gestures. The system is able to achieve an accuracy of 97.72 % for ASL gestures.

Original languageEnglish (US)
Title of host publicationInternational Conference on Intelligent User Interfaces, Proceedings IUI
PublisherAssociation for Computing Machinery
Pages282-293
Number of pages12
Volume07-10-March-2016
ISBN (Print)9781450341370, 9781450341400
DOIs
StatePublished - Mar 7 2016
Event21st International Conference on Intelligent User Interfaces, IUI 2016 - Sonoma, United States
Duration: Mar 7 2016Mar 10 2016

Other

Other21st International Conference on Intelligent User Interfaces, IUI 2016
CountryUnited States
CitySonoma
Period3/7/163/10/16

    Fingerprint

Keywords

  • Assistive technology
  • Gesture-based interfaces
  • Sign language processing
  • Wearable and pervasive computing

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction

Cite this

Paudyal, P., Banerjee, A., & Gupta, S. (2016). SCEPTRE: A pervasive, non-invasive, and programmable gesture recognition technology. In International Conference on Intelligent User Interfaces, Proceedings IUI (Vol. 07-10-March-2016, pp. 282-293). Association for Computing Machinery. https://doi.org/10.1145/2856767.2856794