SCEPTRE: A pervasive, non-invasive, and programmable gesture recognition technology

Prajwal Paudyal, Ayan Banerjee, Sandeep Gupta

Research output: Chapter in Book/Report/Conference proceedingConference contribution

33 Scopus citations


Communication and collaboration between deaf people and hearing people is hindered by lack of a common language. Although there has been a lot of research in this domain, there is room for work towards a system that is ubiquitous, non-invasive, works in real-time and can be trained interactively by the user. Such a system will be powerful enough to translate gestures performed in real-time, while also being flexible enough to be fully personalized to be used as a platform for gesture based HCI. We propose SCEPTRE which utilizes two non-invasive wrist-worn devices to decipher gesture-based communication. The system uses a multitiered template based comparison system for classification on input data from accelerometer, gyroscope and electromyography (EMG) sensors. This work demonstrates that the system is very easily trained using just one to three training instances each for twenty randomly chosen signs from the American Sign Language(ASL) dictionary and also for user-generated custom gestures. The system is able to achieve an accuracy of 97.72 % for ASL gestures.

Original languageEnglish (US)
Title of host publicationInternational Conference on Intelligent User Interfaces, Proceedings IUI
PublisherAssociation for Computing Machinery
Number of pages12
ISBN (Print)9781450341370, 9781450341400
StatePublished - Mar 7 2016
Event21st International Conference on Intelligent User Interfaces, IUI 2016 - Sonoma, United States
Duration: Mar 7 2016Mar 10 2016


Other21st International Conference on Intelligent User Interfaces, IUI 2016
CountryUnited States


  • Assistive technology
  • Gesture-based interfaces
  • Sign language processing
  • Wearable and pervasive computing

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction

Fingerprint Dive into the research topics of 'SCEPTRE: A pervasive, non-invasive, and programmable gesture recognition technology'. Together they form a unique fingerprint.

Cite this