Touch Sensing for a Projected Screen Using Slope Disparity Gating

Mayuka Tsuji, Hiroyuki Kubo, Suren Jayasuriya, Takuya Funatomi, Yasuhiro Mukaigawa

Research output: Contribution to journalArticlepeer-review

Abstract

This paper introduces a novel touch sensing system for a projected screen with a single camera. To achieve touch sensing with camera image, there are two challenges to overcome. One is to establish robustness against image processing being misled by projected contents. The other is to realize both touch detection and fingertips localization with a single-camera image. In this work, we use Slope Disparity Gating and capture only the region slightly above the projected screen. This selected region is set geometrically so that a part of the finger is captured when touching, and no finger is captured when not touching. A key feature of this study is that the projector can enable this selective imaging capability in the camera while still displaying a normal projected image to the user's eyes. The projector is both a programmable light source for capturing system and an interface display device for the users. We built a prototype system and touch sensing algorithm, evaluated the touch accuracy, demonstrated robustness to a projected content.

Original languageEnglish (US)
Article number9495800
Pages (from-to)106005-106013
Number of pages9
JournalIEEE Access
Volume9
DOIs
StatePublished - 2021
Externally publishedYes

Keywords

  • human-computer interface
  • image sensing system
  • projector
  • projector-camera system
  • Touch sensing

ASJC Scopus subject areas

  • Computer Science(all)
  • Materials Science(all)
  • Engineering(all)

Fingerprint

Dive into the research topics of 'Touch Sensing for a Projected Screen Using Slope Disparity Gating'. Together they form a unique fingerprint.

Cite this