Abstract
In multimodal virtual-reality, augmented-reality, and tele-operation systems, a temporal asynchrony often exists between visual and haptic feedback due to differences in processing and rendering the two types of signals. We have conducted two psychophysical experiments to examine how such asynchrony influences our perceptual experience with an object's stiffness. Participants explored a virtual elastic material using a haptic interface, and saw the deformation of the material in a simulated ultrasound that was displayed with a constant or variable latency relative to the haptic feedback. Their perception of stiffness and ability to differentiate stiffness were measured. The results showed that the perceived stiffness increased with the visual latency while the differentiation threshold was little influenced. When the visual latency was variable, the effects were reduced and participants relied more on the haptic sensations. Such effects will be further evaluated in clinical settings using a neural surgical simulator.
| Original language | English (US) |
|---|---|
| Title of host publication | 2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015 |
| Publisher | Institute of Electrical and Electronics Engineers Inc. |
| ISBN (Print) | 9781479989584 |
| DOIs | |
| State | Published - Jul 2 2015 |
| Event | 2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015 - Costa Navarino, Messinia, Greece Duration: May 26 2015 → May 29 2015 |
Other
| Other | 2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015 |
|---|---|
| Country | Greece |
| City | Costa Navarino, Messinia |
| Period | 5/26/15 → 5/29/15 |
Fingerprint
Keywords
- delay
- perceptual experience
- psychophysical evaluation
- stiffness
- visual-haptic
ASJC Scopus subject areas
- Software
- Computer Vision and Pattern Recognition
- Computer Graphics and Computer-Aided Design
- Human-Computer Interaction
Cite this
Effects of visual latency on visual-haptic experience of stiffness. / Wu, Bing; Sim, Sung Hun; Enquobahrie, Andinet; Ortiz, Ricardo.
2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015. Institute of Electrical and Electronics Engineers Inc., 2015. 7148129.Research output: Chapter in Book/Report/Conference proceeding › Conference contribution
}
TY - GEN
T1 - Effects of visual latency on visual-haptic experience of stiffness
AU - Wu, Bing
AU - Sim, Sung Hun
AU - Enquobahrie, Andinet
AU - Ortiz, Ricardo
PY - 2015/7/2
Y1 - 2015/7/2
N2 - In multimodal virtual-reality, augmented-reality, and tele-operation systems, a temporal asynchrony often exists between visual and haptic feedback due to differences in processing and rendering the two types of signals. We have conducted two psychophysical experiments to examine how such asynchrony influences our perceptual experience with an object's stiffness. Participants explored a virtual elastic material using a haptic interface, and saw the deformation of the material in a simulated ultrasound that was displayed with a constant or variable latency relative to the haptic feedback. Their perception of stiffness and ability to differentiate stiffness were measured. The results showed that the perceived stiffness increased with the visual latency while the differentiation threshold was little influenced. When the visual latency was variable, the effects were reduced and participants relied more on the haptic sensations. Such effects will be further evaluated in clinical settings using a neural surgical simulator.
AB - In multimodal virtual-reality, augmented-reality, and tele-operation systems, a temporal asynchrony often exists between visual and haptic feedback due to differences in processing and rendering the two types of signals. We have conducted two psychophysical experiments to examine how such asynchrony influences our perceptual experience with an object's stiffness. Participants explored a virtual elastic material using a haptic interface, and saw the deformation of the material in a simulated ultrasound that was displayed with a constant or variable latency relative to the haptic feedback. Their perception of stiffness and ability to differentiate stiffness were measured. The results showed that the perceived stiffness increased with the visual latency while the differentiation threshold was little influenced. When the visual latency was variable, the effects were reduced and participants relied more on the haptic sensations. Such effects will be further evaluated in clinical settings using a neural surgical simulator.
KW - delay
KW - perceptual experience
KW - psychophysical evaluation
KW - stiffness
KW - visual-haptic
UR - http://www.scopus.com/inward/record.url?scp=84939474112&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84939474112&partnerID=8YFLogxK
U2 - 10.1109/QoMEX.2015.7148129
DO - 10.1109/QoMEX.2015.7148129
M3 - Conference contribution
AN - SCOPUS:84939474112
SN - 9781479989584
BT - 2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015
PB - Institute of Electrical and Electronics Engineers Inc.
ER -