Effects of visual latency on visual-haptic experience of stiffness

Bing Wu, Sung Hun Sim, Andinet Enquobahrie, Ricardo Ortiz

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    3 Scopus citations

    Abstract

    In multimodal virtual-reality, augmented-reality, and tele-operation systems, a temporal asynchrony often exists between visual and haptic feedback due to differences in processing and rendering the two types of signals. We have conducted two psychophysical experiments to examine how such asynchrony influences our perceptual experience with an object's stiffness. Participants explored a virtual elastic material using a haptic interface, and saw the deformation of the material in a simulated ultrasound that was displayed with a constant or variable latency relative to the haptic feedback. Their perception of stiffness and ability to differentiate stiffness were measured. The results showed that the perceived stiffness increased with the visual latency while the differentiation threshold was little influenced. When the visual latency was variable, the effects were reduced and participants relied more on the haptic sensations. Such effects will be further evaluated in clinical settings using a neural surgical simulator.

    Original languageEnglish (US)
    Title of host publication2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    ISBN (Print)9781479989584
    DOIs
    StatePublished - Jul 2 2015
    Event2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015 - Costa Navarino, Messinia, Greece
    Duration: May 26 2015May 29 2015

    Other

    Other2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015
    CountryGreece
    CityCosta Navarino, Messinia
    Period5/26/155/29/15

      Fingerprint

    Keywords

    • delay
    • perceptual experience
    • psychophysical evaluation
    • stiffness
    • visual-haptic

    ASJC Scopus subject areas

    • Software
    • Computer Vision and Pattern Recognition
    • Computer Graphics and Computer-Aided Design
    • Human-Computer Interaction

    Cite this

    Wu, B., Sim, S. H., Enquobahrie, A., & Ortiz, R. (2015). Effects of visual latency on visual-haptic experience of stiffness. In 2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015 [7148129] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/QoMEX.2015.7148129