Effects of visual latency on visual-haptic experience of stiffness

Bing Wu, Sung Hun Sim, Andinet Enquobahrie, Ricardo Ortiz

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    3 Citations (Scopus)

    Abstract

    In multimodal virtual-reality, augmented-reality, and tele-operation systems, a temporal asynchrony often exists between visual and haptic feedback due to differences in processing and rendering the two types of signals. We have conducted two psychophysical experiments to examine how such asynchrony influences our perceptual experience with an object's stiffness. Participants explored a virtual elastic material using a haptic interface, and saw the deformation of the material in a simulated ultrasound that was displayed with a constant or variable latency relative to the haptic feedback. Their perception of stiffness and ability to differentiate stiffness were measured. The results showed that the perceived stiffness increased with the visual latency while the differentiation threshold was little influenced. When the visual latency was variable, the effects were reduced and participants relied more on the haptic sensations. Such effects will be further evaluated in clinical settings using a neural surgical simulator.

    Original languageEnglish (US)
    Title of host publication2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    ISBN (Print)9781479989584
    DOIs
    StatePublished - Jul 2 2015
    Event2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015 - Costa Navarino, Messinia, Greece
    Duration: May 26 2015May 29 2015

    Other

    Other2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015
    CountryGreece
    CityCosta Navarino, Messinia
    Period5/26/155/29/15

    Fingerprint

    Stiffness
    Feedback
    Haptic interfaces
    Augmented reality
    Virtual reality
    Simulators
    Ultrasonics
    Processing
    Experiments

    Keywords

    • delay
    • perceptual experience
    • psychophysical evaluation
    • stiffness
    • visual-haptic

    ASJC Scopus subject areas

    • Software
    • Computer Vision and Pattern Recognition
    • Computer Graphics and Computer-Aided Design
    • Human-Computer Interaction

    Cite this

    Wu, B., Sim, S. H., Enquobahrie, A., & Ortiz, R. (2015). Effects of visual latency on visual-haptic experience of stiffness. In 2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015 [7148129] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/QoMEX.2015.7148129

    Effects of visual latency on visual-haptic experience of stiffness. / Wu, Bing; Sim, Sung Hun; Enquobahrie, Andinet; Ortiz, Ricardo.

    2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015. Institute of Electrical and Electronics Engineers Inc., 2015. 7148129.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Wu, B, Sim, SH, Enquobahrie, A & Ortiz, R 2015, Effects of visual latency on visual-haptic experience of stiffness. in 2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015., 7148129, Institute of Electrical and Electronics Engineers Inc., 2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015, Costa Navarino, Messinia, Greece, 5/26/15. https://doi.org/10.1109/QoMEX.2015.7148129
    Wu B, Sim SH, Enquobahrie A, Ortiz R. Effects of visual latency on visual-haptic experience of stiffness. In 2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015. Institute of Electrical and Electronics Engineers Inc. 2015. 7148129 https://doi.org/10.1109/QoMEX.2015.7148129
    Wu, Bing ; Sim, Sung Hun ; Enquobahrie, Andinet ; Ortiz, Ricardo. / Effects of visual latency on visual-haptic experience of stiffness. 2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015. Institute of Electrical and Electronics Engineers Inc., 2015.
    @inproceedings{cb361c8ed28c41bbb7405dd22a9d1c1e,
    title = "Effects of visual latency on visual-haptic experience of stiffness",
    abstract = "In multimodal virtual-reality, augmented-reality, and tele-operation systems, a temporal asynchrony often exists between visual and haptic feedback due to differences in processing and rendering the two types of signals. We have conducted two psychophysical experiments to examine how such asynchrony influences our perceptual experience with an object's stiffness. Participants explored a virtual elastic material using a haptic interface, and saw the deformation of the material in a simulated ultrasound that was displayed with a constant or variable latency relative to the haptic feedback. Their perception of stiffness and ability to differentiate stiffness were measured. The results showed that the perceived stiffness increased with the visual latency while the differentiation threshold was little influenced. When the visual latency was variable, the effects were reduced and participants relied more on the haptic sensations. Such effects will be further evaluated in clinical settings using a neural surgical simulator.",
    keywords = "delay, perceptual experience, psychophysical evaluation, stiffness, visual-haptic",
    author = "Bing Wu and Sim, {Sung Hun} and Andinet Enquobahrie and Ricardo Ortiz",
    year = "2015",
    month = "7",
    day = "2",
    doi = "10.1109/QoMEX.2015.7148129",
    language = "English (US)",
    isbn = "9781479989584",
    booktitle = "2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015",
    publisher = "Institute of Electrical and Electronics Engineers Inc.",

    }

    TY - GEN

    T1 - Effects of visual latency on visual-haptic experience of stiffness

    AU - Wu, Bing

    AU - Sim, Sung Hun

    AU - Enquobahrie, Andinet

    AU - Ortiz, Ricardo

    PY - 2015/7/2

    Y1 - 2015/7/2

    N2 - In multimodal virtual-reality, augmented-reality, and tele-operation systems, a temporal asynchrony often exists between visual and haptic feedback due to differences in processing and rendering the two types of signals. We have conducted two psychophysical experiments to examine how such asynchrony influences our perceptual experience with an object's stiffness. Participants explored a virtual elastic material using a haptic interface, and saw the deformation of the material in a simulated ultrasound that was displayed with a constant or variable latency relative to the haptic feedback. Their perception of stiffness and ability to differentiate stiffness were measured. The results showed that the perceived stiffness increased with the visual latency while the differentiation threshold was little influenced. When the visual latency was variable, the effects were reduced and participants relied more on the haptic sensations. Such effects will be further evaluated in clinical settings using a neural surgical simulator.

    AB - In multimodal virtual-reality, augmented-reality, and tele-operation systems, a temporal asynchrony often exists between visual and haptic feedback due to differences in processing and rendering the two types of signals. We have conducted two psychophysical experiments to examine how such asynchrony influences our perceptual experience with an object's stiffness. Participants explored a virtual elastic material using a haptic interface, and saw the deformation of the material in a simulated ultrasound that was displayed with a constant or variable latency relative to the haptic feedback. Their perception of stiffness and ability to differentiate stiffness were measured. The results showed that the perceived stiffness increased with the visual latency while the differentiation threshold was little influenced. When the visual latency was variable, the effects were reduced and participants relied more on the haptic sensations. Such effects will be further evaluated in clinical settings using a neural surgical simulator.

    KW - delay

    KW - perceptual experience

    KW - psychophysical evaluation

    KW - stiffness

    KW - visual-haptic

    UR - http://www.scopus.com/inward/record.url?scp=84939474112&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84939474112&partnerID=8YFLogxK

    U2 - 10.1109/QoMEX.2015.7148129

    DO - 10.1109/QoMEX.2015.7148129

    M3 - Conference contribution

    SN - 9781479989584

    BT - 2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015

    PB - Institute of Electrical and Electronics Engineers Inc.

    ER -