TY - GEN
T1 - As go the feet ...
T2 - 10th International Conference on Multimodal Interfaces, ICMI'08
AU - Quek, Francis
AU - Ehrich, Roger
AU - Lockhart, Thurmon
PY - 2008
Y1 - 2008
N2 - The estimation of the direction of visual attention is critical to a large number of interactive systems. This paper investigates the cross-modal relation of the position of one's feet (or standing stance) to the focus of gaze. The intuition is that while one CAN have a range of attentional foci from a particular stance, one may be MORE LIKELY to look in specific directions given an approach vector and stance. We posit that the cross-modal relationship is constrained by biomechanics and personal style. We define a stance vector that models the approach direction before stopping and the pose of a subject's feet. We present a study where the subjects' feet and approach vector are tracked. The subjects read aloud contents of note cards in 4 locations. The order of 'visits' to the cards were randomized. Ten subjects read 40 lines of text each, yielding 400 stance vectors and gaze directions. We divided our data into 4 sets of 300 training and 100 test vectors and trained a neural net to estimate the gaze direction given the stance vector. Our results show that 31% our gaze orientation estimates were within 5°, 51% of our estimates were within 10°, and 60% were within 15°. Given the ability to track foot position, the procedure is minimally invasive.
AB - The estimation of the direction of visual attention is critical to a large number of interactive systems. This paper investigates the cross-modal relation of the position of one's feet (or standing stance) to the focus of gaze. The intuition is that while one CAN have a range of attentional foci from a particular stance, one may be MORE LIKELY to look in specific directions given an approach vector and stance. We posit that the cross-modal relationship is constrained by biomechanics and personal style. We define a stance vector that models the approach direction before stopping and the pose of a subject's feet. We present a study where the subjects' feet and approach vector are tracked. The subjects read aloud contents of note cards in 4 locations. The order of 'visits' to the cards were randomized. Ten subjects read 40 lines of text each, yielding 400 stance vectors and gaze directions. We divided our data into 4 sets of 300 training and 100 test vectors and trained a neural net to estimate the gaze direction given the stance vector. Our results show that 31% our gaze orientation estimates were within 5°, 51% of our estimates were within 10°, and 60% were within 15°. Given the ability to track foot position, the procedure is minimally invasive.
KW - Attention Estimation
KW - Foot-Tracking
KW - Human-Computer Interaction
KW - Multimodal Interfaces
KW - Stance Model
UR - http://www.scopus.com/inward/record.url?scp=78650760548&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=78650760548&partnerID=8YFLogxK
U2 - 10.1145/1452392.1452412
DO - 10.1145/1452392.1452412
M3 - Conference contribution
AN - SCOPUS:78650760548
SN - 9781605581989
T3 - ICMI'08: Proceedings of the 10th International Conference on Multimodal Interfaces
SP - 97
EP - 104
BT - ICMI'08
Y2 - 20 October 2008 through 22 October 2008
ER -