TY - GEN
T1 - Active scene recognition with vision and language
AU - Yu, Xiaodong
AU - Fermuller, Cornelia
AU - Teo, Ching Lik
AU - Yang, Yezhou
AU - Aloimonos, Yiannis
PY - 2011
Y1 - 2011
N2 - This paper presents a novel approach to utilizing high level knowledge for the problem of scene recognition in an active vision framework, which we call active scene recognition. In traditional approaches, high level knowledge is used in the post-processing to combine the outputs of the object detectors to achieve better classification performance. In contrast, the proposed approach employs high level knowledge actively by implementing an interaction between a reasoning module and a sensory module (Figure 1). Following this paradigm, we implemented an active scene recognizer and evaluated it with a dataset of 20 scenes and 100+ objects. We also extended it to the analysis of dynamic scenes for activity recognition with attributes. Experiments demonstrate the effectiveness of the active paradigm in introducing attention and additional constraints into the sensing process.
AB - This paper presents a novel approach to utilizing high level knowledge for the problem of scene recognition in an active vision framework, which we call active scene recognition. In traditional approaches, high level knowledge is used in the post-processing to combine the outputs of the object detectors to achieve better classification performance. In contrast, the proposed approach employs high level knowledge actively by implementing an interaction between a reasoning module and a sensory module (Figure 1). Following this paradigm, we implemented an active scene recognizer and evaluated it with a dataset of 20 scenes and 100+ objects. We also extended it to the analysis of dynamic scenes for activity recognition with attributes. Experiments demonstrate the effectiveness of the active paradigm in introducing attention and additional constraints into the sensing process.
UR - http://www.scopus.com/inward/record.url?scp=84863036307&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84863036307&partnerID=8YFLogxK
U2 - 10.1109/ICCV.2011.6126320
DO - 10.1109/ICCV.2011.6126320
M3 - Conference contribution
AN - SCOPUS:84863036307
SN - 9781457711015
T3 - Proceedings of the IEEE International Conference on Computer Vision
SP - 810
EP - 817
BT - 2011 International Conference on Computer Vision, ICCV 2011
T2 - 2011 IEEE International Conference on Computer Vision, ICCV 2011
Y2 - 6 November 2011 through 13 November 2011
ER -