Abstract
One of the major challenges facing current media management systems and the related applications is the so-called "semantic gap" between the rich meaning that a user desires and the shallowness of the content descriptions that are automatically extracted from the media. In this paper, we address the problem of bridging this gap in the sports domain. We propose a general framework for indexing and summarizing sports broadcast programs. The framework is based on a high-level model of sports broadcast video using the concept of an event, defined according to domain-specific knowledge for different types of sports. Within this general framework, we develop automatic event detection algorithms that are based on automatic analysis of the visual and aural signals in the media. We have successfully applied the event detection algorithms to different types of sports including American football, baseball, Japanese sumo wrestling, and soccer. Event modeling and detection contribute to the reduction of the semantic gap by providing rudimentary semantic information obtained through media analysis. We further propose a novel approach, which makes use of independently generated rich textual metadata, to fill the gap completely through synchronization of the information-laden textual data with the basic event segments. An MPEG-7 compliant prototype browsing system has been implemented to demonstrate semantic retrieval and summarization of sports video.
Original language | English (US) |
---|---|
Title of host publication | Proceedings of SPIE - The International Society for Optical Engineering |
Editors | M.M. Yeung, R.W. Lienhart, C.S. Li |
Pages | 314-326 |
Number of pages | 13 |
Volume | 5021 |
DOIs | |
State | Published - 2003 |
Externally published | Yes |
Event | Storage and Retrieval for Media Databases 2003 - Santa Clara, CA, United States Duration: Jan 22 2003 → Jan 23 2003 |
Other
Other | Storage and Retrieval for Media Databases 2003 |
---|---|
Country/Territory | United States |
City | Santa Clara, CA |
Period | 1/22/03 → 1/23/03 |
Keywords
- Event detection
- Metadata synchronization
- Video summarization
ASJC Scopus subject areas
- Electrical and Electronic Engineering
- Condensed Matter Physics