Instructive video retrieval for surgical skill coaching using attribute learning

Lin Chen, Qiang Zhang, Peng Zhang, Baoxin Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Video-based coaching systems have seen increasing adoption in various applications including dance, sports, and surgery training. Most existing systems are either passive (for data capture only) or barely active (with limited automated feedback to a trainee). In this paper, we present a video-based skill coaching system for simulation-based surgical training by exploring a newly proposed problem of instructive video retrieval. By introducing attribute learning into video for high-level skill understanding, we aim at providing automated feedback and providing an instructive video, to which the trainees can refer for performance improvement. This is achieved by ensuring the feedback is weakness-specific, skill-superior and content-similar. A suite of techniques was integrated to build the coaching system with these features. In particular, algorithms were developed for action segmentation, video attribute learning, and attribute-based video retrieval. Experiments with realistic surgical videos demonstrate the feasibility of the proposed method and suggest areas for further improvement.

Original languageEnglish (US)
Title of host publicationProceedings - IEEE International Conference on Multimedia and Expo
PublisherIEEE Computer Society
Volume2015-August
ISBN (Print)9781479970827
DOIs
StatePublished - Aug 4 2015
EventIEEE International Conference on Multimedia and Expo, ICME 2015 - Turin, Italy
Duration: Jun 29 2015Jul 3 2015

Other

OtherIEEE International Conference on Multimedia and Expo, ICME 2015
CountryItaly
CityTurin
Period6/29/157/3/15

Fingerprint

Feedback
Sports
Surgery
Data acquisition
Experiments

Keywords

  • Attribute Learning
  • Coaching System
  • Instructive Video Retrieval

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications

Cite this

Chen, L., Zhang, Q., Zhang, P., & Li, B. (2015). Instructive video retrieval for surgical skill coaching using attribute learning. In Proceedings - IEEE International Conference on Multimedia and Expo (Vol. 2015-August). [7177389] IEEE Computer Society. https://doi.org/10.1109/ICME.2015.7177389

Instructive video retrieval for surgical skill coaching using attribute learning. / Chen, Lin; Zhang, Qiang; Zhang, Peng; Li, Baoxin.

Proceedings - IEEE International Conference on Multimedia and Expo. Vol. 2015-August IEEE Computer Society, 2015. 7177389.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Chen, L, Zhang, Q, Zhang, P & Li, B 2015, Instructive video retrieval for surgical skill coaching using attribute learning. in Proceedings - IEEE International Conference on Multimedia and Expo. vol. 2015-August, 7177389, IEEE Computer Society, IEEE International Conference on Multimedia and Expo, ICME 2015, Turin, Italy, 6/29/15. https://doi.org/10.1109/ICME.2015.7177389
Chen L, Zhang Q, Zhang P, Li B. Instructive video retrieval for surgical skill coaching using attribute learning. In Proceedings - IEEE International Conference on Multimedia and Expo. Vol. 2015-August. IEEE Computer Society. 2015. 7177389 https://doi.org/10.1109/ICME.2015.7177389
Chen, Lin ; Zhang, Qiang ; Zhang, Peng ; Li, Baoxin. / Instructive video retrieval for surgical skill coaching using attribute learning. Proceedings - IEEE International Conference on Multimedia and Expo. Vol. 2015-August IEEE Computer Society, 2015.
@inproceedings{e0ece00f33fb4fb2888884e22e118f6f,
title = "Instructive video retrieval for surgical skill coaching using attribute learning",
abstract = "Video-based coaching systems have seen increasing adoption in various applications including dance, sports, and surgery training. Most existing systems are either passive (for data capture only) or barely active (with limited automated feedback to a trainee). In this paper, we present a video-based skill coaching system for simulation-based surgical training by exploring a newly proposed problem of instructive video retrieval. By introducing attribute learning into video for high-level skill understanding, we aim at providing automated feedback and providing an instructive video, to which the trainees can refer for performance improvement. This is achieved by ensuring the feedback is weakness-specific, skill-superior and content-similar. A suite of techniques was integrated to build the coaching system with these features. In particular, algorithms were developed for action segmentation, video attribute learning, and attribute-based video retrieval. Experiments with realistic surgical videos demonstrate the feasibility of the proposed method and suggest areas for further improvement.",
keywords = "Attribute Learning, Coaching System, Instructive Video Retrieval",
author = "Lin Chen and Qiang Zhang and Peng Zhang and Baoxin Li",
year = "2015",
month = "8",
day = "4",
doi = "10.1109/ICME.2015.7177389",
language = "English (US)",
isbn = "9781479970827",
volume = "2015-August",
booktitle = "Proceedings - IEEE International Conference on Multimedia and Expo",
publisher = "IEEE Computer Society",

}

TY - GEN

T1 - Instructive video retrieval for surgical skill coaching using attribute learning

AU - Chen, Lin

AU - Zhang, Qiang

AU - Zhang, Peng

AU - Li, Baoxin

PY - 2015/8/4

Y1 - 2015/8/4

N2 - Video-based coaching systems have seen increasing adoption in various applications including dance, sports, and surgery training. Most existing systems are either passive (for data capture only) or barely active (with limited automated feedback to a trainee). In this paper, we present a video-based skill coaching system for simulation-based surgical training by exploring a newly proposed problem of instructive video retrieval. By introducing attribute learning into video for high-level skill understanding, we aim at providing automated feedback and providing an instructive video, to which the trainees can refer for performance improvement. This is achieved by ensuring the feedback is weakness-specific, skill-superior and content-similar. A suite of techniques was integrated to build the coaching system with these features. In particular, algorithms were developed for action segmentation, video attribute learning, and attribute-based video retrieval. Experiments with realistic surgical videos demonstrate the feasibility of the proposed method and suggest areas for further improvement.

AB - Video-based coaching systems have seen increasing adoption in various applications including dance, sports, and surgery training. Most existing systems are either passive (for data capture only) or barely active (with limited automated feedback to a trainee). In this paper, we present a video-based skill coaching system for simulation-based surgical training by exploring a newly proposed problem of instructive video retrieval. By introducing attribute learning into video for high-level skill understanding, we aim at providing automated feedback and providing an instructive video, to which the trainees can refer for performance improvement. This is achieved by ensuring the feedback is weakness-specific, skill-superior and content-similar. A suite of techniques was integrated to build the coaching system with these features. In particular, algorithms were developed for action segmentation, video attribute learning, and attribute-based video retrieval. Experiments with realistic surgical videos demonstrate the feasibility of the proposed method and suggest areas for further improvement.

KW - Attribute Learning

KW - Coaching System

KW - Instructive Video Retrieval

UR - http://www.scopus.com/inward/record.url?scp=84946027691&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84946027691&partnerID=8YFLogxK

U2 - 10.1109/ICME.2015.7177389

DO - 10.1109/ICME.2015.7177389

M3 - Conference contribution

SN - 9781479970827

VL - 2015-August

BT - Proceedings - IEEE International Conference on Multimedia and Expo

PB - IEEE Computer Society

ER -