Instructive video retrieval for surgical skill coaching using attribute learning

Lin Chen, Qiang Zhang, Peng Zhang, Baoxin Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

Video-based coaching systems have seen increasing adoption in various applications including dance, sports, and surgery training. Most existing systems are either passive (for data capture only) or barely active (with limited automated feedback to a trainee). In this paper, we present a video-based skill coaching system for simulation-based surgical training by exploring a newly proposed problem of instructive video retrieval. By introducing attribute learning into video for high-level skill understanding, we aim at providing automated feedback and providing an instructive video, to which the trainees can refer for performance improvement. This is achieved by ensuring the feedback is weakness-specific, skill-superior and content-similar. A suite of techniques was integrated to build the coaching system with these features. In particular, algorithms were developed for action segmentation, video attribute learning, and attribute-based video retrieval. Experiments with realistic surgical videos demonstrate the feasibility of the proposed method and suggest areas for further improvement.

Original languageEnglish (US)
Title of host publication2015 IEEE International Conference on Multimedia and Expo, ICME 2015
PublisherIEEE Computer Society
ISBN (Electronic)9781479970827
DOIs
StatePublished - Aug 4 2015
EventIEEE International Conference on Multimedia and Expo, ICME 2015 - Turin, Italy
Duration: Jun 29 2015Jul 3 2015

Publication series

NameProceedings - IEEE International Conference on Multimedia and Expo
Volume2015-August
ISSN (Print)1945-7871
ISSN (Electronic)1945-788X

Other

OtherIEEE International Conference on Multimedia and Expo, ICME 2015
CountryItaly
CityTurin
Period6/29/157/3/15

Keywords

  • Attribute Learning
  • Coaching System
  • Instructive Video Retrieval

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Instructive video retrieval for surgical skill coaching using attribute learning'. Together they form a unique fingerprint.

  • Cite this

    Chen, L., Zhang, Q., Zhang, P., & Li, B. (2015). Instructive video retrieval for surgical skill coaching using attribute learning. In 2015 IEEE International Conference on Multimedia and Expo, ICME 2015 [7177389] (Proceedings - IEEE International Conference on Multimedia and Expo; Vol. 2015-August). IEEE Computer Society. https://doi.org/10.1109/ICME.2015.7177389