A survey on semantic-based methods for the understanding of human movements

Karinne Ramirez-Amaro, Yezhou Yang, Gordon Cheng

Research output: Contribution to journalArticlepeer-review

10 Scopus citations


This paper presents semantic-based methods for the understanding of human movements in robotic applications. To understand human movements, robots need to first, recognize the observed or demonstrated human activities, and secondly, learn different parameters to execute an action or robot behavior. In order to achieve that, several challenges need to be addressed such as the automatic segmentation of human activities, identification of important features of actions, determine the correct sequencing between activities, and obtain the correct mapping between the continuous data and the symbolic and semantic interpretations of the human movements. This paper aims to present state-of-the-art semantic-based approaches, especially the new emerging approaches that tackle the challenges of finding generic and compact semantic models for the robotics domain. Finally, we will highlight potential breakthroughs and challenges for the next years such as achieving scalability, better generalization, compact and flexible models, and higher system accuracy.

Original languageEnglish (US)
Pages (from-to)31-50
Number of pages20
JournalRobotics and Autonomous Systems
StatePublished - Sep 2019


  • Human activity recognition
  • Intelligent systems
  • Robot action execution
  • Semantic representations
  • Understanding human movements

ASJC Scopus subject areas

  • Software
  • Control and Systems Engineering
  • Mathematics(all)
  • Computer Science Applications


Dive into the research topics of 'A survey on semantic-based methods for the understanding of human movements'. Together they form a unique fingerprint.

Cite this