A survey on semantic-based methods for the understanding of human movements

Karinne Ramirez-Amaro, Yezhou Yang, Gordon Cheng

Research output: Contribution to journalArticle

Abstract

This paper presents semantic-based methods for the understanding of human movements in robotic applications. To understand human movements, robots need to first, recognize the observed or demonstrated human activities, and secondly, learn different parameters to execute an action or robot behavior. In order to achieve that, several challenges need to be addressed such as the automatic segmentation of human activities, identification of important features of actions, determine the correct sequencing between activities, and obtain the correct mapping between the continuous data and the symbolic and semantic interpretations of the human movements. This paper aims to present state-of-the-art semantic-based approaches, especially the new emerging approaches that tackle the challenges of finding generic and compact semantic models for the robotics domain. Finally, we will highlight potential breakthroughs and challenges for the next years such as achieving scalability, better generalization, compact and flexible models, and higher system accuracy.

Original languageEnglish (US)
Pages (from-to)31-50
Number of pages20
JournalRobotics and Autonomous Systems
Volume119
DOIs
StatePublished - Sep 1 2019
Externally publishedYes

Fingerprint

Semantics
Robotics
Robots
Robot
Scalability
Sequencing
Segmentation
Movement
Human
Model

Keywords

  • Human activity recognition
  • Intelligent systems
  • Robot action execution
  • Semantic representations
  • Understanding human movements

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Software
  • Mathematics(all)
  • Computer Science Applications

Cite this

A survey on semantic-based methods for the understanding of human movements. / Ramirez-Amaro, Karinne; Yang, Yezhou; Cheng, Gordon.

In: Robotics and Autonomous Systems, Vol. 119, 01.09.2019, p. 31-50.

Research output: Contribution to journalArticle

@article{78b9391b4c5544c3b208589d880e9bb7,
title = "A survey on semantic-based methods for the understanding of human movements",
abstract = "This paper presents semantic-based methods for the understanding of human movements in robotic applications. To understand human movements, robots need to first, recognize the observed or demonstrated human activities, and secondly, learn different parameters to execute an action or robot behavior. In order to achieve that, several challenges need to be addressed such as the automatic segmentation of human activities, identification of important features of actions, determine the correct sequencing between activities, and obtain the correct mapping between the continuous data and the symbolic and semantic interpretations of the human movements. This paper aims to present state-of-the-art semantic-based approaches, especially the new emerging approaches that tackle the challenges of finding generic and compact semantic models for the robotics domain. Finally, we will highlight potential breakthroughs and challenges for the next years such as achieving scalability, better generalization, compact and flexible models, and higher system accuracy.",
keywords = "Human activity recognition, Intelligent systems, Robot action execution, Semantic representations, Understanding human movements",
author = "Karinne Ramirez-Amaro and Yezhou Yang and Gordon Cheng",
year = "2019",
month = "9",
day = "1",
doi = "10.1016/j.robot.2019.05.013",
language = "English (US)",
volume = "119",
pages = "31--50",
journal = "Robotics and Autonomous Systems",
issn = "0921-8890",
publisher = "Elsevier",

}

TY - JOUR

T1 - A survey on semantic-based methods for the understanding of human movements

AU - Ramirez-Amaro, Karinne

AU - Yang, Yezhou

AU - Cheng, Gordon

PY - 2019/9/1

Y1 - 2019/9/1

N2 - This paper presents semantic-based methods for the understanding of human movements in robotic applications. To understand human movements, robots need to first, recognize the observed or demonstrated human activities, and secondly, learn different parameters to execute an action or robot behavior. In order to achieve that, several challenges need to be addressed such as the automatic segmentation of human activities, identification of important features of actions, determine the correct sequencing between activities, and obtain the correct mapping between the continuous data and the symbolic and semantic interpretations of the human movements. This paper aims to present state-of-the-art semantic-based approaches, especially the new emerging approaches that tackle the challenges of finding generic and compact semantic models for the robotics domain. Finally, we will highlight potential breakthroughs and challenges for the next years such as achieving scalability, better generalization, compact and flexible models, and higher system accuracy.

AB - This paper presents semantic-based methods for the understanding of human movements in robotic applications. To understand human movements, robots need to first, recognize the observed or demonstrated human activities, and secondly, learn different parameters to execute an action or robot behavior. In order to achieve that, several challenges need to be addressed such as the automatic segmentation of human activities, identification of important features of actions, determine the correct sequencing between activities, and obtain the correct mapping between the continuous data and the symbolic and semantic interpretations of the human movements. This paper aims to present state-of-the-art semantic-based approaches, especially the new emerging approaches that tackle the challenges of finding generic and compact semantic models for the robotics domain. Finally, we will highlight potential breakthroughs and challenges for the next years such as achieving scalability, better generalization, compact and flexible models, and higher system accuracy.

KW - Human activity recognition

KW - Intelligent systems

KW - Robot action execution

KW - Semantic representations

KW - Understanding human movements

UR - http://www.scopus.com/inward/record.url?scp=85067241613&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85067241613&partnerID=8YFLogxK

U2 - 10.1016/j.robot.2019.05.013

DO - 10.1016/j.robot.2019.05.013

M3 - Article

AN - SCOPUS:85067241613

VL - 119

SP - 31

EP - 50

JO - Robotics and Autonomous Systems

JF - Robotics and Autonomous Systems

SN - 0921-8890

ER -