Affect Measurement

A Roadmap Through Approaches, Technologies, and Data Analysis

Javier Gonzalez-Sanchez, Mustafa Baydogan, Maria Elena Chavez-Echeagaray, Robert Atkinson, Winslow Burleson

Research output: Chapter in Book/Report/Conference proceedingChapter

2 Citations (Scopus)

Abstract

Affect signals what humans care about and what matters to them. By providing computers with the capability to measure affect, researchers aspire to narrow the communication gap between the emotional human and the emotionally detached computer, with the ultimate aim of enhancing human-computer interactions. This chapter explores the multidisciplinary foundations of affective state measurement as a multimodal process. Specifically, it: (1) describes popular sensing technologies, including brain-computer interfaces, face-based emotion recognition systems, eye-tracking systems, physiological sensors, body language recognition, and text-based language processing; (2) explores the data gathered from each technology and its key characteristics; (3) outlines the pros and cons of each technology; (4) examines sampling, filtering, and multimodal affective data integration methodologies; and (5) presents the tools and algorithms used to analyze affective data off-line, seeking to make inferences regarding the meaning of that data and to correlate it with stimuli.

Original languageEnglish (US)
Title of host publicationEmotions and Affect in Human Factors and Human-Computer Interaction
PublisherElsevier
Pages255-288
Number of pages34
ISBN (Electronic)9780128018798
ISBN (Print)9780128018514
DOIs
StatePublished - Apr 17 2017

Fingerprint

Brain computer interface
Data integration
Human computer interaction
Sampling
Communication
Sensors
Processing

Keywords

  • Affect measurement
  • Affective computing
  • Body language
  • Brain-computer interface
  • Emotion detection
  • Facial expressions
  • Multimodal analysis
  • Physiological signals
  • Sensors

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Gonzalez-Sanchez, J., Baydogan, M., Chavez-Echeagaray, M. E., Atkinson, R., & Burleson, W. (2017). Affect Measurement: A Roadmap Through Approaches, Technologies, and Data Analysis. In Emotions and Affect in Human Factors and Human-Computer Interaction (pp. 255-288). Elsevier. https://doi.org/10.1016/B978-0-12-801851-4.00011-2

Affect Measurement : A Roadmap Through Approaches, Technologies, and Data Analysis. / Gonzalez-Sanchez, Javier; Baydogan, Mustafa; Chavez-Echeagaray, Maria Elena; Atkinson, Robert; Burleson, Winslow.

Emotions and Affect in Human Factors and Human-Computer Interaction. Elsevier, 2017. p. 255-288.

Research output: Chapter in Book/Report/Conference proceedingChapter

Gonzalez-Sanchez, J, Baydogan, M, Chavez-Echeagaray, ME, Atkinson, R & Burleson, W 2017, Affect Measurement: A Roadmap Through Approaches, Technologies, and Data Analysis. in Emotions and Affect in Human Factors and Human-Computer Interaction. Elsevier, pp. 255-288. https://doi.org/10.1016/B978-0-12-801851-4.00011-2
Gonzalez-Sanchez J, Baydogan M, Chavez-Echeagaray ME, Atkinson R, Burleson W. Affect Measurement: A Roadmap Through Approaches, Technologies, and Data Analysis. In Emotions and Affect in Human Factors and Human-Computer Interaction. Elsevier. 2017. p. 255-288 https://doi.org/10.1016/B978-0-12-801851-4.00011-2
Gonzalez-Sanchez, Javier ; Baydogan, Mustafa ; Chavez-Echeagaray, Maria Elena ; Atkinson, Robert ; Burleson, Winslow. / Affect Measurement : A Roadmap Through Approaches, Technologies, and Data Analysis. Emotions and Affect in Human Factors and Human-Computer Interaction. Elsevier, 2017. pp. 255-288
@inbook{a2afb3f6e19746dd99351940e328c440,
title = "Affect Measurement: A Roadmap Through Approaches, Technologies, and Data Analysis",
abstract = "Affect signals what humans care about and what matters to them. By providing computers with the capability to measure affect, researchers aspire to narrow the communication gap between the emotional human and the emotionally detached computer, with the ultimate aim of enhancing human-computer interactions. This chapter explores the multidisciplinary foundations of affective state measurement as a multimodal process. Specifically, it: (1) describes popular sensing technologies, including brain-computer interfaces, face-based emotion recognition systems, eye-tracking systems, physiological sensors, body language recognition, and text-based language processing; (2) explores the data gathered from each technology and its key characteristics; (3) outlines the pros and cons of each technology; (4) examines sampling, filtering, and multimodal affective data integration methodologies; and (5) presents the tools and algorithms used to analyze affective data off-line, seeking to make inferences regarding the meaning of that data and to correlate it with stimuli.",
keywords = "Affect measurement, Affective computing, Body language, Brain-computer interface, Emotion detection, Facial expressions, Multimodal analysis, Physiological signals, Sensors",
author = "Javier Gonzalez-Sanchez and Mustafa Baydogan and Chavez-Echeagaray, {Maria Elena} and Robert Atkinson and Winslow Burleson",
year = "2017",
month = "4",
day = "17",
doi = "10.1016/B978-0-12-801851-4.00011-2",
language = "English (US)",
isbn = "9780128018514",
pages = "255--288",
booktitle = "Emotions and Affect in Human Factors and Human-Computer Interaction",
publisher = "Elsevier",

}

TY - CHAP

T1 - Affect Measurement

T2 - A Roadmap Through Approaches, Technologies, and Data Analysis

AU - Gonzalez-Sanchez, Javier

AU - Baydogan, Mustafa

AU - Chavez-Echeagaray, Maria Elena

AU - Atkinson, Robert

AU - Burleson, Winslow

PY - 2017/4/17

Y1 - 2017/4/17

N2 - Affect signals what humans care about and what matters to them. By providing computers with the capability to measure affect, researchers aspire to narrow the communication gap between the emotional human and the emotionally detached computer, with the ultimate aim of enhancing human-computer interactions. This chapter explores the multidisciplinary foundations of affective state measurement as a multimodal process. Specifically, it: (1) describes popular sensing technologies, including brain-computer interfaces, face-based emotion recognition systems, eye-tracking systems, physiological sensors, body language recognition, and text-based language processing; (2) explores the data gathered from each technology and its key characteristics; (3) outlines the pros and cons of each technology; (4) examines sampling, filtering, and multimodal affective data integration methodologies; and (5) presents the tools and algorithms used to analyze affective data off-line, seeking to make inferences regarding the meaning of that data and to correlate it with stimuli.

AB - Affect signals what humans care about and what matters to them. By providing computers with the capability to measure affect, researchers aspire to narrow the communication gap between the emotional human and the emotionally detached computer, with the ultimate aim of enhancing human-computer interactions. This chapter explores the multidisciplinary foundations of affective state measurement as a multimodal process. Specifically, it: (1) describes popular sensing technologies, including brain-computer interfaces, face-based emotion recognition systems, eye-tracking systems, physiological sensors, body language recognition, and text-based language processing; (2) explores the data gathered from each technology and its key characteristics; (3) outlines the pros and cons of each technology; (4) examines sampling, filtering, and multimodal affective data integration methodologies; and (5) presents the tools and algorithms used to analyze affective data off-line, seeking to make inferences regarding the meaning of that data and to correlate it with stimuli.

KW - Affect measurement

KW - Affective computing

KW - Body language

KW - Brain-computer interface

KW - Emotion detection

KW - Facial expressions

KW - Multimodal analysis

KW - Physiological signals

KW - Sensors

UR - http://www.scopus.com/inward/record.url?scp=85054368587&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85054368587&partnerID=8YFLogxK

U2 - 10.1016/B978-0-12-801851-4.00011-2

DO - 10.1016/B978-0-12-801851-4.00011-2

M3 - Chapter

SN - 9780128018514

SP - 255

EP - 288

BT - Emotions and Affect in Human Factors and Human-Computer Interaction

PB - Elsevier

ER -