Evaluating sociotechnical dynamics in a simulated remotely-piloted aircraft system: a layered dynamics approach

Jamie C. Gorman, Mustafa Demir, Nancy Cooke, David A. Grimm

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

As coordination mechanisms change and technology failures occur, a sociotechnical system must reorganise itself across human and technological layers to maintain effectiveness. We present a study examining reorganisation across communication, controls and vehicle layers of a remotely-piloted aircraft system (RPAS) using a layered dynamics approach. Team members (pilot; navigator; photographer) performed 5 simulated RPAS missions using different operator configurations, including all-human and human-autonomy teams. Reorganization (operationally defined using entropy) time series measured the changing system reorganisation profiles under different operator configurations and following autonomy failures. Correlations between these reorganisation profiles and team effectiveness scores describe the manner in which the system had to be coordinated to maintain effectiveness under these changing conditions. Four unplanned autonomy failures were analysed to visualise system reorganisation following a technology failure. With its objective and real-time modelling and measurement capabilities, layered dynamics complements existing systems thinking tools for understanding sociotechnical complexity and enhancing system effectiveness. Practitioner summary: A layered dynamics approach for understanding how a sociotechnical system dynamically reorganises itself is presented. The layered dynamics of RPAS were analysed under different operator configurations and following autonomy failures. Layered dynamics complements existing system-thinking tools for modelling sociotechnical system complexity and effectiveness. Abbreviation: RPAS: remotely-piloted aircraft system; HIS: human-systems integration; EAST: event analysis of systemic teamwork; H1: hypothesis 1; H2: hypothesis 2; H3: hypothesis 3; CERTT-STE: cognitive engineering research on team tasks--synthetic task environment; AVO: air vehicle operator; PLO: payload operator; DEMPC: data exploitation, mission planning, and communications; ACT-R: adaptive control of thought-rational; sec: seconds; ANOVA: analysis of variance.

Original languageEnglish (US)
JournalErgonomics
DOIs
StatePublished - Jan 1 2019
Externally publishedYes

Fingerprint

Aircraft
aircraft
reorganization
Analysis of variance (ANOVA)
Systems Analysis
sociotechnical system
Analysis of Variance
Communication
Systems Integration
Technology
autonomy
Engineering research
Entropy
Time series
Air
Planning
PLO
photographer
Research
teamwork

Keywords

  • Dynamical systems
  • human-systems integration
  • real-time
  • remotely piloted aircraft system
  • unmanned aerial vehicle

ASJC Scopus subject areas

  • Human Factors and Ergonomics
  • Physical Therapy, Sports Therapy and Rehabilitation

Cite this

Evaluating sociotechnical dynamics in a simulated remotely-piloted aircraft system : a layered dynamics approach. / Gorman, Jamie C.; Demir, Mustafa; Cooke, Nancy; Grimm, David A.

In: Ergonomics, 01.01.2019.

Research output: Contribution to journalArticle

@article{8478a5b91a2c4eedbdde5a8033e115e5,
title = "Evaluating sociotechnical dynamics in a simulated remotely-piloted aircraft system: a layered dynamics approach",
abstract = "As coordination mechanisms change and technology failures occur, a sociotechnical system must reorganise itself across human and technological layers to maintain effectiveness. We present a study examining reorganisation across communication, controls and vehicle layers of a remotely-piloted aircraft system (RPAS) using a layered dynamics approach. Team members (pilot; navigator; photographer) performed 5 simulated RPAS missions using different operator configurations, including all-human and human-autonomy teams. Reorganization (operationally defined using entropy) time series measured the changing system reorganisation profiles under different operator configurations and following autonomy failures. Correlations between these reorganisation profiles and team effectiveness scores describe the manner in which the system had to be coordinated to maintain effectiveness under these changing conditions. Four unplanned autonomy failures were analysed to visualise system reorganisation following a technology failure. With its objective and real-time modelling and measurement capabilities, layered dynamics complements existing systems thinking tools for understanding sociotechnical complexity and enhancing system effectiveness. Practitioner summary: A layered dynamics approach for understanding how a sociotechnical system dynamically reorganises itself is presented. The layered dynamics of RPAS were analysed under different operator configurations and following autonomy failures. Layered dynamics complements existing system-thinking tools for modelling sociotechnical system complexity and effectiveness. Abbreviation: RPAS: remotely-piloted aircraft system; HIS: human-systems integration; EAST: event analysis of systemic teamwork; H1: hypothesis 1; H2: hypothesis 2; H3: hypothesis 3; CERTT-STE: cognitive engineering research on team tasks--synthetic task environment; AVO: air vehicle operator; PLO: payload operator; DEMPC: data exploitation, mission planning, and communications; ACT-R: adaptive control of thought-rational; sec: seconds; ANOVA: analysis of variance.",
keywords = "Dynamical systems, human-systems integration, real-time, remotely piloted aircraft system, unmanned aerial vehicle",
author = "Gorman, {Jamie C.} and Mustafa Demir and Nancy Cooke and Grimm, {David A.}",
year = "2019",
month = "1",
day = "1",
doi = "10.1080/00140139.2018.1557750",
language = "English (US)",
journal = "Ergonomics",
issn = "0014-0139",
publisher = "Taylor and Francis Ltd.",

}

TY - JOUR

T1 - Evaluating sociotechnical dynamics in a simulated remotely-piloted aircraft system

T2 - a layered dynamics approach

AU - Gorman, Jamie C.

AU - Demir, Mustafa

AU - Cooke, Nancy

AU - Grimm, David A.

PY - 2019/1/1

Y1 - 2019/1/1

N2 - As coordination mechanisms change and technology failures occur, a sociotechnical system must reorganise itself across human and technological layers to maintain effectiveness. We present a study examining reorganisation across communication, controls and vehicle layers of a remotely-piloted aircraft system (RPAS) using a layered dynamics approach. Team members (pilot; navigator; photographer) performed 5 simulated RPAS missions using different operator configurations, including all-human and human-autonomy teams. Reorganization (operationally defined using entropy) time series measured the changing system reorganisation profiles under different operator configurations and following autonomy failures. Correlations between these reorganisation profiles and team effectiveness scores describe the manner in which the system had to be coordinated to maintain effectiveness under these changing conditions. Four unplanned autonomy failures were analysed to visualise system reorganisation following a technology failure. With its objective and real-time modelling and measurement capabilities, layered dynamics complements existing systems thinking tools for understanding sociotechnical complexity and enhancing system effectiveness. Practitioner summary: A layered dynamics approach for understanding how a sociotechnical system dynamically reorganises itself is presented. The layered dynamics of RPAS were analysed under different operator configurations and following autonomy failures. Layered dynamics complements existing system-thinking tools for modelling sociotechnical system complexity and effectiveness. Abbreviation: RPAS: remotely-piloted aircraft system; HIS: human-systems integration; EAST: event analysis of systemic teamwork; H1: hypothesis 1; H2: hypothesis 2; H3: hypothesis 3; CERTT-STE: cognitive engineering research on team tasks--synthetic task environment; AVO: air vehicle operator; PLO: payload operator; DEMPC: data exploitation, mission planning, and communications; ACT-R: adaptive control of thought-rational; sec: seconds; ANOVA: analysis of variance.

AB - As coordination mechanisms change and technology failures occur, a sociotechnical system must reorganise itself across human and technological layers to maintain effectiveness. We present a study examining reorganisation across communication, controls and vehicle layers of a remotely-piloted aircraft system (RPAS) using a layered dynamics approach. Team members (pilot; navigator; photographer) performed 5 simulated RPAS missions using different operator configurations, including all-human and human-autonomy teams. Reorganization (operationally defined using entropy) time series measured the changing system reorganisation profiles under different operator configurations and following autonomy failures. Correlations between these reorganisation profiles and team effectiveness scores describe the manner in which the system had to be coordinated to maintain effectiveness under these changing conditions. Four unplanned autonomy failures were analysed to visualise system reorganisation following a technology failure. With its objective and real-time modelling and measurement capabilities, layered dynamics complements existing systems thinking tools for understanding sociotechnical complexity and enhancing system effectiveness. Practitioner summary: A layered dynamics approach for understanding how a sociotechnical system dynamically reorganises itself is presented. The layered dynamics of RPAS were analysed under different operator configurations and following autonomy failures. Layered dynamics complements existing system-thinking tools for modelling sociotechnical system complexity and effectiveness. Abbreviation: RPAS: remotely-piloted aircraft system; HIS: human-systems integration; EAST: event analysis of systemic teamwork; H1: hypothesis 1; H2: hypothesis 2; H3: hypothesis 3; CERTT-STE: cognitive engineering research on team tasks--synthetic task environment; AVO: air vehicle operator; PLO: payload operator; DEMPC: data exploitation, mission planning, and communications; ACT-R: adaptive control of thought-rational; sec: seconds; ANOVA: analysis of variance.

KW - Dynamical systems

KW - human-systems integration

KW - real-time

KW - remotely piloted aircraft system

KW - unmanned aerial vehicle

UR - http://www.scopus.com/inward/record.url?scp=85061063547&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85061063547&partnerID=8YFLogxK

U2 - 10.1080/00140139.2018.1557750

DO - 10.1080/00140139.2018.1557750

M3 - Article

JO - Ergonomics

JF - Ergonomics

SN - 0014-0139

ER -