Evaluating perception systems for autonomous vehicles using quality temporal logic

Adel Dokhanchi; Heni Ben Amor; Jyotirmoy V. Deshmukh; Georgios Fainekos

doi:10.1007/978-3-030-03769-7_23

Evaluating perception systems for autonomous vehicles using quality temporal logic

Adel Dokhanchi, Heni Ben Amor, Jyotirmoy V. Deshmukh, Georgios Fainekos

Computing, Informatics and Decision Systems Engineering, School of (CIDSE)

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

4 Scopus citations

Abstract

For reliable situation awareness in autonomous vehicle applications, we need to develop robust and reliable image processing and machine learning algorithms. Currently, there is no general framework for reasoning about the performance of perception systems. This paper introduces Timed Quality Temporal Logic (TQTL) as a formal language for monitoring and testing the performance of object detection and situation awareness algorithms for autonomous vehicle applications. We demonstrate that it is possible to describe interesting properties as TQTL formulas and detect cases where the properties are violated.

Original language	English (US)
Title of host publication	Runtime Verification- 18th International Conference, RV 2018, Proceedings
Editors	Christian Colombo, Martin Leucker
Publisher	Springer Verlag
Pages	409-416
Number of pages	8
ISBN (Print)	9783030037680
DOIs	https://doi.org/10.1007/978-3-030-03769-7_23
State	Published - 2019
Event	18th International Conference on Runtime Verification, RV 2018 - Limassol, Cyprus Duration: Nov 10 2018 → Nov 13 2018

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	11237
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	18th International Conference on Runtime Verification, RV 2018
Country	Cyprus
City	Limassol
Period	11/10/18 → 11/13/18

Keywords

Autonomous vehicles Perception
Image processing
Machine Learning
Monitoring
Temporal logic

ASJC Scopus subject areas

Theoretical Computer Science
Computer Science(all)

Access to Document

10.1007/978-3-030-03769-7_23

Fingerprint Dive into the research topics of 'Evaluating perception systems for autonomous vehicles using quality temporal logic'. Together they form a unique fingerprint.

Cite this

Dokhanchi, A., Amor, H. B., Deshmukh, J. V., & Fainekos, G. (2019). Evaluating perception systems for autonomous vehicles using quality temporal logic. In C. Colombo, & M. Leucker (Eds.), Runtime Verification- 18th International Conference, RV 2018, Proceedings (pp. 409-416). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11237). Springer Verlag. https://doi.org/10.1007/978-3-030-03769-7_23

Evaluating perception systems for autonomous vehicles using quality temporal logic. / Dokhanchi, Adel; Amor, Heni Ben; Deshmukh, Jyotirmoy V.; Fainekos, Georgios.

Runtime Verification- 18th International Conference, RV 2018, Proceedings. ed. / Christian Colombo; Martin Leucker. Springer Verlag, 2019. p. 409-416 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11237).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Dokhanchi, A, Amor, HB, Deshmukh, JV & Fainekos, G 2019, Evaluating perception systems for autonomous vehicles using quality temporal logic. in C Colombo & M Leucker (eds), Runtime Verification- 18th International Conference, RV 2018, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11237, Springer Verlag, pp. 409-416, 18th International Conference on Runtime Verification, RV 2018, Limassol, Cyprus, 11/10/18. https://doi.org/10.1007/978-3-030-03769-7_23

Dokhanchi A, Amor HB, Deshmukh JV, Fainekos G. Evaluating perception systems for autonomous vehicles using quality temporal logic. In Colombo C, Leucker M, editors, Runtime Verification- 18th International Conference, RV 2018, Proceedings. Springer Verlag. 2019. p. 409-416. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-030-03769-7_23

Dokhanchi, Adel ; Amor, Heni Ben ; Deshmukh, Jyotirmoy V. ; Fainekos, Georgios. / Evaluating perception systems for autonomous vehicles using quality temporal logic. Runtime Verification- 18th International Conference, RV 2018, Proceedings. editor / Christian Colombo ; Martin Leucker. Springer Verlag, 2019. pp. 409-416 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{20761baa5b364933b19b6513e5f82143,

title = "Evaluating perception systems for autonomous vehicles using quality temporal logic",

abstract = "For reliable situation awareness in autonomous vehicle applications, we need to develop robust and reliable image processing and machine learning algorithms. Currently, there is no general framework for reasoning about the performance of perception systems. This paper introduces Timed Quality Temporal Logic (TQTL) as a formal language for monitoring and testing the performance of object detection and situation awareness algorithms for autonomous vehicle applications. We demonstrate that it is possible to describe interesting properties as TQTL formulas and detect cases where the properties are violated.",

keywords = "Autonomous vehicles Perception, Image processing, Machine Learning, Monitoring, Temporal logic",

author = "Adel Dokhanchi and Amor, {Heni Ben} and Deshmukh, {Jyotirmoy V.} and Georgios Fainekos",

note = "Funding Information: Acknowledgements. This work was partially supported by the NSF I/UCRC Center for Embedded Systems and by NSF grants 1350420, 1361926 and 1446730.; 18th International Conference on Runtime Verification, RV 2018 ; Conference date: 10-11-2018 Through 13-11-2018",

year = "2019",

doi = "10.1007/978-3-030-03769-7_23",

language = "English (US)",

isbn = "9783030037680",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "409--416",

editor = "Christian Colombo and Martin Leucker",

booktitle = "Runtime Verification- 18th International Conference, RV 2018, Proceedings",

}

TY - GEN

T1 - Evaluating perception systems for autonomous vehicles using quality temporal logic

AU - Dokhanchi, Adel

AU - Amor, Heni Ben

AU - Deshmukh, Jyotirmoy V.

AU - Fainekos, Georgios

N1 - Funding Information: Acknowledgements. This work was partially supported by the NSF I/UCRC Center for Embedded Systems and by NSF grants 1350420, 1361926 and 1446730.

PY - 2019

Y1 - 2019

N2 - For reliable situation awareness in autonomous vehicle applications, we need to develop robust and reliable image processing and machine learning algorithms. Currently, there is no general framework for reasoning about the performance of perception systems. This paper introduces Timed Quality Temporal Logic (TQTL) as a formal language for monitoring and testing the performance of object detection and situation awareness algorithms for autonomous vehicle applications. We demonstrate that it is possible to describe interesting properties as TQTL formulas and detect cases where the properties are violated.

AB - For reliable situation awareness in autonomous vehicle applications, we need to develop robust and reliable image processing and machine learning algorithms. Currently, there is no general framework for reasoning about the performance of perception systems. This paper introduces Timed Quality Temporal Logic (TQTL) as a formal language for monitoring and testing the performance of object detection and situation awareness algorithms for autonomous vehicle applications. We demonstrate that it is possible to describe interesting properties as TQTL formulas and detect cases where the properties are violated.

KW - Autonomous vehicles Perception

KW - Image processing

KW - Machine Learning

KW - Monitoring

KW - Temporal logic

UR - http://www.scopus.com/inward/record.url?scp=85066636161&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85066636161&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-03769-7_23

DO - 10.1007/978-3-030-03769-7_23

M3 - Conference contribution

AN - SCOPUS:85066636161

SN - 9783030037680

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 409

EP - 416

BT - Runtime Verification- 18th International Conference, RV 2018, Proceedings

A2 - Colombo, Christian

A2 - Leucker, Martin

PB - Springer Verlag

T2 - 18th International Conference on Runtime Verification, RV 2018

Y2 - 10 November 2018 through 13 November 2018

ER -

Evaluating perception systems for autonomous vehicles using quality temporal logic

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Cite this