TY - GEN
T1 - M2NN
T2 - 2020 IEEE International Conference on Smart Data Services, SMDS 2020
AU - Ravindranath, Manjusha
AU - Selcuk Candan, K.
AU - Sapino, Maria Luisa
N1 - Funding Information:
This work has been supported by NSF grants #1633381, #1909555, #1629888, #2026860, #1827757, DOD grant W81XWH-19-1-0514, and a DOE CYDRES grant. Experiments for the paper were conducted using NSF testbed: “Chameleon: A Large-Scale Re-configurable Experimental Environment for Cloud Research”. We thank Phoenix Children’s Hospital and Drs. Brian Appavu and Stephen Foldes for the (anonymized) EEG trauma data and their invaluable expertise and feedback.
Publisher Copyright:
© 2020 IEEE.
PY - 2020/10
Y1 - 2020/10
N2 - With the increasing availability of sensory data, inferring the existence of relevant events in the observations is becoming a critical task for smart data service delivery in applications that rely on such data sources. Yet, existing solutions tend to fail when the events that are being inferred are rare, for instance when one attempts to infer seizure events in electroencephalogram (EEG) data. In this paper, we note that multi-variate time series often carry robust localized multi-variate temporal features that could, at least in theory, help identify these events; however, the lack of sufficient data to train for these events make it impossible for neural architectures to identify and make use of these features. To tackle this challenge, we propose an LSTM-based neural architecture, M2N N, with an attention mechanism that leverages robust multivariate temporal features that are extracted a priori and fed into the NN as a side information. In particular, multi-variate temporal features are extracted by simultaneously considering, at multiple scales, temporal characteristics of the time series along with external knowledge, including variate relationships that are known a priori. We then show that a single layer LSTM with dual-layer attention that leverages these multi-scale, multi-variate features provides significant gains in rare seizure detection on EEG data. In addition, in order to illustrate the broader applicability (and reproducibility) of M2N N, we also evaluate it in other publicly available rare event detection tasks, such as anomaly detection in manufacturing. We further show that the proposed M2N N technique is beneficial in tackling more traditional inference problems, such as travel-time prediction, where rare accident events can cause congestions.
AB - With the increasing availability of sensory data, inferring the existence of relevant events in the observations is becoming a critical task for smart data service delivery in applications that rely on such data sources. Yet, existing solutions tend to fail when the events that are being inferred are rare, for instance when one attempts to infer seizure events in electroencephalogram (EEG) data. In this paper, we note that multi-variate time series often carry robust localized multi-variate temporal features that could, at least in theory, help identify these events; however, the lack of sufficient data to train for these events make it impossible for neural architectures to identify and make use of these features. To tackle this challenge, we propose an LSTM-based neural architecture, M2N N, with an attention mechanism that leverages robust multivariate temporal features that are extracted a priori and fed into the NN as a side information. In particular, multi-variate temporal features are extracted by simultaneously considering, at multiple scales, temporal characteristics of the time series along with external knowledge, including variate relationships that are known a priori. We then show that a single layer LSTM with dual-layer attention that leverages these multi-scale, multi-variate features provides significant gains in rare seizure detection on EEG data. In addition, in order to illustrate the broader applicability (and reproducibility) of M2N N, we also evaluate it in other publicly available rare event detection tasks, such as anomaly detection in manufacturing. We further show that the proposed M2N N technique is beneficial in tackling more traditional inference problems, such as travel-time prediction, where rare accident events can cause congestions.
KW - Brain EEG analysis
KW - Multi-scale attention
KW - Multivariate time series
KW - Rare event inference
UR - http://www.scopus.com/inward/record.url?scp=85099194949&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85099194949&partnerID=8YFLogxK
U2 - 10.1109/SMDS49396.2020.00014
DO - 10.1109/SMDS49396.2020.00014
M3 - Conference contribution
AN - SCOPUS:85099194949
T3 - Proceedings - 2020 IEEE International Conference on Smart Data Services, SMDS 2020
SP - 53
EP - 62
BT - Proceedings - 2020 IEEE International Conference on Smart Data Services, SMDS 2020
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 18 October 2020 through 24 October 2020
ER -