TY - GEN
T1 - Enabling real-time collaborative brain-mobile interactive applications on volunteer mobile devices
AU - Pore, Madhurima
AU - Sadeghi, Koosha
AU - Chakati, Vinaya
AU - Banerjee, Ayan
AU - Gupta, Sandeep
N1 - Funding Information:
This work has been partly funded by CNS grant # 1218505, IIS grant # 1116385, and NIH grant # EB019202.
Publisher Copyright:
© 2015 ACM.
PY - 2015/9/11
Y1 - 2015/9/11
N2 - Commercially available wearable brain sensors and devices that convert smartphones into virtual reality systems open up the potential to implement real time collaborative brainmobile interactive applications. These applications may derive psychological contexts using electroencephalogram (EEG) collected in a wireless setting, and provide individualized sensory feedback through devices such as Google Cardboard. Psychological contexts are affected not only by user's own behavior but also by her interaction with the environment and possibly other individuals. Hence, deriving psychological context information not only requires sensing of an individual's brain but also data from her neighbors. Further, the data needs to be processed by computationally intensive machine learning algorithms which may not be executed within desired latency using resource limited mobile devices. In such a scenario, real time computation of psychological contexts and administration of sensory feedback may be infeasible. In this work, we consider the idea of offloading psychological context estimation and sensory feedback computation to volunteer mobile devices and study the feasibility of large scale real-time adhoc brain-mobile interface applications. We present the BraiNet architecture, which can be used to write a custom application to perform computation on brain data and gain group level aggregate inferences and provide feedback. Further, heavy computation related to the brain signal processing can be offloaded to networked mobile devices for adhoc real-time execution without the need for a dedicated server. We show the usage of BraiNet to develop "Neuro Movie" (nMovie) [7], that modulates movie frames based on individuals subconscious preferences.
AB - Commercially available wearable brain sensors and devices that convert smartphones into virtual reality systems open up the potential to implement real time collaborative brainmobile interactive applications. These applications may derive psychological contexts using electroencephalogram (EEG) collected in a wireless setting, and provide individualized sensory feedback through devices such as Google Cardboard. Psychological contexts are affected not only by user's own behavior but also by her interaction with the environment and possibly other individuals. Hence, deriving psychological context information not only requires sensing of an individual's brain but also data from her neighbors. Further, the data needs to be processed by computationally intensive machine learning algorithms which may not be executed within desired latency using resource limited mobile devices. In such a scenario, real time computation of psychological contexts and administration of sensory feedback may be infeasible. In this work, we consider the idea of offloading psychological context estimation and sensory feedback computation to volunteer mobile devices and study the feasibility of large scale real-time adhoc brain-mobile interface applications. We present the BraiNet architecture, which can be used to write a custom application to perform computation on brain data and gain group level aggregate inferences and provide feedback. Further, heavy computation related to the brain signal processing can be offloaded to networked mobile devices for adhoc real-time execution without the need for a dedicated server. We show the usage of BraiNet to develop "Neuro Movie" (nMovie) [7], that modulates movie frames based on individuals subconscious preferences.
KW - Brain computer interface
KW - Brain sensing
KW - Context aware applications
KW - Mobile computing
KW - Offloading
UR - http://www.scopus.com/inward/record.url?scp=84963783965&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84963783965&partnerID=8YFLogxK
U2 - 10.1145/2799650.2799660
DO - 10.1145/2799650.2799660
M3 - Conference contribution
AN - SCOPUS:84963783965
T3 - HotWireless 2015 - Proceedings of the 2nd International Workshop on Hot Topics in Wireless, co-located with MobiCom 2015
SP - 46
EP - 50
BT - HotWireless 2015 - Proceedings of the 2nd International Workshop on Hot Topics in Wireless, co-located with MobiCom 2015
PB - Association for Computing Machinery, Inc
T2 - 2nd ACM International Workshop on Hot Topics in Wireless, HotWireless 2015
Y2 - 11 September 2015
ER -