Enabling real-time collaborative brain-mobile interactive applications on volunteer mobile devices

Madhurima Pore, Koosha Sadeghi, Vinaya Chakati, Ayan Banerjee, Sandeep Gupta

Research output: Chapter in Book/Report/Conference proceedingConference contribution

15 Citations (Scopus)

Abstract

Commercially available wearable brain sensors and devices that convert smartphones into virtual reality systems open up the potential to implement real time collaborative brainmobile interactive applications. These applications may derive psychological contexts using electroencephalogram (EEG) collected in a wireless setting, and provide individualized sensory feedback through devices such as Google Cardboard. Psychological contexts are affected not only by user's own behavior but also by her interaction with the environment and possibly other individuals. Hence, deriving psychological context information not only requires sensing of an individual's brain but also data from her neighbors. Further, the data needs to be processed by computationally intensive machine learning algorithms which may not be executed within desired latency using resource limited mobile devices. In such a scenario, real time computation of psychological contexts and administration of sensory feedback may be infeasible. In this work, we consider the idea of offloading psychological context estimation and sensory feedback computation to volunteer mobile devices and study the feasibility of large scale real-time adhoc brain-mobile interface applications. We present the BraiNet architecture, which can be used to write a custom application to perform computation on brain data and gain group level aggregate inferences and provide feedback. Further, heavy computation related to the brain signal processing can be offloaded to networked mobile devices for adhoc real-time execution without the need for a dedicated server. We show the usage of BraiNet to develop "Neuro Movie" (nMovie) [7], that modulates movie frames based on individuals subconscious preferences.

Original languageEnglish (US)
Title of host publicationHotWireless 2015 - Proceedings of the 2nd International Workshop on Hot Topics in Wireless, co-located with MobiCom 2015
PublisherAssociation for Computing Machinery, Inc
Pages46-50
Number of pages5
ISBN (Electronic)9781450336994
DOIs
StatePublished - Sep 11 2015
Event2nd ACM International Workshop on Hot Topics in Wireless, HotWireless 2015 - Paris, France
Duration: Sep 11 2015 → …

Other

Other2nd ACM International Workshop on Hot Topics in Wireless, HotWireless 2015
CountryFrance
CityParis
Period9/11/15 → …

Fingerprint

Mobile devices
Sensory feedback
Brain
Smartphones
Open systems
Electroencephalography
Virtual reality
Learning algorithms
Learning systems
Signal processing
Servers
Feedback
Sensors

Keywords

  • Brain computer interface
  • Brain sensing
  • Context aware applications
  • Mobile computing
  • Offloading

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Information Systems

Cite this

Pore, M., Sadeghi, K., Chakati, V., Banerjee, A., & Gupta, S. (2015). Enabling real-time collaborative brain-mobile interactive applications on volunteer mobile devices. In HotWireless 2015 - Proceedings of the 2nd International Workshop on Hot Topics in Wireless, co-located with MobiCom 2015 (pp. 46-50). [2799660] Association for Computing Machinery, Inc. https://doi.org/10.1145/2799650.2799660

Enabling real-time collaborative brain-mobile interactive applications on volunteer mobile devices. / Pore, Madhurima; Sadeghi, Koosha; Chakati, Vinaya; Banerjee, Ayan; Gupta, Sandeep.

HotWireless 2015 - Proceedings of the 2nd International Workshop on Hot Topics in Wireless, co-located with MobiCom 2015. Association for Computing Machinery, Inc, 2015. p. 46-50 2799660.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Pore, M, Sadeghi, K, Chakati, V, Banerjee, A & Gupta, S 2015, Enabling real-time collaborative brain-mobile interactive applications on volunteer mobile devices. in HotWireless 2015 - Proceedings of the 2nd International Workshop on Hot Topics in Wireless, co-located with MobiCom 2015., 2799660, Association for Computing Machinery, Inc, pp. 46-50, 2nd ACM International Workshop on Hot Topics in Wireless, HotWireless 2015, Paris, France, 9/11/15. https://doi.org/10.1145/2799650.2799660
Pore M, Sadeghi K, Chakati V, Banerjee A, Gupta S. Enabling real-time collaborative brain-mobile interactive applications on volunteer mobile devices. In HotWireless 2015 - Proceedings of the 2nd International Workshop on Hot Topics in Wireless, co-located with MobiCom 2015. Association for Computing Machinery, Inc. 2015. p. 46-50. 2799660 https://doi.org/10.1145/2799650.2799660
Pore, Madhurima ; Sadeghi, Koosha ; Chakati, Vinaya ; Banerjee, Ayan ; Gupta, Sandeep. / Enabling real-time collaborative brain-mobile interactive applications on volunteer mobile devices. HotWireless 2015 - Proceedings of the 2nd International Workshop on Hot Topics in Wireless, co-located with MobiCom 2015. Association for Computing Machinery, Inc, 2015. pp. 46-50
@inproceedings{c07a5d1a8c3f459ba88440deff8b4ec8,
title = "Enabling real-time collaborative brain-mobile interactive applications on volunteer mobile devices",
abstract = "Commercially available wearable brain sensors and devices that convert smartphones into virtual reality systems open up the potential to implement real time collaborative brainmobile interactive applications. These applications may derive psychological contexts using electroencephalogram (EEG) collected in a wireless setting, and provide individualized sensory feedback through devices such as Google Cardboard. Psychological contexts are affected not only by user's own behavior but also by her interaction with the environment and possibly other individuals. Hence, deriving psychological context information not only requires sensing of an individual's brain but also data from her neighbors. Further, the data needs to be processed by computationally intensive machine learning algorithms which may not be executed within desired latency using resource limited mobile devices. In such a scenario, real time computation of psychological contexts and administration of sensory feedback may be infeasible. In this work, we consider the idea of offloading psychological context estimation and sensory feedback computation to volunteer mobile devices and study the feasibility of large scale real-time adhoc brain-mobile interface applications. We present the BraiNet architecture, which can be used to write a custom application to perform computation on brain data and gain group level aggregate inferences and provide feedback. Further, heavy computation related to the brain signal processing can be offloaded to networked mobile devices for adhoc real-time execution without the need for a dedicated server. We show the usage of BraiNet to develop {"}Neuro Movie{"} (nMovie) [7], that modulates movie frames based on individuals subconscious preferences.",
keywords = "Brain computer interface, Brain sensing, Context aware applications, Mobile computing, Offloading",
author = "Madhurima Pore and Koosha Sadeghi and Vinaya Chakati and Ayan Banerjee and Sandeep Gupta",
year = "2015",
month = "9",
day = "11",
doi = "10.1145/2799650.2799660",
language = "English (US)",
pages = "46--50",
booktitle = "HotWireless 2015 - Proceedings of the 2nd International Workshop on Hot Topics in Wireless, co-located with MobiCom 2015",
publisher = "Association for Computing Machinery, Inc",

}

TY - GEN

T1 - Enabling real-time collaborative brain-mobile interactive applications on volunteer mobile devices

AU - Pore, Madhurima

AU - Sadeghi, Koosha

AU - Chakati, Vinaya

AU - Banerjee, Ayan

AU - Gupta, Sandeep

PY - 2015/9/11

Y1 - 2015/9/11

N2 - Commercially available wearable brain sensors and devices that convert smartphones into virtual reality systems open up the potential to implement real time collaborative brainmobile interactive applications. These applications may derive psychological contexts using electroencephalogram (EEG) collected in a wireless setting, and provide individualized sensory feedback through devices such as Google Cardboard. Psychological contexts are affected not only by user's own behavior but also by her interaction with the environment and possibly other individuals. Hence, deriving psychological context information not only requires sensing of an individual's brain but also data from her neighbors. Further, the data needs to be processed by computationally intensive machine learning algorithms which may not be executed within desired latency using resource limited mobile devices. In such a scenario, real time computation of psychological contexts and administration of sensory feedback may be infeasible. In this work, we consider the idea of offloading psychological context estimation and sensory feedback computation to volunteer mobile devices and study the feasibility of large scale real-time adhoc brain-mobile interface applications. We present the BraiNet architecture, which can be used to write a custom application to perform computation on brain data and gain group level aggregate inferences and provide feedback. Further, heavy computation related to the brain signal processing can be offloaded to networked mobile devices for adhoc real-time execution without the need for a dedicated server. We show the usage of BraiNet to develop "Neuro Movie" (nMovie) [7], that modulates movie frames based on individuals subconscious preferences.

AB - Commercially available wearable brain sensors and devices that convert smartphones into virtual reality systems open up the potential to implement real time collaborative brainmobile interactive applications. These applications may derive psychological contexts using electroencephalogram (EEG) collected in a wireless setting, and provide individualized sensory feedback through devices such as Google Cardboard. Psychological contexts are affected not only by user's own behavior but also by her interaction with the environment and possibly other individuals. Hence, deriving psychological context information not only requires sensing of an individual's brain but also data from her neighbors. Further, the data needs to be processed by computationally intensive machine learning algorithms which may not be executed within desired latency using resource limited mobile devices. In such a scenario, real time computation of psychological contexts and administration of sensory feedback may be infeasible. In this work, we consider the idea of offloading psychological context estimation and sensory feedback computation to volunteer mobile devices and study the feasibility of large scale real-time adhoc brain-mobile interface applications. We present the BraiNet architecture, which can be used to write a custom application to perform computation on brain data and gain group level aggregate inferences and provide feedback. Further, heavy computation related to the brain signal processing can be offloaded to networked mobile devices for adhoc real-time execution without the need for a dedicated server. We show the usage of BraiNet to develop "Neuro Movie" (nMovie) [7], that modulates movie frames based on individuals subconscious preferences.

KW - Brain computer interface

KW - Brain sensing

KW - Context aware applications

KW - Mobile computing

KW - Offloading

UR - http://www.scopus.com/inward/record.url?scp=84963783965&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84963783965&partnerID=8YFLogxK

U2 - 10.1145/2799650.2799660

DO - 10.1145/2799650.2799660

M3 - Conference contribution

SP - 46

EP - 50

BT - HotWireless 2015 - Proceedings of the 2nd International Workshop on Hot Topics in Wireless, co-located with MobiCom 2015

PB - Association for Computing Machinery, Inc

ER -