Lifelogging: Archival and retrieval of continuously recorded audio using wearable devices

Mohit Shah, Brian Mears, Chaitali Chakrabarti, Andreas Spanias

Research output: Chapter in Book/Report/Conference proceedingConference contribution

21 Scopus citations

Abstract

We propose a complete system for lifelogging where audio is continuously recorded using a smartphone or a wearable recorder. Recorded audio includes speech, music and environmental sounds. First, we describe a feature-based segmentation algorithm for breaking down a long piece of audio into smaller clips. In order to archive clips into a large database, we present methods for automatically indexing and annotating audio with relevant acoustic and semantic tags. Retrieval is performed using a Query-By-Example based approach. To support our claims, the results are demonstrated via a smart-phone application on the popular Android platform. Finally, we also propose a novel virtualization-based design framework to rapidly develop and test such systems for signal processing.

Original languageEnglish (US)
Title of host publication2012 IEEE International Conference on Emerging Signal Processing Applications, ESPA 2012 - Proceedings
Pages99-102
Number of pages4
DOIs
StatePublished - Mar 15 2012
Event2012 IEEE International Conference on Emerging Signal Processing Applications, ESPA 2012 - Las Vegas, NV, United States
Duration: Jan 12 2011Jan 14 2011

Publication series

Name2012 IEEE International Conference on Emerging Signal Processing Applications, ESPA 2012 - Proceedings

Other

Other2012 IEEE International Conference on Emerging Signal Processing Applications, ESPA 2012
CountryUnited States
CityLas Vegas, NV
Period1/12/111/14/11

Keywords

  • Android
  • lifelogging
  • retrieval
  • tagging

ASJC Scopus subject areas

  • Signal Processing

Fingerprint Dive into the research topics of 'Lifelogging: Archival and retrieval of continuously recorded audio using wearable devices'. Together they form a unique fingerprint.

Cite this