DOI

The increasing availability of multiple sensory devices on or near a human body has opened brand new opportunities to leverage redundant sensory signals for powerful sensing applications. For instance, personal-scale sensory inferences with motion and audio signals can be done individually on a smartphone, a smartwatch, and even an earbud - each offering unique sensor quality, model accuracy, and runtime behaviour. At execution time, however, it is incredibly challenging to assess these characteristics to select the best device for accurate and resource-efficient inferences. To this end, we look at a quality-aware collaborative sensing system that actively interplays across multiple devices and respective sensing models. It dynamically selects the best device as a function of model accuracy at any given context. We propose two complementary techniques for the runtime quality assessment. Borrowing principles from active learning, our first technique runs on three heuristic-based quality assessment functions that employ confidence, margin sampling, and entropy of models' output. Our second technique is built with a siamese neural network and acts on the premise that runtime sensing quality can be learned from historical data. Our evaluation across multiple motion and audio datasets shows that our techniques provide 12% increase in overall accuracy through dynamic device selection at the average expense of 13 mW power on each device as compared to traditional single-device approaches.

Original languageEnglish
Title of host publicationSenSys 2019 - Proceedings of the 17th Conference on Embedded Networked Sensor Systems
EditorsMi Zhang
PublisherAssociation for Computing Machinery (ACM)
Pages271-284
Number of pages14
ISBN (Electronic)9781450369503
DOIs
Publication statusPublished - 10 Nov 2019
Event17th ACM Conference on Embedded Networked Sensor Systems, SenSys 2019 - New York, United States
Duration: 10 Nov 201913 Nov 2019

Conference

Conference17th ACM Conference on Embedded Networked Sensor Systems, SenSys 2019
CountryUnited States
CityNew York
Period10/11/1913/11/19

    Research areas

  • Multi-device environments, Quality assessment, Sensing models

ID: 67891037