Improving human activity recognition with neural translator models.

Wijekoon, Anjana; Wiratunga, Nirmalie; Sani, Sadiq

Abstract

Multiple sensor modalities provide more accurate Human Activity Recognition (HAR) compared to using a single modality, yet the latter is more convenient and less intrusive. It is advantages to create a model which learns from all available sensors; although it is challenging to deploy such model in an environment with fewer sensors, while maintaining reliable performance levels. We address this challenge with Neural Translator, capable of generating missing modalities from available modalities. These can be used to generate missing or 'privileged' modalities at deployment to improve HAR. We evaluate the translator with k-NN classifiers on the SelfBACK HAR dataset and achieve up-to 4.28% performance improvements with generated modalities. This suggests that non-intrusive modalities suited for deployment benefit from translators that generate missing modalities at deployment.

Citation

WIJEKOON, A., WIRATUNGA, N. and SANI, S. 2018. Improving human activity recognition with neural translator models. In Minor, M. (ed.) Workshop proceedings for the 26th International conference on case-based reasoning (ICCBR 2018), 9-12 July 2018, Stockholm, Sweden. Stockholm: ICCBR [online], pages 96-100. Available from: http://iccbr18.com/wp-content/uploads/ICCBR-2018-V3.pdf#page=96

• Presentation Conference Type: Conference Paper (published)
• Conference Name: 26th International conference on case-based reasoning (ICCBR 2018)
• Start Date: Jul 9, 2018
• End Date: Jul 12, 2018
• Acceptance Date: Jul 12, 2018
• Online Publication Date: Jul 12, 2018
• Publication Date: Jul 12, 2018
• Deposit Date: Feb 4, 2019
• Publicly Available Date: Feb 4, 2019
• Peer Reviewed: Peer Reviewed
• Keywords: Human activity recognition; Machine learning; Privileged learning
• Public URL: http://hdl.handle.net/10059/3280
• Publisher URL: http://iccbr18.com/wp-content/uploads/ICCBR-2018-V3.pdf#page=96
• Contract Date: Feb 4, 2019