Skip to main content

Research Repository

Advanced Search

Improving human activity recognition with neural translator models.

Wijekoon, Anjana; Wiratunga, Nirmalie; Sani, Sadiq


Anjana Wijekoon

Sadiq Sani


Multiple sensor modalities provide more accurate Human Activity Recognition (HAR) compared to using a single modality, yet the latter is more convenient and less intrusive. It is advantages to create a model which learns from all available sensors; although it is challenging to deploy such model in an environment with fewer sensors, while maintaining reliable performance levels. We address this challenge with Neural Translator, capable of generating missing modalities from available modalities. These can be used to generate missing or 'privileged' modalities at deployment to improve HAR. We evaluate the translator with k-NN classifiers on the SelfBACK HAR dataset and achieve up-to 4.28% performance improvements with generated modalities. This suggests that non-intrusive modalities suited for deployment benefit from translators that generate missing modalities at deployment.

Start Date Jul 9, 2018
Publication Date Jul 12, 2018
Institution Citation WIJEKOON, A., WIRATUNGA, N. and SANI, S. 2018. Improving human activity recognition with neural translator models. In Minor, M. (ed.) Workshop proceedings for the 26th International conference on case-based reasoning (ICCBR 2018), 9-12 July 2018, Stockholm, Sweden. Stockholm: ICCBR [online], pages 96-100. Available from:
Keywords Human activity recognition; Machine learning; Privileged learning
Publisher URL


You might also like

Downloadable Citations