MDAR: a multiscale features-based network for remotely measuring human heart rate utilizing dual-branch architecture and alternating frame shifts in facial videos.

Zhang, Linhua; Ren, Jinchang; Zhao, Shuang; Wu, Peng

Abstract

Remote photoplethysmography (rPPG) refers to a non-contact technique that measures heart rate through analyzing the subtle signal changes of facial blood flow captured by video sensors. It is widely used in contactless medical monitoring, remote health management, and activity monitoring, providing a more convenient and non-invasive way to monitor heart health. However, factors such as ambient light variations, facial movements, and differences in light absorption and reflection pose challenges to deep learning-based methods. To solve these difficulties, we put forward a measurement network of heart rate based on multiscale features. In this study, we designed and implemented a dual-branch signal processing framework that combines static and dynamic features, proposing a novel and efficient method for feature fusion, enhancing the robustness and reliability of the signal. Furthermore, we proposed an alternate time-shift module to enhance the model's temporal depth. To integrate the features extracted at different scales, we utilized a multiscale feature fusion method, enabling the model to accurately capture subtle changes in blood flow. We conducted cross-validation on three public datasets: UBFC-rPPG, PURE, and MMPD. The results demonstrate that MDAR not only ensures fast inference speed but also significantly improves performance. The two main indicators, MAE and MAPE, achieved improvements of at least 30.6% and 30.2%, respectively, surpassing state-of-the-art methods. These conclusions highlight the potential advantages of MDAR for practical applications.

Citation

ZHANG, L., REN, J., ZHAO, S. and WU, P. 2024. MDAR: a multiscale features-based network for remotely measuring human heart rate utilizing dual-branch architecture and alternating frame shifts in facial videos. Sensors [online], 24(21), article number 6791. Available from: https://doi.org/10.3390/s24216791

• Journal Article Type: Article
• Acceptance Date: Oct 21, 2024
• Online Publication Date: Oct 22, 2024
• Publication Date: Nov 15, 2024
• Deposit Date: Nov 11, 2024
• Publicly Available Date: Nov 11, 2024
• Journal: Sensors
• Print ISSN: 1424-3210
• Electronic ISSN: 1424-8220
• Publisher: MDPI
• Peer Reviewed: Peer Reviewed
• Volume: 24
• Issue: 21
• Article Number: 6791
• DOI: https://doi.org/10.3390/s24216791
• Keywords: Dual-branch architecture; Alternating frame shifts; Multiscale features; rPPG
• Public URL: https://rgu-repository.worktribe.com/output/2577298