Segmentation framework for heat loss identification in thermal images: empowering Scottish retrofitting and thermographic survey companies.

Hasan, Md. Junayed; Elyan, Eyad; Yan, Yijun; Ren, Jinchang; Sarker, Md. Mostafa Kamal

Abstract

Retrofitting and thermographic survey (TS) companies in Scotland collaborate with social housing providers to tackle fuel poverty. They employ ground-level infrared (IR) camera-based-TSs (GIRTSs) for collecting thermal images to identify the heat loss sources resulting from poor insulation. However, this identification process is labor-intensive and time-consuming, necessitating extensive data processing. To automate this, an AI-driven approach is necessary. Therefore, this study proposes a deep learning (DL)-based segmentation framework using the Mask Region Proposal Convolutional Neural Network (Mask RCNN) to validate its applicability to these thermal images. The objective of the framework is to automatically identify, and crop heat loss sources caused by weak insulation, while also eliminating obstructive objects present in those images. By doing so, it minimizes labor-intensive tasks and provides an automated, consistent, and reliable solution. To validate the proposed framework, approximately 2500 thermal images were collected in collaboration with industrial TS partner. Then, 1800 representative images were carefully selected with the assistance of experts and annotated to highlight the target objects (TO) to form the final dataset. Subsequently, a transfer learning strategy was employed to train the dataset, progressively augmenting the training data volume and fine-tuning the pre-trained baseline Mask RCNN. As a result, the final fine-tuned model achieved a mean average precision (mAP) score of 77.2% for segmenting the TO, demonstrating the significant potential of proposed framework in accurately quantifying energy loss in Scottish homes.

Citation

HASAN, M.J., ELYAN, E., YAN, Y., REN, J. and SARKER, M.M.K. 2024. Segmentation framework for heat loss identification in thermal images: empowering Scottish retrofitting and thermographic survey companies. In: Ren, J., Hussain, A., Liao, I.Y. et al. (eds.) Advances in brain inspired cognitive systems: proceedings of the 13th Brain-inspired cognitive systems 2023 (BICS 2023), 5-6 August 2023, Kuala Lumpur, Malaysia. Lecture notes in computer sciences, 14374. Cham: Springer [online], pages 220-228. Available from: https://doi.org/10.1007/978-981-97-1417-9_21

• Conference Name: 13th Brain-inspired cognitive systems international conference 2023 (BICS 2023)
• Conference Location: Kuala Lumpur, Malaysia
• Start Date: Aug 5, 2023
• End Date: Aug 6, 2023
• Acceptance Date: Jul 28, 2023
• Online Publication Date: May 22, 2024
• Publication Date: Dec 31, 2024
• Deposit Date: Jun 14, 2024
• Publicly Available Date: May 23, 2025
• Publisher: Springer
• Pages: 220-228
• Series Title: Lecture notes in computer science (LNCS)
• Series Number: 14374
• Series ISSN: 0302-9743; 1611-3349
• Book Title: Advances in brain inspired cognitive systems
• ISBN: 9789819714162
• DOI: https://doi.org/10.1007/978-981-97-1417-9_21
• Keywords: Infrared thermographic testing; Instance segmentation; Mask RCNN; Thermal images; Transfer learning
• Public URL: https://rgu-repository.worktribe.com/output/2344824