Skip to main content

Research Repository

Advanced Search

Crowdsourced Quality Assessment of Enhanced Underwater Images-A Pilot Study

Lin, Hanhe; Men, Hui; Yan, Yijun; Ren, Jinchang; Saupe, Dietmar


Hanhe Lin

Hui Men

Jinchang Ren

Dietmar Saupe


Underwater image enhancement (UIE) is essential for a high-quality underwater optical imaging system. While a number of UIE algorithms have been proposed in recent years, there is little study on image quality assessment (IQA) of enhanced underwater images. In this paper, we conduct the first crowdsourced subjective IQA study on enhanced underwater images. We chose ten state-of-the-art UIE algorithms and applied them to yield enhanced images from an underwater image benchmark. Their latent quality scales were reconstructed from pair comparison. We demonstrate that the existing IQA metrics are not suitable for assessing the perceived quality of enhanced underwater images. In addition, the overall performance of 10 UIE algorithms on the benchmark is ranked by the newly proposed simulated pair comparison of the methods.


LIN, H., MEN, H., YAN, Y., REN, J. and SAUPE, D. 2022. Crowdsourced quality assessment of enhanced underwater images: a pilot study. In Proceedings of 14th International conference on quality of multimedia experience 2022 (QoMEX 2022), 5-7 September 2022, Lippstadt, Germany. Piscataway: IEEE [online], article 9900904. Available from:

Conference Name 2022 14th International Conference on Quality of Multimedia Experience, QoMEX 2022
Conference Location Lippstadt, Germany
Start Date Sep 5, 2022
End Date Sep 7, 2022
Acceptance Date May 31, 2022
Online Publication Date Oct 4, 2022
Publication Date Dec 31, 2022
Deposit Date Oct 6, 2022
Publicly Available Date Oct 6, 2022
Publisher IEEE Institute of Electrical and Electronics Engineers
Series ISSN 2472-7814
Book Title Proceedings of 14th International conference on quality of multimedia experience 2022 (QoMEX 2022), 5-7 September 2022, Lippstadt, Germany
Keywords Underwater image; Image quality assessment; Image enhancement; Crowdsourcing
Public URL


LIN 2022 Crowdsourced quality assessment (AAM) (3.7 Mb)

Copyright Statement
© 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

You might also like

Downloadable Citations