Abstract
Underwater images often exhibit severe color deviations and degraded visibility, which limits many practical applications in ocean engineering. Although extensive research has been conducted into underwater image enhancement, little of which demonstrates the significant robustness and generalization for diverse real-world underwater scenes. In this paper, we propose an adaptive color correction algorithm based on the maximum likelihood estimation of Gaussian parameters, which effectively removes color casts of a variety of underwater images. A novel algorithm using weighted combination of gradient maps in HSV color space and absolute difference of intensity for accurate background light estimation is proposed, which circumvents the influence of white or bright regions that challenges existing physical model-based methods. To enhance contrast of resultant images, a piece-wise affine transform is applied to the transmission map estimated via background light differential. Finally, with the estimated background light and transmission map, the scene radiance is recovered by addressing an inverse problem of image formation model. Extensive experiments reveal that our results are characterized by natural appearance and genuine color, and our method achieves competitive performance with the state-of-the-art methods in terms of objective evaluation metrics, which further validates the better robustness and higher generalization ability of our enhancement model.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Change history
13 August 2022
Incorrect cover date was used, instead of 2022 it should be 2023.
References
Li C, Guo C, Ren W, Cong R, Hou J, Kwong S, Tao D. An underwater image enhancement benchmark dataset and beyond. IEEE Transactions on Image Processing, 2020, 29: 4376–4389
Fu X, Cao X. Underwater image enhancement with global-local networks and compressed-histogram equalization. Signal Processing: Image Communication, 2020, 86: 115892
Drews P Jr, do Nascimento E, Moraes F, Botelho S, Campos M. Transmission estimation in underwater single images. In: Proceedings of the IEEE International Conference on Computer Vision Workshops. 2013, 825–830
Galdran A, Pardo D, Picón A, Alvarez-Gila A. Automatic red-channel underwater image restoration. Journal of Visual Communication and Image Representation, 2015, 26: 132–145
Drews P L J, Nascimento E R, Botelho S S C, Campos M F M. Underwater depth estimation and image restoration based on single images. IEEE Computer Graphics and Applications, 2016, 36(2): 24–35
Peng Y T, Cosman P C. Single image restoration using scene ambient light differential. In: Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP). 2016, 1953–1957
Lu H, Li Y, Xu X, Li J, Liu Z, Li X, Yang J, Serikawa S. Underwater image enhancement method using weighted guided trigonometric filtering and artificial light correction. Journal of Visual Communication and Image Representation, 2016, 38: 504–516
Li C, Guo J, Guo C, Cong R, Gong J. A hybrid method for underwater image correction. Pattern Recognition Letters, 2017, 94: 62–67
Zhuang P, Li C, Wu J. Bayesian retinex underwater image enhancement. Engineering Applications of Artificial Intelligence, 2021, 101: 104171
Zhang W, Dong L, Zhang T, Xu W. Enhancing underwater image via color correction and Bi-interval contrast enhancement. Signal Processing: Image Communication, 2021, 90: 116030
Chen L, Jiang Z, Tong L, Liu Z, Zhao A, Zhang Q, Dong J, Zhou H. Perceptual underwater image enhancement with deep learning and physical priors. IEEE Transactions on Circuits and Systems for Video Technology, 2021, 31(8): 3078–3092
Li C, Anwar S, Hou J, Cong R, Guo C, Ren W. Underwater image enhancement via medium transmission-guided multi-color space embedding. IEEE Transactions on Image Processing, 2021, 30: 4985–5000
Wen H, Tian Y, Huang T, Gao W. Single underwater image enhancement with a new optical model. In: Proceedings of the 2013 IEEE International Symposium on Circuits and Systems (ISCAS). 2013, 753–756
Emberton S, Chittka L, Cavallaro A. Hierarchical rank-based veiling light estimation for underwater dehazing. In: Proceedings of the British Machine Vision Conference (BMVC). 2015, 125.1–125.12
Zhou Y, Wu Q, Yan K, Feng L, Xiang W. Underwater image restoration using color-line model. IEEE Transactions on Circuits and Systems for Video Technology, 2019, 29(3): 907–911
Iqbal K, Odetayo M, James A, Salam R A, Talib A Z H. Enhancing the low quality images using unsupervised colour correction method. In: Proceedings of the 2010 IEEE International Conference on Systems, Man and Cybernetics. 2010, 1703–1709
Ghani A S A, Isa N A M. Enhancement of low quality underwater image through integrated global and local contrast correction. Applied Soft Computing, 2015, 37: 332–344
Ghani A S A, Isa N A M. Underwater image quality enhancement through integrated color model with Rayleigh distribution. Applied Soft Computing, 2015, 27: 219–230
Wang Y, Zhang J, Cao Y, Wang Z. A deep CNN method for underwater image enhancement. In: Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP). 2017, 1382–1386
Dudhane A, Hambarde P, Patil P, Murala S. Deep underwater image restoration and beyond. IEEE Signal Processing Letters, 2020, 27: 675–679
Islam J, Xia Y, Sattar J. Fast underwater image enhancement for improved visual perception. IEEE Robotics and Automation Letters, 2020, 5(2): 3227–3234
Carlevaris-Bianco N, Mohan A, Eustice R M. Initial results in underwater single image dehazing. In: Proceedings of the Oceans 2010 MTS/IEEE Seattle. 2010, 1–8
Chiang J Y, Chen Y C. Underwater image enhancement by wavelength compensation and dehazing. IEEE Transactions on Image Processing, 2012, 21(4): 1756–1769
Lu H M, Li Y J, Zhang L F, Serikawa S. Contrast enhancement for images in turbid water. Journal of the Optical Society of America A, 2015, 32(5): 886–893
Li C Y, Guo J C, Cong R M, Pang Y W, Wang B. Underwater image enhancement by dehazing with minimum information loss and histogram distribution prior. IEEE Transactions on Image Processing, 2016, 25(12): 5664–5677
Peng Y T, Cosman P C. Underwater image restoration based on image blurriness and light absorption. IEEE Transactions on Image Processing, 2017, 26(4): 1579–1594
Berman D, Treibitz T, Avidan S. Diving into haze-lines: color restoration of underwater images. In: Proceedings of the British Machine Vision Conference (BMVC). 2017, 1–12
Wang Y, Liu H, Chau L P. Single underwater image restoration using adaptive attenuation-curve prior. IEEE Transactions on Circuits and Systems I: Regular Papers, 2018, 65(3): 992–1002
Peng Y T, Cao K, Cosman P C. Generalization of the dark channel prior for single image restoration. IEEE Transactions on Image Processing, 2018, 27(6): 2856–2868
Ancuti C, Ancuti C O, Haber T, Bekaert P. Enhancing underwater images and videos by fusion. In: Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition. 2012, 81–88
Fu X, Zhuang P, Huang Y, Liao Y, Zhang X P, Ding X. A Retinex-based enhancing approach for single underwater image. In: Proceedings of the 2014 IEEE International Conference on Image Processing (ICIP). 2014, 4572–4576
Zhang S, Wang T, Dong J, Yu H. Underwater image enhancement via extended multi-scale Retinex. Neurocomputing, 2017, 245: 1–9
Fu X, Fan Z, Ling M, Huang Y, Ding X. Two-step approach for single underwater image enhancement. In: Proceedings of the 2017 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS). 2017, 789–794
Ancuti C O, Ancuti C, De Vleeschouwer C, Bekaert P. Color balance and fusion for underwater image enhancement. IEEE Transactions on Image Processing, 2018, 27(1): 379–393
Ancuti C O, Ancuti C, De Vleeschouwer C, Sbert M. Color channel compensation (3C): a fundamental pre-processing step for image enhancement. IEEE Transactions on Image Processing, 2020, 29: 2653–2665
Li J, Skinner K A, Eustice R M, Johnson-Roberson M. WaterGAN: unsupervised generative network to enable real-time color correction of monocular underwater images. IEEE Robotics and Automation Letters, 2018, 3(1): 387–394
Zhu J Y, Park T, Isola P, Efros A A. Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE International Conference on Computer Vision. 2017, 2242–2251
Li C, Guo J, Guo C. Emerging from water: underwater image color correction based on weakly supervised color transfer. IEEE Signal Processing Letters, 2018, 25(3): 323–327
Guo Y, Li H, Zhuang P. Underwater image enhancement using a multiscale dense generative adversarial network. IEEE Journal of Oceanic Engineering, 2020, 45(3): 862–870
Li C, Anwar S, Porikli F. Underwater scene prior inspired deep underwater image and video enhancement. Pattern Recognition, 2020, 98: 107038
Berman D, Treibitz T, Avidan S. Non-local image dehazing. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2016, 1674–1682
Wang B, Li C. A visual hierarchical framework based model for underwater image enhancement. Frontiers of Computer Science, 2019, 13(3): 665–667
Wang B, Wei B, Kang Z, Hu L, Li C. Fast color balance and multi-path fusion for sandstorm image enhancement. Signal, Image and Video Processing, 2021, 15(3): 637–644
Gao S B, Zhang M, Zhao Q, Zhang X S, Li Y J. Underwater image enhancement using adaptive retinal mechanisms. IEEE Transactions on Image Processing, 2019, 28(11): 5580–5595
Xu Y, Wen J, Fei L, Zhang Z. Review of video and image defogging algorithms and related studies on image restoration and enhancement. IEEE Access, 2016, 4: 165–188
Yang M, Sowmya A. An underwater color image quality evaluation metric. IEEE Transactions on Image Processing, 2015, 24(12): 6062–6071
Finlayson G D, Trezzi E. Shades of gray and colour constancy. In: Proceedings of the Twelfth Color Imaging Conference: Color Science and Engineering Systems, Technologies, and Applications. 2004, 37–41
Land E H. The Retinex theory of color vision. Scientific American, 1977, 237(6): 108–128
Buchsbaum G. A spatial processor model for object colour perception. Journal of the Franklin Institute, 1980, 310(1): 1–26
van de Weijer J, Gevers T, Gijsenij A. Edge-based color constancy. IEEE Transactions on Image Processing, 2007, 16(9): 2207–2214
Kareem H H, Daway E G, Daway H G. No reference quality of the hazy images depending on transmission component estimation. IIUM Engineering Journal, 2019, 20(2): 70–77
Harris C, Stephens M. A combined corner and edge detector. In: Proceedings of the 4th Alvey Vision Conference. 1988, 147–151
Lowe D G. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 2004, 60(2): 91–110
Cheng M M, Mitra N J, Huang X L, Torr P H S, Hu S M. Global contrast based salient region detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 37(3): 569–582
Acknowledgements
This work was supported by Higher Education Scientific Research Project of Ningxia (NGY2017009).
Author information
Authors and Affiliations
Corresponding author
Additional information
Bo Wang received his PhD degree from the School of Electrical and Information Engineering, Tianjin University, China in 2016. He is currently a lecture in the School of Physics and Electronic-Electrical Engineering, Ningxia University, China. His research interests include image restoration and enhancement, image classification and medical image processing.
Zitong Kang received the BS degree from the School of Automation and Electronic Engineering, Qingdao University of Science and Technology, China in 2019. She is currently studying in the School of Physics, Electronic and Electrical Engineering, Ningxia University, China, majoring in Electronic and Communication Engineering. Her research interests include computer vision and data mining.
Pengwei Dong received the BS degree in Ningxia University, China in 2020. He is currently working toward the MS degree in School of Physics and Electronic-Electrical Engineering in Ningxia University, China. His research interests include remote sensing image enhancement and computer vision.
Fan Wang received the BS degree in University of South China, China in 2020. He is currently working toward the MS degree in School of Physics and Electronic-Electrical Engineering in Ningxia University, China. His research interests include medical image segmentation and computer vision.
Peng Ma received the BS degree in Ningxia University, China in 2020. He is currently working toward the MS degree in School of Physics and Electronic Electrical Engineering in Ningxia University, China. His research interests include computer vision and machine learning.
Jiajing Bai received the BS degree in Ningxia University, China in 2020. She is currently working toward the MS degree in School of Physics and Electronic-Electrical Engineering in Ningxia University, China. Her research interests include image processing and computer vision.
Pengwei Liang received the BS degree in Tianjin University of Technology, China in 2019. He is currently working toward the MS degree in School of Physics and Electronic-Electrical Engineering in Ningxia University, China. His research interests include image processing and computer vision.
Chongyi Li received the PhD degree from the School of Electrical and Information Engineering, Tianjin University, China in June 2018. From 2016 to 2017, he was a joint-training PhD Student with Australian National University, Australia. He was a postdoctoral fellow with the Department of Computer Science, City University of Hong Kong, China. He is currently a research fellow with the School of Computer Science and Engineering, Nanyang Technological University (NTU), Singapore. His current research focuses on image processing, computer vision, and deep learning, particularly in the domains of image restoration and enhancement.
Electronic supplementary material
Rights and permissions
About this article
Cite this article
Wang, B., Kang, Z., Dong, P. et al. Underwater image enhancement by maximum-likelihood based adaptive color correction and robust scattering removal. Front. Comput. Sci. 17, 172702 (2023). https://doi.org/10.1007/s11704-022-1205-7
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11704-022-1205-7