Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Advertisement

Springer Nature Link
Log in

HNQA: histogram-based descriptors for fast night-time image quality assessment

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

Taking high quality images at night is a challenging issue for many applications. Therefore, assessing the quality of night-time images (NTIs) is a significant area of research. Since there is no reference image for such images, night-time image quality assessment (NTQA) must be performed blindly. Although the field of blind quality assessment of natural images has gained significant popularity over the past decade, the quality assessment of NTIs usually confront complex distortions such as contrast loss, chroma noise, color desaturation, and detail blur, that have been less investigated. In this paper, a blind night-time image quality evaluation model is proposed by generating innovative quality-aware local feature maps, including detail exposedness, color saturation, sharpness, contrast, and naturalness. In the next step, these maps are compressed and converted into global feature representations using histograms. These feature histograms are used to learn a Gaussian process regression (GPR) quality prediction model. The suggested BIQA approach for night images undergoes a comprehensive evaluation on a standard night image database. The results of the experiments demonstrate the superior prediction performance of the proposed BIQA method for night images compared to other advanced BIQA methods despite its simplicity of implementation and execution speed. Hence, it is readily applicable in real-time scenarios.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Availability of data and materials

The data and code that support the findings of this study are openly available in NNID database: https://sites.google.com/site/xiangtaooo/. HNQA code: https://github.com/mkarimid/HNQA.

References

  1. Wang, Z.: Applications of objective image quality assessment methods. IEEE Signal Process. Mag. 28(6), 137–142 (2011)

    Article  Google Scholar 

  2. Zhai, G., Min, X.: Perceptual image quality assessment: a survey. Sci. China Inf. Sci. 63(11), 76–127 (2020)

    Article  Google Scholar 

  3. Zhan, Y., Zhang, R.: No-reference jpeg image quality assessment based on blockiness and luminance change. IEEE Signal Process. Lett. 24(6), 760–764 (2017)

    Article  Google Scholar 

  4. Gu, K., Zhai, G., Lin, W., Yang, X., Zhang, W.: No-reference image sharpness assessment in autoregressive parameter space. IEEE Trans. Image Process. 24(10), 3218–3231 (2015)

    Article  MathSciNet  Google Scholar 

  5. Tang, C., Yang, X., Zhai, G.: Noise estimation of natural images via statistical analysis and noise injection. IEEE Trans. Circuits Syst. Video Technol. 25(8), 1283–1294 (2015)

    Article  Google Scholar 

  6. Nafchi, H.Z., Cheriet, M.: Efficient no-reference quality assessment and classification model for contrast distorted images. IEEE Trans. Broadcast. 64(2), 518–523 (2018)

    Article  Google Scholar 

  7. Moorthy, A.K., Bovik, A.C.: Blind image quality assessment: from natural scene statistics to perceptual quality. IEEE Trans. Image Process. 20(12), 3350–3364 (2011)

    Article  MathSciNet  Google Scholar 

  8. Saad, M.A., Bovik, A.C., Charrier, C.: Blind image quality assessment: a natural scene statistics approach in the DCT domain. IEEE Trans. Image Process. 21(8), 3339–3352 (2012)

    Article  MathSciNet  Google Scholar 

  9. Liu, L., Dong, H., Huang, H., Bovik, A.C.: No-reference image quality assessment in curvelet domain. Signal Process. Image Commun. 29(4), 494–505 (2014)

    Article  Google Scholar 

  10. Mittal, A., Moorthy, A.K., Bovik, A.C.: No-reference image quality assessment in the spatial domain. IEEE Trans. Image Process. 21(12), 4695–4708 (2012)

    Article  MathSciNet  Google Scholar 

  11. Mittal, A., Soundararajan, R., Bovik, A.C.: Making a “completely blind” image quality analyzer. IEEE Signal Process. Lett. 20(3), 209–212 (2012)

    Article  Google Scholar 

  12. Zhang, L., Zhang, L., Bovik, A.C.: A feature-enriched completely blind image quality evaluator. IEEE Trans. Image Process. 24(8), 2579–2591 (2015)

    Article  MathSciNet  Google Scholar 

  13. Liu, L., Liu, B., Huang, H., Bovik, A.C.: No-reference image quality assessment based on spatial and spectral entropies. Signal Process. Image Commun. 29(8), 856–863 (2014)

    Article  Google Scholar 

  14. Xue, W., Mou, X., Zhang, L., Bovik, A.C., Feng, X.: Blind image quality assessment using joint statistics of gradient magnitude and Laplacian features. IEEE Trans. Image Process. 23(11), 4850–4862 (2014)

    Article  MathSciNet  Google Scholar 

  15. Gu, K., Tao, D., Qiao, J.-F., Lin, W.: Learning a no-reference quality assessment model of enhanced images with big data. IEEE Trans. Neural Netw. Learn. Syst. 29(4), 1301–1313 (2017)

    Article  Google Scholar 

  16. Wu, Q., Li, H., Meng, F., Ngan, K.N., Zhu, S.: No reference image quality assessment metric via multi-domain structural information and piecewise regression. J. Vis. Commun. Image Represent. 32, 205–216 (2015)

    Article  Google Scholar 

  17. Gu, K., Zhai, G., Yang, X., Zhang, W.: Using free energy principle for blind image quality assessment. IEEE Trans. Multimed. 17(1), 50–63 (2015)

    Article  Google Scholar 

  18. Li, Q., Lin, W., Xu, J., Fang, Y.: Blind image quality assessment using statistical structural and luminance features. IEEE Trans. Multimed. 18(12), 2457–2469 (2016)

    Article  Google Scholar 

  19. Wu, J., Zeng, J., Liu, Y., Shi, G., Lin, W.: Hierarchical feature degradation based blind image quality assessment. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 510–517 (2017)

  20. Bosse, S., Maniry, D., Muller, K.-R., Wiegand, T., Samek, W.: Deep neural networks for no-reference and full-reference image quality assessment. IEEE Trans. Image Process. 27(1), 206–219 (2017)

    Article  MathSciNet  Google Scholar 

  21. Zhang, W., Ma, K., Yan, J., Deng, D., Wang, Z.: Blind image quality assessment using a deep bilinear convolutional neural network. IEEE Trans. Circuits Syst. Video Technol. 30(1), 36–47 (2018)

    Article  Google Scholar 

  22. Yan, Q., Gong, D., Zhang, Y.: Two-stream convolutional networks for blind image quality assessment. IEEE Trans. Image Process. 28, 2200–2211 (2019)

    Article  MathSciNet  Google Scholar 

  23. Pan, Z., Yuan, F., Lei, J., Fang, Y., Shao, X., Kwong, S.T.W.: Vcrnet: visual compensation restoration network for no-reference image quality assessment. IEEE Trans. Image Process. 31, 1613–1627 (2022)

    Article  Google Scholar 

  24. Sun, S., Yu, T., Xu, J., Lin, J., Zhou, W., Chen, Z.: Graphiqa: learning distortion graph representations for blind image quality assessment. IEEE Trans. Multimed. 25, 2912–2925 (2022)

    Google Scholar 

  25. Han, J., Ma, K.: Fuzzy color histogram and its use in color image retrieval. IEEE Trans. Image Process. 11(8), 944–952 (2002)

    Article  Google Scholar 

  26. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60, 91–110 (2004)

    Article  Google Scholar 

  27. Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), vol. 1, pp. 886–893 (2005)

  28. Xiang, T., Yang, Y., Guo, S.: Blind night-time image quality assessment: subjective and objective approaches. IEEE Trans. Multimed. 22(5), 1259–1272 (2019)

    Article  Google Scholar 

  29. Hu, R., Liu, Y., Wang, Z., Li, X.: Blind quality assessment of night-time image. Displays 69, 102045 (2021)

    Article  Google Scholar 

  30. Wang, M., Huang, Y., Zhang, J.: Blind quality assessment of night-time images via weak illumination analysis. In: 2021 IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6 (2021)

  31. Li, Z.G., Zheng, J.H., Rahardja, S.: Detail-enhanced exposure fusion. IEEE Trans. Image Process. 21(11), 4672–4676 (2012)

    Article  MathSciNet  Google Scholar 

  32. Nejati, M., Karimi, M., Soroushmehr, S.R., Karimi, N., Samavi, S., Najarian, K.: Fast exposure fusion using exposedness function. In:2017 IEEE International Conference on Image Processing (ICIP), pp. 2234–2238 (2017)

  33. Rasmussen, C.E., Williams, C.K.: Gaussian Processes for Machine Learning. Springer, Berlin (2006)

    Google Scholar 

  34. Khalid, H., Ali, M., Ahmed, N.: Gaussian process-based feature-enriched blind image quality assessment. J. Vis. Commun. Image Represent. 77, 103092 (2021)

    Article  Google Scholar 

  35. Ahmed, N., Muhammad Shahzad Asif, H., Khalid, H.: PIQI: perceptual image quality index based on ensemble of Gaussian process regression. Multimed. Tools Appl. 80(10), 15677–15700 (2021)

    Article  Google Scholar 

  36. BT, R.I.R. Methodology for the subjective assessment of the quality of television pictures. International Telecommunication Union, 4 (2002)

Download references

Funding

The authors declare that no funds, grants or other support were received during the preparation of this manuscript.

Author information

Authors and Affiliations

  1. Department of Computer Science, Faculty of Mathematical Sciences, Shahrekord University, Shahrekord, 88186-34141, Iran

    Maryam Karimi

  2. Department of Electrical and Computer Engineering, Isfahan University of Technology, Isfahan, 84156-83111, Iran

    Mansour Nejati

Authors
  1. Maryam Karimi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mansour Nejati
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Maryam Karimi: conceptualization, methodology, software, validation, investigation, data curation, writing—original draft, writing—review and editing, visualization, project administration. Mansour Nejati: conceptualization, methodology, software, writing—review and editing, visualization, project administration.

Corresponding author

Correspondence to Maryam Karimi.

Ethics declarations

Conflict of interest

The authors declare that we have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants performed by any of the authors.

Additional information

Communicated by Qianqian Xu.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Karimi, M., Nejati, M. HNQA: histogram-based descriptors for fast night-time image quality assessment. Multimedia Systems 30, 259 (2024). https://doi.org/10.1007/s00530-024-01440-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s00530-024-01440-7

Keywords

Search

Navigation