Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

No-reference stereo image quality assessment based on discriminative sparse representation

Published: 01 September 2021 Publication History

Abstract

The quality of images could be degraded through processing, compression, and transmission. This has created a fundamental need for perceptual quality assessment methods in multimedia services. The use of 3D stereo imaging is rapidly increasing. The quality assessment of stereo images is different from their 2D counterparts. Various algorithms have been devised in this field, mainly based on feature extraction. However, the objective quality scores are not sufficiently correlated with human judgments, or they are not fast enough because of using stereo matching and fusion techniques. In this paper, a fast-efficient algorithm is proposed for blind quality assessment of stereoscopic images. A supervised dictionary learning approach for discriminative sparse representation is applied as an automatic feature discovery framework. Based on this framework, discriminative distortion-specific bases are learned on structural features from stereoscopic images based upon discriminative dictionary learning. The over-complete bases are suitable for sparse representation of samples from the same distortion class. Given these features, an SVR is trained for the no-reference quality assessment of stereoscopic images. The experimental results show that the proposed method has achieved an overall correlation of 97% with subjective scores on common datasets so that its superiority compared to the state-of-the-art methods is up to 2%. Furthermore, our method is computationally efficient and evaluates the quality of stereo images much faster than the competing methods making it qualified for real-time applications.

References

[1]
Aharon M, Elad M, and Bruckstein A K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation IEEE Trans Signal Process 2006 54 11 4311-4322
[2]
Akhter R, Sazzad ZP, Horita Y, and Baltes J No-reference stereoscopic image quality assessment Stereoscopic Displays and Applications XXI 2010 7524 75240T
[3]
Appina B, Khan S, and Channappayya SS No-reference stereoscopic image quality assessment using natural scene statistics Signal Process Image Comm 2016 43 1-14
[4]
Benoit A, Le Callet P, Campisi P, Cousseau R (2009) Quality assessment of stereoscopic images. EURASIP J Image Video Process 2008(1):659024
[5]
Bensalma R, Larabi MC (2010) Towards a perceptual quality metric for color stereo images. In 17th IEEE Int Conf Image Process (ICIP 2010) 4037–4040
[6]
Chen MJ, Su CC, Kwon DK, Cormack LK, and Bovik AC Full-reference quality assessment of stereopairs accounting for rivalry Signal Process Image Comm 2013 28 9 1143-1155
[7]
Chen M-J, Cormack LK, and Bovik AC No-reference quality assessment of natural stereopairs IEEE Trans Image Process 2013 22 9 3379-3391
[8]
Hachicha W, Kaaniche M, Beghdadi A, Cheikh FA (2017) No-reference stereo image quality assessment based on joint wavelet decomposition and statistical models. Signal Process Image Commun 54:107–117
[9]
Jiang G, Xu H, Yu M, Luo T, and Zhang Y Stereoscopic image quality assessment by learning non-negative matrix factorization-based color visual characteristics and considering binocular interactions” J Vis Commun Image Represent 2017 46 269-279
[10]
Jiang Q, Shao F, Gao W, Chen Z, Jiang G, and Ho YS Unified no-reference quality assessment of singly and multiply distorted stereoscopic images IEEE Trans Image Process 2018 28 4 1866-1881
[11]
Jiang Z, Lin Z, and Davis LS Label consistent K-SVD: Learning a discriminative dictionary for recognition IEEE Trans Pattern Analysis Machine Intellig 2013 35 11 2651-2664
[12]
Karimi M, Samavi S, Karimi N, Soroushmehr SR, Lin W, and Najarian K Pyramidal modeling of geometric distortions for retargeted image quality evaluation Multimedia Tools Applications 2018 77 11 13799-13820
[13]
Karimi M, Soltanian N, Samavi S, Najarian K, Karimi N, and Soroushmehr SR Blind stereo image quality assessment inspired by brain sensory-motor fusion Digital Signal Process 2019 91 91-104
[14]
Karimi M, Nejati M, Soroushmehr SR, Samavi S, Karimi N, and Najarian K Blind stereo quality assessment based on learned features from binocular combined images IEEE Trans Multimedia. 2017 19 11 2475-89
[15]
Liao X, Yin J, Chen M, Qin Z (2020) Adaptive payload distribution in multiple images steganography based on image texture features. IEEE Trans Dependable Secure Comput
[16]
Liao X, Li K, Zhu X, and Liu KR Robust detection of image operator chain with two-stream convolutional neural network IEEE Journal of Selected Topics in Signal Processing 2020 14 5 955-968
[17]
Lin Y-H and Wu J-L Quality assessment of stereoscopic 3D image compression by binocular integration behaviors IEEE Trans Image Process 2014 23 4 1527-1542
[18]
Lin Y, Yang J, Lu W, Meng Q, Lv Z, and Song H Quality index for stereoscopic images by jointly evaluating cyclopean amplitude and cyclopean phase IEEE Journal of Selected Topics in Signal Processing 2017 11 1 89-101
[19]
Liu L, Liu B, Su C, Huang H, and Bovik AC Binocular spatial activity and reverse saliency driven no-reference stereopair quality assessment Signal Process Image Comm 2017 58 287-299
[20]
Liu TJ, Lin CT, Liu HH, and Pei SC Blind stereoscopic image quality assessment based on hierarchical learning IEEE Access 2019 7 8058-8069
[21]
Lowe DG Distinctive image features from scale-invariant keypoints International journal of computer vision 2004 60 2 91-110
[22]
Liu C, Yuen J, and Torralba A Sift flow: Dense correspondence across scenes and its applications IEEE Trans pattern analysis and machine intellig 2011 33 5 978-994
[23]
Ma J, An P, Shen L, and Li K Reduced-reference stereoscopic image quality assessment using natural scene statistics and structural degradation IEEE Access 2018 6 2768-2780
[24]
Mairal J, Bach F, and Ponce J Task-driven dictionary learnin IEEE trans pattern analysis machine intellig 2012 34 4 791-804
[25]
Messai O, Hachouf F, Seghir ZA (2020) AdaBoost neural network and cyclopean view for no-reference stereoscopic image quality assessment. Signal Process Image Commun 82:115772
[26]
Mittal A, Moorthy AK, and Bovik AC No-reference image quality assessment in the spatial domain IEEE Trans on Image Process 2012 21 12 4695-4708
[27]
Moorthy AK and Bovik AC Blind image quality assessment: From natural scene statistics to perceptual quality IEEE Trans Image Process 2011 20 12 3350-3364
[28]
Moorthy A, Su CC, Chen MJ, Mittal A, Cormack LK, Bovik AC (2013a) LIVE 3D image quality database Phase I. [Online]. Available: http://live.ece.utexas.edu/research/quality/live_3dimage_phase1.html
[29]
Moorthy A, Su CC, Chen MJ, Mittal A, Cormack LK, Bovik AC (2013b) LIVE 3D image quality database Phase II. [Online]. Available: http://live.ece.utexas.edu/research/quality/live_3dimage_phase2.html
[30]
Nejati M, Samavi S, Karimi N, Soroushmehr SR, and Najarian K Boosted dictionary learning for image compression IEEE Trans Image Process 2016 25 10 4900-4915
[31]
Nejati M, Samavi S, Derksen H, and Najarian K Denoising by low-rank and sparse representations J Vis Commun Image Represent 2016 36 28-39
[32]
Pati YC, Rezaiifar R, Krishnaprasad PS (1993) Orthogonal matching pursuit: Recursive function approximation with applications to wavelet decomposition. In 1993 Conference Record of the Twenty-Seventh Asilomar. IEEE Conf Signals Syst Comput 40–44
[33]
Saad MA, Bovik AC, and Charrier C A DCT statistics-based blind image quality index IEEE Signal Process Letters 2010 17 6 583-586
[34]
Shao F, Lin W, Gu S, Jiang G, and Srikanthan T Perceptual full-reference quality assessment of stereoscopic images by considering binocular visual characteristics IEEE Trans Image Process 2013 22 5 1940-1953
[35]
Shao F, Li K, Lin W, Jiang G, Yu M, and Dai Q Full-reference quality assessment of stereoscopic images by learning binocular receptive field properties IEEE Trans Image Process 2015 24 10 2971-2983
[36]
Shao F, Li K, Lin W, Jiang G, and Yu M Using binocular feature combination for blind quality assessment of stereoscopic images IEEE Signal Process Letters 2015 22 10 1548-1551
[37]
Shao F, Li K, Lin W, Jiang G, and Dai Q Learning blind quality evaluator for stereoscopic images using joint sparse representation IEEE Trans Multimedia 2016 18 10 2104-2114
[38]
Shi Y, Guo W, Niu Y, Zhan J (2020) No-reference stereoscopic image quality assessment using a multi-task CNN and registered distortion representation. Pattern Recognit 100:107168
[39]
Su C-C, Cormack LK, and Bovik AC Oriented correlation models of distorted natural images with application to natural stereopair quality evaluation IEEE Trans Image Process 2015 24 5 1685-1699
[40]
Wan Z, Gu K, Zhao D (2019) Reduced Reference Stereoscopic Image Quality Assessment Using Sparse Representation and Natural Scene Statistics. IEEE Trans Multimed
[41]
Wang Z, Bovik AC, Sheikh HR, and Simoncelli EP Image quality assessment: from error visibility to structural similarity IEEE Trans Image Process 2004 13 4 600-612
[42]
Wang Z, Simoncelli EP, Bovik AC (2004) Multi-scale structural similarity for image quality assessment. In the 37th Asilomar Conf Signals Syst Comput 1398–1402
[43]
Wang J, Rehman A, Zeng K, Wang S, and Wang Z Quality prediction of asymmetrically distorted stereoscopic 3D images IEEE Trans Image Process 2015 24 11 3400-3414
[44]
Yang J, Liu Y, Gao Z, Chu R, and Song Z A perceptual stereoscopic image quality assessment model accounting for binocular combination behavior J Vis Commun Image Represent 2015 31 138-145
[45]
Zhou W, Zhang S, Pan T, Yu L, Qiu W, Zhou Y, and Luo T Blind 3D image quality assessment based on self-similarity of binocular features Neurocomputing 2017 224 128-134
[46]
Zhou W and Yu L Binocular responses for no-reference 3D image quality assessment IEEE Trans Multimedia 2016 18 6 1077-1084
[47]
Zhou W, Qiu W, and Wu MW Utilizing dictionary learning and machine learning for blind quality assessment of 3-D images IEEE Trans Broadcast 2017 63 2 404-415

Index Terms

  1. No-reference stereo image quality assessment based on discriminative sparse representation
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Information & Contributors

          Information

          Published In

          cover image Multimedia Tools and Applications
          Multimedia Tools and Applications  Volume 80, Issue 21-23
          Sep 2021
          1592 pages

          Publisher

          Kluwer Academic Publishers

          United States

          Publication History

          Published: 01 September 2021
          Accepted: 23 July 2021
          Revision received: 26 January 2021
          Received: 18 October 2020

          Author Tags

          1. Blind image quality assessment
          2. Discriminative dictionary learning
          3. No-reference quality assessment
          4. Sparse representation
          5. Stereo image quality assessment

          Qualifiers

          • Research-article

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • 0
            Total Citations
          • 0
            Total Downloads
          • Downloads (Last 12 months)0
          • Downloads (Last 6 weeks)0
          Reflects downloads up to 25 Jan 2025

          Other Metrics

          Citations

          View Options

          View options

          Figures

          Tables

          Media

          Share

          Share

          Share this Publication link

          Share on social media