Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.4108/ICST.MOBIMEDIA2009.7469guideproceedingsArticle/Chapter ViewAbstractPublication PagesConference Proceedingsacm-pubtype
research-article
Free access

Super-resolution reconstruction of video sequences based on back-projection and motion estimation

Published: 07 September 2009 Publication History
  • Get Citation Alerts
  • Abstract

    Bandwidth limitation and service costs are important factors when dealing with mobile multimedia contents' fruition. Super-resolution reconstruction might be a relevant solution, since it allows for restoring the original spatial resolution from low-resolution compressed data. In this way, both content and service providers, not to tell the final users, are relieved from the burden of providing and supporting large multimedia data transfer. In the proposed work, the high-resolution video sequence is reconstructed through iterative processing of inter-frame information and interpolative techniques. Resolution enhancement is based on iterative update of the high-resolution image estimate through motion and scene change detection. The devised technique is derived from the work of Irani and Peleg [8]. The main contribution of the proposed approach consists in the generalization of the transformation model through the exploitation of local change. Results are encouraging and prove that the devised scheme outperforms alternative techniques.

    References

    [1]
    R. Y. Tsai and T. S. Huang, "Multiframe image restoration and registration," in Advances in Computer Vision and Image Processing, R.Y. Tsai and T.S. Huang, Eds., vol. 1, pp. 317--339. JAI Press Inc., 1984.
    [2]
    R. A. Roberts and C. T. Mullis, Digital Signal Processing, Addison-Wesley, 1987.
    [3]
    A. M. Tekalp, M. K. Ozkan, and M. I. Sezan, "High-resolution image reconstruction from lower-resolution image sequences and space-varying image restoration," in Proc. of the IEEE Int. Conf. on Acoustics, Speech and Signal Processing, San Francisco, CA, vol. 3, pp. 169--172, 1992.
    [4]
    S. P. Kim, N. K. Bose, and H. M. Valenzuela, "Recursive reconstruction of high resolution image from noisy undersampled multiframes," IEEE Trans. on Acoustics, Speech and Signal Processing, vol. 38, no. 6, pp. 1013--1027, 1990.
    [5]
    D. Keren, S. Peleg, and R. Brada, "Image sequence enhancement using subpixel displacements," in Proc. of the IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, pp. 742--746, June 1988.
    [6]
    M. Irani and S. Peleg, "Super Resolution From Image Sequences," in Proc. of the 10th Int. Conf. on Pattern Recognition, Atlantic City, NJ, vol. 2, pp. 115--120, June 1990.
    [7]
    M. Irani and S. Peleg, "Improving resolution by image registration," CVGIP: Graphical Models and Image Processing, vol. 53, no. 3, pp. 231--239, May 1991.
    [8]
    M. Irani and S. Peleg, "Motion analysis for image enhancement: Resolution, occlusion and transparency," Journal of Visual Communications and Image Representation, vol. 4, no. 4, pp. 324--335, Dec. 1993.
    [9]
    K. Aizawa, T. Komatsu, and T. Saito, "Acquisition of very high resolution images using stereo cameras," Visual Communications and Image Processing Conf., 1991, Proc. SPIE, pp. 318--328, 1991.
    [10]
    B. R. Frieden and H. G. Aumann, "Image reconstruction from multiple 1-D scans using filtered localized projection," Applied Optics, vol. 26, no. 17, pp. 3615--3621, Sept. 1987.
    [11]
    S. Peleg, D. Keren, and L. Schweitzer, "Improving image resolution by using subpixel motion," Pattern Recognition Letters, vol. 5, no. 3, pp. 223--226, Mar 1987.
    [12]
    V. Avrin and I. Dinstein, "Local Motion Estimation and Resolution Enhancement of Video Sequences", in Proc. of the 14th IEEE Int. Conf. on Pattern Recognition, Washington, DC, USA, vol. 1, pp 539--541, Aug. 1998.
    [13]
    G. Messina, S. Battiato, M. Mancuso and A. Buemi, "Improving Image Resolution by Adaptive Back-Projection Correction Techniques," in Proc. of the IEEE Trans. on Consumer Electronics, vol. 48, no. 3, pp 409--416, Aug. 2002.
    [14]
    R. R. Schultz and R. L. Stevenson, "Extraction of high-resolution frames from video sequences," IEEE Trans. on Image Processing, vol. 5, no. 6, pp. 996--1011, June 1996.
    [15]
    H. Stark and P. Oskoui, "High-resolution image recovery from image-plane arrays, using convex projections," Journal of the Optical Society of America, Journal, A: Optics and Image Science, vol. 6, no. 11, pp. 1715--1726, 1989.
    [16]
    B. C. Tom and A. K. Katsaggelos, "An Iterative Algorithm for Improving the Resolution of Video Sequences," in Visual Communications and Image Processing, Orlando, FL, Proc. SPIE, vol. 2727, pp. 1430--1438, Mar. 1996.
    [17]
    B. C. Tom and A. K. Katsaggelos, "Resolution enhancement of video sequences using motion compensation," in Proc. of the IEEE Int. Conf. on Image Processing, Lausanne, Switzerland, vol. 1, pp. 713--716, Sept. 1996.
    [18]
    A. K. Katsaggelos, "A Multiple Input Image Restoration Approach," Journal of Visual Communication and Image Representation, vol. 1, no. 1, pp. 93--103, Sept. 1990.
    [19]
    R. Li, B. Zeng and M. L. Liou, "A new three-step search algorithm for block motion estimation," IEEE Trans. on Circuits and Systems for Video Technology, vol. 4, no. 4, pp 438--442, Aug. 1994.
    [20]
    X. Jing and L. P. Chau, "An efficient three-step search algorithm for block motion estimation," IEEE Trans. on Multimedia, vol. 6, no. 3, pp 435--438, June 2004.
    [21]
    Test video sequences: http://trace.eas.asu.edu/yuv/index.html.

    Cited By

    View all

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image Guide Proceedings
    Mobimedia '09: Proceedings of the 5th International ICST Mobile Multimedia Communications Conference
    September 2009
    360 pages
    ISBN:9789639799622

    Sponsors

    • ICST

    Publisher

    ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering)

    Brussels, Belgium

    Publication History

    Published: 07 September 2009

    Qualifiers

    • Research-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)4
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 10 Aug 2024

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Get Access

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media