article

QoS Control Strategies for High-Quality Video Processing

Authors:

Clemens C. Wüst,

Liesbeth Steffens,

Wim F. Verhaegh,

Reinder J. Bril,

Christian HentschelAuthors Info & Claims

Real-Time Systems, Volume 30, Issue 1-2

Pages 7 - 29

https://doi.org/10.1007/s11241-005-0502-1

Published: 01 May 2005 Publication History

Abstract

Video processing in software is often characterized by highly fluctuating, content-dependent processing times, and a limited tolerance for deadline misses. We present an approach that allows close-to-average-case resource allocation to a single video processing task, based on asynchronous, scalable processing, and QoS adaptation. The QoS adaptation balances different QoS parameters that can be tuned, based on user-perception experiments: picture quality, deadline misses, and quality changes. We model the balancing problem as a discrete stochastic decision problem, and propose two solution strategies, based on a Markov decision process and reinforcement learning, respectively. We enhance both strategies with a compensation for structural (non-stochastic) load fluctuations. Finally, we validate our approach by means of simulation experiments, and conclude that both enhanced strategies perform close to the theoretical optimum.

References

[1]

Audsley, N. C., Burns, A., Davis, R. I., and Wellings, A. J. 1995. Integrating unbounded software components into hard real-time systems. In S. Natarajan (ed.), Imprecise and Approximate Computation, Kluwer Academic Publishers, Dordrecht, The Netherlands, pp. 63-86.

[2]

Bellman, R. E. 1957. Dynamic Programming. Princeton, NJ: Princeton University Press.

[3]

Braspenning, R. A., de Haan, G., and Hentschel, C. 2002. Complexity scalable motion estimation. In Proc. SPIE, Vol. 4671, Visual Communications and Image Processing, San José, CA, pp. 442-453.

[4]

Bril, R. J., and Steffens, E. F. M. 2001. User focus in consumer terminals and conditionally guaranteed budgets. In Proc. 9th International Workshop on Quality of Service (IWQoS), Karlsruhe, Germany, Vol. 2092 of Lecture Notes in Computer Science (LNCS), Springer Verlag, pp. 107-120.

[5]

Bril, R. J., Hentschel, C., Steffens, E. F. M., Gabrani, M., Van Loo, G. C., and Gelissen, J. H. A. 2001. Multimedia QoS in consumer terminals. In Proc. IEEE Workshop on Signal Processing Systems (SIPS), Antwerp, Belgium, pp. 332-343.

[6]

Bril, R. J. 2004. Real-time scheduling for media processing using conditionally guaranteed budgets. PhD thesis, Technische Universiteit Eindhoven, The Netherlands.

[7]

Buttazzo, G. C. 1997. Hard Real-Time Computing Systems: Predictable Scheduling Algorithms and Applications. Dordrecht, The Netherlands: Kluwer Academic Publishers.

[8]

García Valls, M., Alonso, A., Ruíz, J. F., and Groba, A. 2002. An architecture of a Quality of Service resource manager for flexible multimedia embedded systems. In Proc. 3rd International Workshop on Software Engineering and Middleware (SEM), Orlando, FL, Vol. 2596 of Lecture Notes in Computer Science (LNCS), Springer Verlag, pp. 39-57.

[9]

Hamann, C.-J., Löser, J., Reuther, L., Schönberg, S., Wolter, J., and Härtig, H. 2001. Quality-assuring scheduling: Using stochastic behavior to improve resource utilization. In Proc. 22nd IEEE Real-Time Systems Symposium (RTSS), London, UK, pp. 119-128.

[10]

Hentschel, C., Bril, R. J., Gabrani, M., Steffens, L., Van Zon, K., and Van Loo, S. 2001. Scalable video algorithms and dynamic resource management for consumer terminals. In Proc. International Conference on Media Futures (ICMF), Florence, Italy, pp. 193-196.

[11]

Hentschel, C., Bril, R. J., Chen, Y., Braspenning, R., and Lan, T.-H. 2003. Video Quality-of-Service for consumer terminals: a novel system for programmable components. IEEE Transactions on Consumer Electronics 49(4): 1367-1377.

Digital Library

[12]

Isović, D., Fohler, G., and Steffens, L. 2003. Timing constraints of MPEG-2 decoding for high-quality video: Misconceptions and realistic assumptions. In Proc. 15th Euromicro Conference on Real-Time Systems (ECRTS), Porto, Portugal, pp. 73-82.

[13]

Isović, D., and Fohler, G. 2004. Quality aware MPEG-2 stream adaptation in resource constrained systems. In Proc. 16th Euromicro Conference on Real-Time Systems (ECRTS), Catania, Italy, pp. 23-32.

[14]

Klein, M. H., Ralya, T., Pollak, B., Obenza, R., and González Harbour, M. 1993. A Practitioner's Handbook for Real-Time Analysis: Guide to Rate Monotonic Analysis for Real-Time Systems. Dordrecht, The Netherlands: Kluwer Academic Publishers.

[15]

Koren, G., and Shasha, D. 1995. Skip-over: Algorithms and complexity for overloaded systems that allow skips. In Proc. 16th IEEE Real-Time Systems Symposium (RTSS), Pisa, Italy, pp. 110-117.

[16]

Lan, T., Chen, Y., and Zhong, Z. 2001. MPEG2 decoding complexity regulation for a media processor. In Proc. Fourth IEEE Workshop on Multimedia Signal Processing (MMSP), Cannes, France, pp. 193-198.

[17]

Lee, C., Lehoczky, J., Rajkumar, R., and Siewiorek, D. 1999. On quality of service optimization with discrete QoS options. In Proc. Fifth IEEE Real-Time Technology and Applications Symposium (RTAS), Vancouver, Canada, pp. 276-286.

[18]

Lu, C., Stankovic, J. A., Tao, G., and Son, S. H. 1999. Design and evaluation of a feedback control EDF scheduling algorithm. In Proc. 20th IEEE Real-Time Systems Symposium (RTSS), Phoenix, AZ, pp. 56-67.

[19]

Lu, C., Stankovic, J. A., Abdelzaher, T. F., Tao, G., Son, S. H., and Marley, M. 2000. Performance specifications and metrics for adaptive real-time systems. In Proc. 21st IEEE Real-Time Systems Symposium (RTSS), Orlando, FL, pp. 13-23.

[20]

Mietens, S., de With, P. H. N., and Hentschel, C. 2004. Computational-complexity scalable motion estimation for mobile MPEG encoding. In IEEE Transactions on Consumer Electronics 50(1): 281-291.

Digital Library

[21]

Oppenheim, A. V., and Schafer, R. W. 1975. Digital Signal Processing. Englewood Cliffs, NJ: Prentice-Hall.

[22]

Otero Pérez, C. M., and Nitescu, I. 2002. Quality of Service resource management for consumer terminals: demonstrating the concepts. In Proc. Work-in-Progress Session 14th Euromicro Conference on Real-Time Systems (ECRTS), Vienna, Austria, pp. 29-32.

[23]

Otero Pérez, C. M., Steffens, L., Van der Stok, P., Van Loo, S., Alonso, A., Ruíz, J. F., Bril, R. J., and García Valls, M. 2003. QoS-based resource management for ambient intelligence. In T. Basten, M. Geilen, and H. de Groot (ed.), Ambient Intelligence: Impact on Embedded System Design, Kluwer Academic Publishers, Dordrecht, The Netherlands, pp. 159-182.

[24]

Peng, S. 2001. Complexity scalable video decoding via IDCT data pruning. In Digest of technical papers IEEE International Conference on Consumer Electronics (ICCE), Los Angeles, CA, pp. 74-75.

[25]

Puterman, M. L. 1994. Markov Decision Processes: Discrete Stochastic Dynamic Programming. New York: Wiley-Interscience.

[26]

Rajkumar, R., Juvva, K., Molano, A., and Oikawa, S. 1998. Resource kernels: A resource-centric approach to real-time and multimedia systems. In Proc. SPIE. Vol. 3310, Conference on Multimedia Computing and Networking, San José, CA, pp. 150-164.

[27]

Sha, L., Lehoczky, J. P., and Rajkumar, R. 1986. Solutions for some practical problems in prioritized preemptive scheduling. In Proc. 7th IEEE Real-Time Systems Symposium (RTSS), New Orleans, LA, pp. 181- 191.

[28]

Slavenburg, G. A., Rathnam, S., and Dijkstra, H. 1996. The TriMedia TM-1 PCI VLIW mediaprocessor. In Proc. Eight IEEE Symposium on High-Performance Chips (Hot Chips 8), Stanford, CA, pp. 171-177.

[29]

Steinmetz, R. 1996. Human perception of jitter and media synchronization. IEEE Journal on Selected Areas in Communications 14(1): 61-72.

Digital Library

[30]

Sutton, R. S., and Barto, A. G. 1998. Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press.

Digital Library

[31]

Wüst, C. C., and Verhaegh, W. F. J. 2004a. Quality control for scalable media processing applications. Journal of Scheduling 7(2): 105-117.

[32]

Wüst, C. C., and Verhaegh, W. F. J. 2004b. Dynamic control of scalable media processing applications. In W. Verhaegh, E. Aarts, and J. Korst (ed.), Algorithms in Ambient Intelligence, Kluwer Academic Publishers, Dordrecht, The Netherlands, pp. 259-276.

[33]

Zhao, W., Chew Lim, C., Liu, J. W. S., and Alexander, P. D. 1995. Overload management by imprecise computation. In S. Natarajan, (ed.), Imprecise and Approximate Computation, Kluwer Academic Publishers, Dordrecht, The Netherlands, pp. 1-22.

[34]

Zhong, Z., Chen, Y., and Lan, T.-H. 2002. Signal adaptive processing in MPEG-2 decoders with embedded resizing for interlaced video. In Proc. SPIE, Vol. 4671, Visual Communications and Image Processing, San José, CA, pp. 434-441.

Cited By

Gao GWen YWestphal C(2019)Dynamic Priority-Based Resource Provisioning for Video Transcoding With Heterogeneous QoSIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2018.284035129:5(1515-1529)Online publication date: 1-May-2019
https://dl.acm.org/doi/10.1109/TCSVT.2018.2840351
Cucinotta TChecconi FAbeni LPalopoli L(2013)Adaptive real-time scheduling for legacy multimedia applicationsACM Transactions on Embedded Computing Systems10.1145/2362336.236235311:4(1-23)Online publication date: 1-Jan-2013
https://dl.acm.org/doi/10.1145/2362336.2362353
Cucinotta TAbeni LPalopoli LLipari G(2011)A Robust Mechanism for Adaptive Scheduling of Multimedia ApplicationsACM Transactions on Embedded Computing Systems10.1145/2043662.204367010:4(1-24)Online publication date: 1-Nov-2011
https://dl.acm.org/doi/10.1145/2043662.2043670
Show More Cited By

Index Terms

QoS Control Strategies for High-Quality Video Processing

Recommendations

QoS Control Strategies for High-Quality Video Processing
ECRTS '04: Proceedings of the 16th Euromicro Conference on Real-Time Systems

Video processing in software is often characterized byhighly fluctuating, content-dependent processing times, anda limited tolerance for deadline misses. We present anapproach that allows close-to-average-case resource allocationto a single video ...
Near optimal fair delay based resource allocation for video traffic over wireless multimedia system

The major issue related to the realization of wireless multimedia system is the design of suitable medium access control (MAC) protocol. The design challenge is to maximize the utilization of the limited wireless resources while guaranteeing the various ...
Soft QoS in Call Admission Control for Wireless Personal Communications

In wireless multimedia communication systems, call admission control (CAC) is critical for simultaneously achieving a high resource utilization efficiency and maintaining quality-of-service (QoS) to mobile users. User mobility, heterogeneous nature of ...

Comments

Information & Contributors

Information

Published In

cover image Real-Time Systems

Real-Time Systems Volume 30, Issue 1-2

May 2005

145 pages

ISSN:0922-6443

Issue’s Table of Contents

Copyright © Copyright © 2005 Springer Science + Business Media, Inc.

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 May 2005

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 09 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Gao GWen YWestphal C(2019)Dynamic Priority-Based Resource Provisioning for Video Transcoding With Heterogeneous QoSIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2018.284035129:5(1515-1529)Online publication date: 1-May-2019
https://dl.acm.org/doi/10.1109/TCSVT.2018.2840351
Cucinotta TChecconi FAbeni LPalopoli L(2013)Adaptive real-time scheduling for legacy multimedia applicationsACM Transactions on Embedded Computing Systems10.1145/2362336.236235311:4(1-23)Online publication date: 1-Jan-2013
https://dl.acm.org/doi/10.1145/2362336.2362353
Cucinotta TAbeni LPalopoli LLipari G(2011)A Robust Mechanism for Adaptive Scheduling of Multimedia ApplicationsACM Transactions on Embedded Computing Systems10.1145/2043662.204367010:4(1-24)Online publication date: 1-Nov-2011
https://dl.acm.org/doi/10.1145/2043662.2043670
Alt ASimon D(2010)Control strategies for H.264 video decoding under resources constraintsACM SIGOPS Operating Systems Review10.1145/1842733.184274344:3(53-58)Online publication date: 17-Aug-2010
https://dl.acm.org/doi/10.1145/1842733.1842743
Alt ASimon D(2010)Control strategies for H.264 video decoding under resources constraintsProceedings of the Fifth International Workshop on Feedback Control Implementation and Design in Computing Systems and Networks10.1145/1791204.1791207(13-18)Online publication date: 13-Apr-2010
https://dl.acm.org/doi/10.1145/1791204.1791207
Peng HLin Y(2010)An optimal warning-zone-length assignment algorithm for real-time and multiple-QoS on-chip bus arbitrationACM Transactions on Embedded Computing Systems10.1145/1721695.17217019:4(1-39)Online publication date: 6-Apr-2010
https://dl.acm.org/doi/10.1145/1721695.1721701
Ma ZCatthoor F(2010)Run-time Task Overlapping on Multiprocessor PlatformsJournal of Signal Processing Systems10.1007/s11265-008-0302-760:2(169-182)Online publication date: 1-Aug-2010
https://dl.acm.org/doi/10.1007/s11265-008-0302-7
Albers RSuijs EDe With P(2009)Resource prediction and quality control for parallel execution of heterogeneous medical imaging tasksProceedings of the 16th IEEE international conference on Image processing10.5555/1819298.1819377(2293-2296)Online publication date: 7-Nov-2009
https://dl.acm.org/doi/10.5555/1819298.1819377
Hansson AGoossens KBekooij MHuisken J(2009)CoMPSoCACM Transactions on Design Automation of Electronic Systems10.1145/1455229.145523114:1(1-24)Online publication date: 23-Jan-2009
https://dl.acm.org/doi/10.1145/1455229.1455231

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents