research-article

Public Access

A Whittle's Index Based Approach for QoE Optimization in Wireless Networks

Authors:

Gustavo de VecianaAuthors Info & Claims

Proceedings of the ACM on Measurement and Analysis of Computing Systems, Volume 2, Issue 1

Article No.: 15, Pages 1 - 39

https://doi.org/10.1145/3179418

Published: 03 April 2018 Publication History

Abstract

The design of schedulers to optimize heterogeneous users' Quality of Experience (QoE) remains a challenging and important problem for wireless systems. This paper explores three inter-related aspects of this problem: 1) non-linear relationships between a user's QoE and flow delays; 2) managing load dependent QoE trade-offs among heterogeneous application classes; and 3), striking a good balance between opportunistic scheduling and greedy QoE optimization. To that end we study downlink schedulers which minimize the expected cost modeled by convex functions of flow delays for users with heterogeneous channel rate variations. The essential features of this challenging problem are modeled as a Markov Decision Process to which we apply Whittle's relaxation, which in turn is shown to be indexable. Based on the Whittle's relaxation we develop a new scheduling policy, Opportunistic Delay Based Index Policy (ODIP). We then prove various structural properties for ODIP which result in closed form expressions for Whittle's indices under different scheduler scenarios. Using extensive simulations we show that ODIP scheduler provides a robust means to realize complex QoE trade-offs for a range of system loads.

References

[1]

Samuli Aalto and Urtzi Ayesta. 2008. Optimal Scheduling of Jobs with a DHR Tail in the M/G/1 Queue Proc. Int. Conf. on Performance Evaluation Methodologies and Tools (ValueTools '08). Article 50, 8 pages.

Digital Library

[2]

Samuli Aalto, Urtzi Ayesta, and Rhonda Righter. 2009. On the Gittins index in the M/G/1 queue. Queueing Systems, Vol. 63, 1--4 (2009), 437--458.

Digital Library

[3]

Samuli Aalto and Pasi Lassila. 2007. Impact of Size-Based Scheduling on Flow Level Performance in Wireless Downlink Data Channels. Managing Traffic Performance in Converged Networks. Lecture Notes in Computer Science, Vol. Vol. 4516. Springer Berlin Heidelberg, 1096--1107.

Digital Library

[4]

Samuli Aalto, Pasi Lassila, and Prajwal Osti. 2015. Whittle Index Approach to Size-aware Scheduling with Time-varying Channels Proc. ACM SIGMETRICS Int. Conf. on Measurement and Modeling of Computer Systems (SIGMETRICS '15). ACM, 57--69.

Digital Library

[5]

Samuli Aalto, Aleksi Penttinen, Pasi Lassila, and Prajwal Osti. 2011. On the Optimal Trade-off Between SRPT and Opportunistic Scheduling Proc. ACM SIGMETRICS Joint Int. Conf. on Measurement and Modeling of Computer Systems (SIGMETRICS '11). 185--196.

Digital Library

[6]

Samuli Aalto, Aleksi Penttinen, Pasi Lassila, and Prajwal Osti. 2012. Optimal Size-Based Opportunistic Scheduler for Wireless Systems. Queueing Systems, Vol. 72, 1 (Oct. 2012), 5--30.

Digital Library

[7]

Pablo Ameigeiras, Juan J. Ramos-Munoz, Jorge Navarro-Ortiz, Preben Mogensen, and Juan M. Lopez-Soler. 2010. QoE Oriented Cross-layer Design of a Resource Allocation Algorithm in Beyond 3G Systems. Comput. Commun., Vol. 33, 5 (Mar. 2010), 571--582.

Digital Library

[8]

Arjun Anand and Gustavo de Veciana. 2017. Measurement-based Scheduler for Multi-class QoE Optimization in Wireless Networks Proc. INFOCOM. 1--9.

[9]

P. S. Ansell, K. D. Glazebrook, J. Ni no-Mora, and M. O'Keeffe. 2003. Whittle's Index Policy for a Multi-Class Queueing System with Convex Holding Costs. Mathematical Methods of Operations Research, Vol. 57, 1 (01 Apr. 2003), 21--39.

[10]

Konstantin Avrachenkov, Urtzi Ayesta, Patrick Brown, and Eeva Nyberg. 2004. Differentiation Between Short and Long TCP flows: Predictability of the Response Time Proc. INFOCOM, Vol. Vol. 2. 762--773.

[11]

Urtzi Ayesta, Martin Erausquin, and Peter Jacko. 2010. A Modeling Framework for Optimizing the Flow-level Scheduling with Time-varying Channels. Perform. Eval., Vol. 67, 11 (Nov. 2010), 1014--1029.

Digital Library

[12]

Urtzi Ayesta, Martin Erausquin, Matthieu Jonckheere, and Maaike Verloop. 2013. Scheduling in a Random Environment: Stability and Asymptotic Optimality. IEEE/ACM Transactions on Networking Vol. 21, 1 (Feb. 2013), 258--271.

Digital Library

[13]

Dimitri P. Bertsekas. 2012. Dynamic Programming and Optimal Control (bibinfoedition4 ed.). Vol. Vol. 2. Athena Scientific.

[14]

Carlos F. Bispo. 2011. Single Server Scheduling Problem: Optimal policy for Convex Costs Depends on Arrival Rates Proc. Multidisciplinary Int. Conf. on Scheduling : Theory and Applications (MISTA 2011). 275--296.

[15]

Sem Borst. 2003. User-level Performance of Channel-Aware Scheduling Algorithms in Wireless Data Networks Proc. INFOCOM, Vol. Vol. 1. 321--331.

[16]

Sem Borst and Matthieu Jonckheere. 2006. Flow-Level Stability of Channel-Aware Scheduling Algorithms Proc. 4th International Symposium on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks. 1--6.

[17]

John C. Gittins, Kevin D. Glazebrook, and Richard Weber. 2011. Multi-armed Bandit Allocation Indices (2nd ed.). Qiley.

[18]

Itay Gurvich and Ward Whitt. 2009. Scheduling Flexible Servers with Convex Delay Costs in Many-Server Service Systems. Manufacturing & Service Operations Management, Vol. 11, 2 (2009), 237--253.

Digital Library

[19]

Mor Harchol-Balter. 2013. Performance Modeling and Design of Computer Systems: Queueing Theory in Action. Cambridge University Press.

Digital Library

[20]

Tobias Hobfeld, Sebastian Biedermann, Raimund Schatz, Alexander Platzer, Sebastian Egger, and Markus Fiedler. 2011. The Memory Effect and its Implications on Web QoE modeling Proc. Int. Teletraffic Cong.(ITC). 103--110.

Digital Library

[21]

Peter Jacko. 2011. Value of Information in Optimal Flow-level Scheduling of Users with Markovian Time-varying Channels. Perform. Eval., Vol. 68, 11 (Nov. 2011), 1022--1036.

Digital Library

[22]

Leonard Kleinrock. 1976. Queueing Systems. Vol. Vol. II: Computer Applications. Wiley Interscience.

[23]

Chi-ping Li and Michael J. Neely. 2011. Delay and Power-Optimal Control in Multi-Class Queueing Systems. ArXiv e-prints (Jan. 2011). showeprint{arxiv}math.OC/1101.2478

[24]

Avishai Mandelbaum and Alexander L. Stolyar. 2004. Scheduling Flexible Servers with Convex Delay Costs: Heavy-Traffic Optimality of the Generalized c|mu rule. Operations Research, Vol. 52, 6 (Dec. 2004).

Digital Library

[25]

Ricky K. P. Mok, Edward W. W. Chan, and Rocky K. C. Chang. 2011. Measuring the Quality of Experience of HTTP Video Streaming Proc. IFIP/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops. 485--492.

[26]

Shailesh Patil and Gustavo de Veciana. 2009. Measurement-based Opportunistic Scheduling for Heterogenous Wireless Systems. IEEE Trans. Commun., Vol. 57, 9 (Sep. 2009), 2745--2753.

Digital Library

[27]

Magnus Proebster. 2014. Improving the Quality of Experience with Size-Based and Opportunistic Scheduling Proc. International Symposium on Wireless Communications Systems (ISWCS). 443--448.

[28]

Magnus Proebster, Matthias Kaschub, Thomas Werthmann, and Stefan Valentin. 2012. Context-Aware Resource Allocation for Cellular Wireless Networks. EURASIP Journal on Wireless Communications and Networking, Vol. 2012, 1 (Jul. 2012), 1--19.

[29]

Rhonda Righter and Susan H. Xu. 1991. Scheduling Jobs on Non-Identical IFR Processors to Minimize General Cost Functions. Advances in Applied Probability Vol. 23, 4 (Dec. 1991), 909--924.

Cited By

Tomar RNalavade MKasbekar G(2024)User Association in Dense Millimeter Wave Networks With Multi-Channel Access Points Using the Whittle IndexIEEE Open Journal of the Communications Society10.1109/OJCOMS.2024.34471575(5154-5175)Online publication date: 2024
https://doi.org/10.1109/OJCOMS.2024.3447157
Pavamana KSingh C(2024)Caching Contents with Varying Popularity Using Restless BanditsPerformance Evaluation Methodologies and Tools10.1007/978-3-031-48885-6_9(133-150)Online publication date: 3-Jan-2024
https://doi.org/10.1007/978-3-031-48885-6_9
Wang WYing L(2020)Learning Parallel Markov Chains over Unreliable Wireless Channels2020 54th Annual Conference on Information Sciences and Systems (CISS)10.1109/CISS48834.2020.1570614323(1-6)Online publication date: Mar-2020
https://doi.org/10.1109/CISS48834.2020.1570614323
Show More Cited By

Index Terms

A Whittle's Index Based Approach for QoE Optimization in Wireless Networks
1. Mathematics of computing
  1. Mathematical analysis
    1. Mathematical optimization
      1. Continuous optimization
        Stochastic control and optimization
2. Networks

Recommendations

Whittle Index Approach to Size-aware Scheduling with Time-varying Channels
SIGMETRICS '15: Proceedings of the 2015 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems

We consider the optimal opportunistic scheduling problem for downlink data traffic in a wireless cell with time-varying channels. The scheduler itself operates in a very fast timescale of milliseconds, but the objective function is related to minimizing ...
A Whittle's Index Based Approach for QoE Optimization in Wireless Networks
SIGMETRICS '18

The design of schedulers to optimize heterogeneous users' Quality of Experience (QoE) remains a challenging and important problem for wireless systems. Our paper ([1]) explores three inter-related aspects of this problem: 1) non-linear relationships ...
A Whittle's Index Based Approach for QoE Optimization in Wireless Networks
SIGMETRICS '18: Abstracts of the 2018 ACM International Conference on Measurement and Modeling of Computer Systems

The design of schedulers to optimize heterogeneous users' Quality of Experience (QoE) remains a challenging and important problem for wireless systems. Our paper ([1]) explores three inter-related aspects of this problem: 1) non-linear relationships ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Measurement and Analysis of Computing Systems

Proceedings of the ACM on Measurement and Analysis of Computing Systems Volume 2, Issue 1

March 2018

603 pages

EISSN:2476-1249

DOI:10.1145/3203302

Editors:
Augustin Chaintreau
Columbia University
,
Aditya Akella
University of Wisconsin-Madison
,
Adam Wierman
California Institute of Technology

Issue’s Table of Contents

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 April 2018

Published in POMACS Volume 2, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Futurewei Technologies
NSF

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
283
Total Downloads

Downloads (Last 12 months)41
Downloads (Last 6 weeks)6

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Tomar RNalavade MKasbekar G(2024)User Association in Dense Millimeter Wave Networks With Multi-Channel Access Points Using the Whittle IndexIEEE Open Journal of the Communications Society10.1109/OJCOMS.2024.34471575(5154-5175)Online publication date: 2024
https://doi.org/10.1109/OJCOMS.2024.3447157
Pavamana KSingh C(2024)Caching Contents with Varying Popularity Using Restless BanditsPerformance Evaluation Methodologies and Tools10.1007/978-3-031-48885-6_9(133-150)Online publication date: 3-Jan-2024
https://doi.org/10.1007/978-3-031-48885-6_9
Wang WYing L(2020)Learning Parallel Markov Chains over Unreliable Wireless Channels2020 54th Annual Conference on Information Sciences and Systems (CISS)10.1109/CISS48834.2020.1570614323(1-6)Online publication date: Mar-2020
https://doi.org/10.1109/CISS48834.2020.1570614323
Anand Ade Veciana G(2019)A Whittle's Index Based Approach for QoE Optimization in Wireless NetworksACM SIGMETRICS Performance Evaluation Review10.1145/3308809.330883046:1(39-39)Online publication date: 17-Jan-2019
https://doi.org/10.1145/3308809.3308830
Aalto SLassila PTaboada I(2019)Whittle index approach to opportunistic scheduling with partial channel informationPerformance Evaluation10.1016/j.peva.2019.102052(102052)Online publication date: Nov-2019
https://doi.org/10.1016/j.peva.2019.102052
Anand Ade Veciana G(2018)A Whittle's Index Based Approach for QoE Optimization in Wireless NetworksACM SIGMETRICS Performance Evaluation Review10.1145/3292040.321963346:1(39-39)Online publication date: 12-Jun-2018
https://dl.acm.org/doi/10.1145/3292040.3219633
Anand Ade Veciana GPsounis KAkella AWierman A(2018)A Whittle's Index Based Approach for QoE Optimization in Wireless NetworksAbstracts of the 2018 ACM International Conference on Measurement and Modeling of Computer Systems10.1145/3219617.3219633(39-39)Online publication date: 12-Jun-2018
https://dl.acm.org/doi/10.1145/3219617.3219633
Duran SVerloop I(2018)Asymptotic Optimal Control of Markov-Modulated Restless BanditsProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/31794102:1(1-25)Online publication date: 3-Apr-2018
https://dl.acm.org/doi/10.1145/3179410

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents