Abstract
Sample path methods are now among the most used techniques in the control of queueing systems. However, due to the lack of mathematical formalism, they may appear to be non-rigorous and even sometimes mysterious. The goal of this paper is threefold: to provide a general mathematical setting, to survey the most popular sample path methods including forward induction, backward induction and interchange arguments, and to illustrate our approach through the study of a number of classical scheduling and routing optimization problems arising in queueing theory.
Similar content being viewed by others
References
F. Baccelli, Z. Liu and D. Towsley, Extremal scheduling of parallel processing with and without real-time constraints, J. ACM 40 (1993) 1209–1237.
J.S. Baras, D.-J. Ma and A.M. Makowski,K competing queues with geometric requirements and linear costs: the μc-rule is always optimal. Syst. Contr. Lett. 6 (1985) 173–180.
C. Buyukkoc, P. Varaiya and J. Walrand, The μic-rule revisited, Adv. Appl. Prob. 17 (1985) 237–238.
C.S. Chang, A new ordering for stochastic majorization: theory and applications, Adv. Appl. Prob. 24 (1992) 604–634.
P.W. Day, Rearrangement inequalities, Can. J. Monthly 24 (1972) 930–943.
A. Ephremides, P. Varaiya and J. Walrand, A simple dynamic routing problem, IEEE Trans. Autom. Contr. 25 (1980).
W. Feller,An Introduction to Probability Theory and Its Applications, Vol. 2, 2nd Ed. (Wiley, 1971).
S.G. Foss, Approximation of multichannel queueing systems (in Russian), Sibirski Mat. Zh. 21 (1980) 132–140 [transl: Siberian Math. J. 21 (1980) 851–857].
S.G. Foss, Comparison of servicing strategies in multichannel queueing systems (in Russian), Sibirski Math. Zh. 22 (1981) 190–197 [transi.: Siberian Math. J. 22 (1981) 141–147].
S.G. Foss, Queues with customers of several types, in:Limit Theorems and Related Problems, ed. A.A. Borovokov (Optimization Software, 1984) pp. 348–377.
S.G. Foss, Comparison of service disciplines inG/GI/m queues, INRIA Technical Report No. 1097 (1989).
S. Ghahramani and R.W. Wolff, A new proof of finite moment conditions for GI/G/1 busy periods, Queueing Systems 4 (1989) 171–178.
T. Hirayama and M. Kijima, An extremal property of FIFO discipline in G/IFR/1 queues, Adv. Appl. Prob. 21 (1989) 481–484.
A. Hordijk and G. Koole, On the optimality of the generalized shortest queue policy, Prob. Eng. Inf. Sci. 4 (1991) 477–487.
G.P. Klimov, Time-sharing service systems I, Th. Prob. Appl. 19 (1974) 532–551.
A. Hordijk and G. Koole, The μ-rule is not optimal in the second node of the tandem queue: a counterexample, Adv. Appl. Prob. 24 (1992) 234–237.
Z. Liu, P. Nain and D. Towsley, On optimal polling policies, Queueing Systems 11 (1992) 59–83.
Z. Liu and R. Righter, Optimal load balancing on distributed homogeneous unreliable processors, submitted for publication.
Z. Liu and D. Towsley, Effects of service disciplines inG/G/s queueing systems, Ann. Oper. Res. 48 (1994) 401–429.
Z. Liu and D. Towsley, Stochastic scheduling in in-forest networks, Adv. Appl. Prob. 26 (1994) 222–241.
Z. Liu and D. Towsley, Optimality of the Round Robin routing policy. J. Appl. Prob. 31 (1994) 466–475.
A.W. Marshall and I. Olkin,Inequalities: Theory of Majorization and Its Applications (Academic Press, 1979).
R. Menich and R.F. Serfozo, Optimality of routing and servicing in dependent parallel processing systems, Queueing Systems 9 (1991) 403–418.
P. Nain, Interchange arguments for classical scheduling problems in queues, Syst. Contr. Lett. 12 (1989) 177–184.
P. Nain, P. Tsoucas and J. Walrand, Interchange arguments in stochastic scheduling, J. Appl. Prob. 27 (1989) 815–826.
P. Nain and D. Towsley, Optimal scheduling in a machine with stochastic varying processing rate, IEEE Trans. Autom. Contr. 39 (1994) 1853–1855.
S.M. Ross,Applied Probability Models with Optimization Applications (Holden-Day, San Francisco, 1970).
M. Schäl, Conditions for optimality in dynamic programming and for the limit of n-stage optimal policies to be optimal, Z. Wahrscheinlichkeitsth. 32 (1975) 179–196.
J.G. Shanthikumar and U. Sumita, Convex ordering of sojourn times in single-server queues: extremal properties of FIFO and LIFO service disciplines, J. Appl. Prob. 24 (1987) 737–748.
P.D. Sparaggis, C.G. Cassandras and D. Towsley, On the duality between routing and scheduling systems with finite buffer space, IEEE Trans. Autom. Contr. 38 (1993) 1440–1446.
P.D. Sparaggis, D. Towsley and C.G. Cassandras, Sample path criteria for weak majorization, Adv. Appl. Prob. 26 (1994) 155–171.
P.D. Sparaggis, C.G. Cassandras and D. Towsley, Routing with limited state information in queueing systems with blocking, IEEE Trans. Autom. Contr. 39 (1994) 1492–1497.
D. Stoyan,Comparison Methods for Queues and Other Stochastic Models (Wiley, Berlin, 1983).
D. Towsley and F. Baccelli, Comparison of service disciplines in tandem queueing networks with delay dependent customer behavior, Oper. Res. Lett. 10 (1991) 49–55.
D. Towsley, S. Fdida and H. Santoso, Flow control protocols for interconnected high speed networks,Proc. NATO Workshop on High Speed Networks, Sophia-Antipolis, France (1990).
D. Towsley and P. Sparaggis, Optimal routing in systems with ILR service time distributions, Technical Report TR93-13, Department of Computer Science, Univ. of Massachusetts (1993).
D. Towsley, P. Sparaggis and C.G. Cassandras, Optimal routing and buffer allocation for a class of finite capacity queueing systems, IEEE Trans. Autom. Contr. 37 (1992) 1446–1451.
P.P. Varaiya, J. Walrand and C. Buyukkoc, Extensions of the multiarmed bandit problem: the discounted case, IEEE Trans. Autom. Contr. 30 (1985) 426–439.
O.A. Vasicek, An inequality for the variance of waiting time under a general queueing discipline, Oper. Res. 25 (1977) 879–884.
J. Walrand,An Introduction to Queueing Networks (Prentice Hall, Englewood Cliff, NJ, 1988).
R.R. Weber, On the optimal assignment of customers to parallel queue, J. Appl. Prob. 15 (1978) 406–413.
G. Weiss, Branching bandit processes, Prob. Eng. Inf. Sci. 2 (1988) 269–278.
W. Whitt, Deciding which queue to join, Oper. Res. 34 (1986) 55–62.
W. Winston, Optimality of the shortest line discipline, J. Appl. Prob. 14 (1977) 181–189.
Author information
Authors and Affiliations
Additional information
Z. Liu was supported in part by the CEC DG XIII under the ESPRIT BRA grants QMIPS.
P. Nain was supported in part by NSF under grant NCR-9116183 and by the CEC DG XIII under the ESPRIT BRA grants QMIPS.
D. Towsley was supported in part by NSF under grant NCR-9116183.
Rights and permissions
About this article
Cite this article
Liu, Z., Nain, P. & Towsley, D. Sample path methods in the control of queues. Queueing Syst 21, 293–335 (1995). https://doi.org/10.1007/BF01149166
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF01149166