-
Efficient Online Learning of Optimal Rankings: Dimensionality Reduction via Gradient Descent
Authors:
Dimitris Fotakis,
Thanasis Lianeas,
Georgios Piliouras,
Stratis Skoulakis
Abstract:
We consider a natural model of online preference aggregation, where sets of preferred items $R_1, R_2, \ldots, R_t$ along with a demand for $k_t$ items in each $R_t$, appear online. Without prior knowledge of $(R_t, k_t)$, the learner maintains a ranking $π_t$ aiming that at least $k_t$ items from $R_t$ appear high in $π_t$. This is a fundamental problem in preference aggregation with applications…
▽ More
We consider a natural model of online preference aggregation, where sets of preferred items $R_1, R_2, \ldots, R_t$ along with a demand for $k_t$ items in each $R_t$, appear online. Without prior knowledge of $(R_t, k_t)$, the learner maintains a ranking $π_t$ aiming that at least $k_t$ items from $R_t$ appear high in $π_t$. This is a fundamental problem in preference aggregation with applications to, e.g., ordering product or news items in web pages based on user scrolling and click patterns. The widely studied Generalized Min-Sum-Set-Cover (GMSSC) problem serves as a formal model for the setting above. GMSSC is NP-hard and the standard application of no-regret online learning algorithms is computationally inefficient, because they operate in the space of rankings. In this work, we show how to achieve low regret for GMSSC in polynomial-time. We employ dimensionality reduction from rankings to the space of doubly stochastic matrices, where we apply Online Gradient Descent. A key step is to show how subgradients can be computed efficiently, by solving the dual of a configuration LP. Using oblivious deterministic and randomized rounding schemes, we map doubly stochastic matrices back to rankings with a small loss in the GMSSC objective.
△ Less
Submitted 5 November, 2020;
originally announced November 2020.
-
No-regret learning and mixed Nash equilibria: They do not mix
Authors:
Lampros Flokas,
Emmanouil-Vasileios Vlatakis-Gkaragkounis,
Thanasis Lianeas,
Panayotis Mertikopoulos,
Georgios Piliouras
Abstract:
Understanding the behavior of no-regret dynamics in general $N$-player games is a fundamental question in online learning and game theory. A folk result in the field states that, in finite games, the empirical frequency of play under no-regret learning converges to the game's set of coarse correlated equilibria. By contrast, our understanding of how the day-to-day behavior of the dynamics correlat…
▽ More
Understanding the behavior of no-regret dynamics in general $N$-player games is a fundamental question in online learning and game theory. A folk result in the field states that, in finite games, the empirical frequency of play under no-regret learning converges to the game's set of coarse correlated equilibria. By contrast, our understanding of how the day-to-day behavior of the dynamics correlates to the game's Nash equilibria is much more limited, and only partial results are known for certain classes of games (such as zero-sum or congestion games). In this paper, we study the dynamics of "follow-the-regularized-leader" (FTRL), arguably the most well-studied class of no-regret dynamics, and we establish a sweeping negative result showing that the notion of mixed Nash equilibrium is antithetical to no-regret learning. Specifically, we show that any Nash equilibrium which is not strict (in that every player has a unique best response) cannot be stable and attracting under the dynamics of FTRL. This result has significant implications for predicting the outcome of a learning process as it shows unequivocally that only strict (and hence, pure) Nash equilibria can emerge as stable limit points thereof.
△ Less
Submitted 20 October, 2020; v1 submitted 19 October, 2020;
originally announced October 2020.
-
Node Max-Cut and Computing Equilibria in Linear Weighted Congestion Games
Authors:
Dimitris Fotakis,
Vardis Kandiros,
Thanasis Lianeas,
Nikos Mouzakis,
Panagiotis Patsilinakos,
Stratis Skoulakis
Abstract:
In this work, we seek a more refined understanding of the complexity of local optimum computation for Max-Cut and pure Nash equilibrium (PNE) computation for congestion games with weighted players and linear latency functions. We show that computing a PNE of linear weighted congestion games is PLS-complete either for very restricted strategy spaces, namely when player strategies are paths on a ser…
▽ More
In this work, we seek a more refined understanding of the complexity of local optimum computation for Max-Cut and pure Nash equilibrium (PNE) computation for congestion games with weighted players and linear latency functions. We show that computing a PNE of linear weighted congestion games is PLS-complete either for very restricted strategy spaces, namely when player strategies are paths on a series-parallel network with a single origin and destination, or for very restricted latency functions, namely when the latency on each resource is equal to the congestion. Our results reveal a remarkable gap regarding the complexity of PNE in congestion games with weighted and unweighted players, since in case of unweighted players, a PNE can be easily computed by either a simple greedy algorithm (for series-parallel networks) or any better response dynamics (when the latency is equal to the congestion). For the latter of the results above, we need to show first that computing a local optimum of a natural restriction of Max-Cut, which we call \emph{Node-Max-Cut}, is PLS-complete. In Node-Max-Cut, the input graph is vertex-weighted and the weight of each edge is equal to the product of the weights of its endpoints. Due to the very restricted nature of Node-Max-Cut, the reduction requires a careful combination of new gadgets with ideas and techniques from previous work. We also show how to compute efficiently a $(1+\eps)$-approximate equilibrium for Node-Max-Cut, if the number of different vertex weights is constant.
△ Less
Submitted 23 February, 2020; v1 submitted 19 November, 2019;
originally announced November 2019.
-
A Submodular Approach for Electricity Distribution Network Reconfiguration
Authors:
Ali Khodabakhsh,
Ger Yang,
Soumya Basu,
Evdokia Nikolova,
Michael C. Caramanis,
Thanasis Lianeas,
Emmanouil Pountourakis
Abstract:
Distribution network reconfiguration (DNR) is a tool used by operators to balance line load flows and mitigate losses. As distributed generation and flexible load adoption increases, the impact of DNR on the security, efficiency, and reliability of the grid will increase as well. Today, heuristic-based actions like branch exchange are routinely taken, with no theoretical guarantee of their optimal…
▽ More
Distribution network reconfiguration (DNR) is a tool used by operators to balance line load flows and mitigate losses. As distributed generation and flexible load adoption increases, the impact of DNR on the security, efficiency, and reliability of the grid will increase as well. Today, heuristic-based actions like branch exchange are routinely taken, with no theoretical guarantee of their optimality. This paper considers loss minimization via DNR, which changes the on/off status of switches in the network. The goal is to ensure a radial final configuration (called a spanning tree in the algorithms literature) that spans all network buses and connects them to the substation (called the root of the tree) through a single path. We prove that the associated combinatorial optimization problem is strongly NP-hard and thus likely cannot be solved efficiently. We formulate the loss minimization problem as a supermodular function minimization under a single matroid basis constraint, and use existing algorithms to propose a polynomial time local search algorithm for the DNR problem at hand and derive performance bounds. We show that our algorithm is equivalent to the extensively used branch exchange algorithm, for which, to the best of our knowledge, we pioneer in proposing a theoretical performance bound. Finally, we use a 33-bus network to compare our algorithm's performance to several algorithms published in the literature.
△ Less
Submitted 9 November, 2017;
originally announced November 2017.
-
Reconciling Selfish Routing with Social Good
Authors:
Soumya Basu,
Ger Yang,
Thanasis Lianeas,
Evdokia Nikolova,
Yitao Chen
Abstract:
Selfish routing is a central problem in algorithmic game theory, with one of the principal applications being that of routing in road networks. Inspired by the emergence of routing technologies and autonomous driving, we revisit selfish routing and consider three possible outcomes of it: (i) $θ$-Positive Nash Equilibrium flow, where every path that has non-zero flow on all of its edges has cost no…
▽ More
Selfish routing is a central problem in algorithmic game theory, with one of the principal applications being that of routing in road networks. Inspired by the emergence of routing technologies and autonomous driving, we revisit selfish routing and consider three possible outcomes of it: (i) $θ$-Positive Nash Equilibrium flow, where every path that has non-zero flow on all of its edges has cost no greater than $θ$ times the cost of any other path, (ii) $θ$-Used Nash Equilibrium flow, where every used path that appears in the path flow decomposition has cost no greater than $θ$ times the cost of any other path, and (iii) $θ$-Envy Free flow, where every path that appears in the path flow decomposition has cost no greater than $θ$ times the cost of any other path in the path flow decomposition. We first examine the relations of these outcomes among each other and then measure their possible impact on the network's performance. Afterwards, we examine the computational complexity of finding such flows of minimum social cost and give a range for $θ$ for which this task is easy and a range for $θ$ for which this task is NP-hard. Finally, we propose deterministic strategies which, in a worst case approach, can be used by a central planner in order to provide good such flows, and further introduce a natural idea for randomly routing players after giving them specific guarantees about their costs in the randomized routing, as a tool for the central planner to implement a desired flow.
△ Less
Submitted 1 July, 2017;
originally announced July 2017.
-
When Does Diversity of User Preferences Improve Outcomes in Selfish Routing?
Authors:
Richard Cole,
Thanasis Lianeas,
Evdokia Nikolova
Abstract:
We seek to understand when heterogeneity in user preferences yields improved outcomes in terms of overall cost. That this might be hoped for is based on the common belief that diversity is advantageous in many settings. We investigate this in the context of routing. Our main result is a sharp characterization of the network settings in which diversity always helps, versus those in which it is some…
▽ More
We seek to understand when heterogeneity in user preferences yields improved outcomes in terms of overall cost. That this might be hoped for is based on the common belief that diversity is advantageous in many settings. We investigate this in the context of routing. Our main result is a sharp characterization of the network settings in which diversity always helps, versus those in which it is sometimes harmful. Specifically, we consider routing games, where diversity arises in the way that users trade-off two criteria (such as time and money, or, in the case of stochastic delays, expectation and variance of delay). Our main contributions are the following: 1) A participant-oriented measure of cost in the presence of user diversity, together with the identification of the natural benchmark: the same cost measure for an appropriately defined average of the diversity. 2) A full characterization of those network topologies for which diversity always helps, for all latency functions and demands. For single-commodity routings, these are series-parallel graphs, while for multi-commodity routings, they are the newly-defined "block-matching" networks. The latter comprise a suitable interweaving of multiple series-parallel graphs each connecting a distinct source-sink pair. While the result for the single-commodity case may seem intuitive in light of the well-known Braess paradox, the two problems are different: there are instances where diversity helps although the Braess paradox occurs, and vice-versa. But the main technical challenge is to establish the "only if" direction of the result for multi-commodity networks. This follows by constructing an instance where diversity hurts, and showing how to embed it in any network which is not block-matching, by carefully exploiting the way the simple source-sink paths of the commodities intersect in the "non-block-matching" portion of the network.
△ Less
Submitted 27 June, 2018; v1 submitted 24 February, 2017;
originally announced February 2017.
-
Asymptotically tight bounds for inefficiency in risk-averse selfish routing
Authors:
Thanasis Lianeas,
Evdokia Nikolova,
Nicolas E. Stier-Moses
Abstract:
We consider a nonatomic selfish routing model with independent stochastic travel times, represented by mean and variance latency functions for each edge that depend on their flows. In an effort to decouple the effect of risk-averse player preferences from selfish behavior on the degradation of system performance, Nikolova and Stier- Moses [16] defined the concept of the price of risk aversion as t…
▽ More
We consider a nonatomic selfish routing model with independent stochastic travel times, represented by mean and variance latency functions for each edge that depend on their flows. In an effort to decouple the effect of risk-averse player preferences from selfish behavior on the degradation of system performance, Nikolova and Stier- Moses [16] defined the concept of the price of risk aversion as the worst-case ratio of the cost of an equilibrium with risk-averse players and that of an equilibrium with risk-neutral users. For risk-averse users who seek to minimize the mean plus variance of travel time on a path, they proved an upper bound on the price of risk aversion, which is independent of the latency functions, and grows linearly with the size of the graph and players' risk-aversion. In this follow-up paper, we provide a matching lower bound for graphs with number of vertices equal to powers of two, via the construction of a graph family inductively generated from the Braess graph. We also provide conceptually different bounds, which we call functional, that depend on the class of mean latency functions and provide characterizations that are independent of the network topology (first derived, in a more complicated way, by Meir and Parkes [10] in a different context with different techniques). We also supplement the upper bound with a new asymptotically-tight lower bound. Our third contribution is a tight bound on the price of risk aversion for a family of graphs that generalize series-parallel graphs which applies to users minimizing the mean plus standard deviation of a path, a much more complex model of risk-aversion due to the cost of a path being non-additive over edge costs. This is a refinement of previous results in [16] that characterized the price of risk-aversion for series-parallel graphs and for the Braess graph.
△ Less
Submitted 16 October, 2015; v1 submitted 7 October, 2015;
originally announced October 2015.
-
New Complexity Results and Algorithms for the Minimum Tollbooth Problem
Authors:
Soumya Basu,
Thanasis Lianeas,
Evdokia Nikolova
Abstract:
The inefficiency of the Wardrop equilibrium of nonatomic routing games can be eliminated by placing tolls on the edges of a network so that the socially optimal flow is induced as an equilibrium flow. A solution where the minimum number of edges are tolled may be preferable over others due to its ease of implementation in real networks. In this paper we consider the minimum tollbooth (MINTB) probl…
▽ More
The inefficiency of the Wardrop equilibrium of nonatomic routing games can be eliminated by placing tolls on the edges of a network so that the socially optimal flow is induced as an equilibrium flow. A solution where the minimum number of edges are tolled may be preferable over others due to its ease of implementation in real networks. In this paper we consider the minimum tollbooth (MINTB) problem, which seeks social optimum inducing tolls with minimum support. We prove for single commodity networks with linear latencies that the problem is NP-hard to approximate within a factor of $1.1377$ through a reduction from the minimum vertex cover problem. Insights from network design motivate us to formulate a new variation of the problem where, in addition to placing tolls, it is allowed to remove unused edges by the social optimum. We prove that this new problem remains NP-hard even for single commodity networks with linear latencies, using a reduction from the partition problem. On the positive side, we give the first exact polynomial solution to the MINTB problem in an important class of graphs---series-parallel graphs. Our algorithm solves MINTB by first tabulating the candidate solutions for subgraphs of the series-parallel network and then combining them optimally.
△ Less
Submitted 25 September, 2015; v1 submitted 24 September, 2015;
originally announced September 2015.
-
On the Hardness of Network Design for Bottleneck Routing Games
Authors:
Dimitris Fotakis,
Alexis C. Kaporis,
Thanasis Lianeas,
Paul G. Spirakis
Abstract:
In routing games, the network performance at equilibrium can be significantly improved if we remove some edges from the network. This counterintuitive fact, widely known as Braess's paradox, gives rise to the (selfish) network design problem, where we seek to recognize routing games suffering from the paradox, and to improve the equilibrium performance by edge removal. In this work, we investigate…
▽ More
In routing games, the network performance at equilibrium can be significantly improved if we remove some edges from the network. This counterintuitive fact, widely known as Braess's paradox, gives rise to the (selfish) network design problem, where we seek to recognize routing games suffering from the paradox, and to improve the equilibrium performance by edge removal. In this work, we investigate the computational complexity and the approximability of the network design problem for non-atomic bottleneck routing games, where the individual cost of each player is the bottleneck cost of her path, and the social cost is the bottleneck cost of the network. We first show that bottleneck routing games do not suffer from Braess's paradox either if the network is series-parallel, or if we consider only subpath-optimal Nash flows. On the negative side, we prove that even for games with strictly increasing linear latencies, it is NP-hard not only to recognize instances suffering from the paradox, but also to distinguish between instances for which the Price of Anarchy (PoA) can decrease to 1 and instances for which the PoA is as large as Ω(n^{0.121}) and cannot improve by edge removal. Thus, the network design problem for such games is NP-hard to approximate within a factor of O(n^{0.121-\eps}), for any constant \eps > 0. On the positive side, we show how to compute an almost optimal subnetwork w.r.t. the bottleneck cost of its worst Nash flow, when the worst Nash flow in the best subnetwork routes a non-negligible amount of flow on all used edges. The running time is determined by the total number of paths, and is quasipolynomial when the number of paths is quasipolynomial.
△ Less
Submitted 22 July, 2012;
originally announced July 2012.
