International Joint Conference on Artificial Intelligence, 2009
Designing high-performance algorithms for computation- ally hard problems is a difficult and ofte... more Designing high-performance algorithms for computation- ally hard problems is a difficult and often time-consuming task. In this work, we demonstrate that this task can be automated in the context of stochastic local search (SLS) solvers for the propositional satisfiability problem (SAT). We first introduce a generalised, highly param- eterised solver framework, dubbed SATenstein, that in- cludes components gleaned from or
We introduce a class of mechanisms, called bidding clubs, that allow agents to coordinate their b... more We introduce a class of mechanisms, called bidding clubs, that allow agents to coordinate their bidding in auctions. Bidding clubs invite a set of agents to join, and each invited agent freely chooses whether to accept the invitation or to participate independently in the auction. Agents who join a bidding club flrst conduct a \knockout auction" within the club; depending
Action-graph games (AGGs) are a fully expres- sive game representation which can compactly expres... more Action-graph games (AGGs) are a fully expres- sive game representation which can compactly express both strict and context-specific indepen- dence between players' utility functions. Ac- tions are represented as nodes in a graph G, and the payoff to an agent who chose the action s depends only on the numbers of other agents who chose actions connected to s. We
International Joint Conference on Artificial Intelligence, 1999
In combinatorial auctions, multiple goods are sold simultaneously and bidders may bid for arbitra... more In combinatorial auctions, multiple goods are sold simultaneously and bidders may bid for arbitrary combinations of goods. Determining the outcome of such an auction is an optimization problem that is NP-complete in the general case. We propose two methods of overcoming this ...
Proceedings of the fifteenth ACM conference on Economics and computation - EC '14, 2014
ABSTRACT Behavioral game theory seeks to describe the way actual people (as compared to idealized... more ABSTRACT Behavioral game theory seeks to describe the way actual people (as compared to idealized, ``rational'' agents) act in strategic situations. Our own recent work has identified iterative models (such as quantal cognitive hierarchy) as the state of the art for predicting human play in unrepeated, simultaneous-move games [Wright and Leyton-Brown 2012]. Iterative models predict that agents reason iteratively about their opponents, building up from a specification of nonstrategic behavior called level-0. The modeler is in principle free to choose any description of level-0 behavior that makes sense for the given setting; however, in practice almost all existing work specifies this behavior as a uniform distribution over actions. In most games it is not plausible that even nonstrategic agents would choose an action uniformly at random, nor that other agents would expect them to do so. A more accurate model for level-0 behavior has the potential to dramatically improve predictions of human behavior, since a substantial fraction of agents may play level-0 strategies directly, and furthermore since iterative models ground all higher-level strategies in responses to the level-0 strategy. Our work considers ``meta-models'' of level-0 behavior: models of the way in which level-0 agents construct a probability distribution over actions, given an arbitrary game. We evaluated many such meta-models, each of which makes its prediction based only on general features that can be computed from any normal form game. We evaluated the effects of combining each new level-0 meta-model with various iterative models, and in many cases observed large improvements in the models' predictive accuracies. In the end, we recommend a meta-model that achieved excellent performance across the board: a linear weighting of features that requires the estimation of five weights.
The papers in these proceedings were presented at the 13th ACM Conference on Electronic Commerce ... more The papers in these proceedings were presented at the 13th ACM Conference on Electronic Commerce (EC'12), held June 4-8 in Valencia, Spain. Since 1999 the ACM Special Interest Group on Electronic Commerce (SIGecom) has sponsored the leading scientific conference on advances in theory, systems, and applications for electronic commerce. The natural focus of the conference is on computer science issues, but the conference is interdisciplinary in nature, including research in economics and research related to (but not limited to) the following three non-exclusive focus areas: TF: Theory and Foundations (Computer Science Theory; Economic Theory) AI: Artificial Intelligence (AI, Agents, Machine Learning, Data Mining) EA: Experimental and Applications (Empirical Research, Experience with E-Commerce Applications) In addition to the main technical program, EC'12 featured four workshops and five tutorials. EC'12 was also co-located with the Autonomous Agents and Multiagent Systems...
Although some algorithms are better than others on average, there is rarely a best algo-rithm for... more Although some algorithms are better than others on average, there is rarely a best algo-rithm for a given problem. Instead, different algorithms often perform well on different problem instances. Not surprisingly, this phenomenon is most pronounced among algo-rithms for ...
Proceeding of the fifteenth annual conference companion on Genetic and evolutionary computation conference companion - GECCO '13 Companion, 2013
ABSTRACT We benchmark a sequential model-based optimization procedure, SMAC-BBOB, on the BBOB set... more ABSTRACT We benchmark a sequential model-based optimization procedure, SMAC-BBOB, on the BBOB set of blackbox functions. We demonstrate that with a small budget of 10xD evaluations of D-dimensional functions, SMAC-BBOB in most cases outperforms the state-of-the-art blackbox optimizer CMA-ES. However, CMA-ES benefits more from growing the budget to 100xD, and for larger number of function evaluations SMAC-BBOB also requires increasingly large computational resources for building and using its models.
International Joint Conference on Artificial Intelligence, 2009
Designing high-performance algorithms for computation- ally hard problems is a difficult and ofte... more Designing high-performance algorithms for computation- ally hard problems is a difficult and often time-consuming task. In this work, we demonstrate that this task can be automated in the context of stochastic local search (SLS) solvers for the propositional satisfiability problem (SAT). We first introduce a generalised, highly param- eterised solver framework, dubbed SATenstein, that in- cludes components gleaned from or
We introduce a class of mechanisms, called bidding clubs, that allow agents to coordinate their b... more We introduce a class of mechanisms, called bidding clubs, that allow agents to coordinate their bidding in auctions. Bidding clubs invite a set of agents to join, and each invited agent freely chooses whether to accept the invitation or to participate independently in the auction. Agents who join a bidding club flrst conduct a \knockout auction" within the club; depending
Action-graph games (AGGs) are a fully expres- sive game representation which can compactly expres... more Action-graph games (AGGs) are a fully expres- sive game representation which can compactly express both strict and context-specific indepen- dence between players' utility functions. Ac- tions are represented as nodes in a graph G, and the payoff to an agent who chose the action s depends only on the numbers of other agents who chose actions connected to s. We
International Joint Conference on Artificial Intelligence, 1999
In combinatorial auctions, multiple goods are sold simultaneously and bidders may bid for arbitra... more In combinatorial auctions, multiple goods are sold simultaneously and bidders may bid for arbitrary combinations of goods. Determining the outcome of such an auction is an optimization problem that is NP-complete in the general case. We propose two methods of overcoming this ...
Proceedings of the fifteenth ACM conference on Economics and computation - EC '14, 2014
ABSTRACT Behavioral game theory seeks to describe the way actual people (as compared to idealized... more ABSTRACT Behavioral game theory seeks to describe the way actual people (as compared to idealized, ``rational'' agents) act in strategic situations. Our own recent work has identified iterative models (such as quantal cognitive hierarchy) as the state of the art for predicting human play in unrepeated, simultaneous-move games [Wright and Leyton-Brown 2012]. Iterative models predict that agents reason iteratively about their opponents, building up from a specification of nonstrategic behavior called level-0. The modeler is in principle free to choose any description of level-0 behavior that makes sense for the given setting; however, in practice almost all existing work specifies this behavior as a uniform distribution over actions. In most games it is not plausible that even nonstrategic agents would choose an action uniformly at random, nor that other agents would expect them to do so. A more accurate model for level-0 behavior has the potential to dramatically improve predictions of human behavior, since a substantial fraction of agents may play level-0 strategies directly, and furthermore since iterative models ground all higher-level strategies in responses to the level-0 strategy. Our work considers ``meta-models'' of level-0 behavior: models of the way in which level-0 agents construct a probability distribution over actions, given an arbitrary game. We evaluated many such meta-models, each of which makes its prediction based only on general features that can be computed from any normal form game. We evaluated the effects of combining each new level-0 meta-model with various iterative models, and in many cases observed large improvements in the models' predictive accuracies. In the end, we recommend a meta-model that achieved excellent performance across the board: a linear weighting of features that requires the estimation of five weights.
The papers in these proceedings were presented at the 13th ACM Conference on Electronic Commerce ... more The papers in these proceedings were presented at the 13th ACM Conference on Electronic Commerce (EC'12), held June 4-8 in Valencia, Spain. Since 1999 the ACM Special Interest Group on Electronic Commerce (SIGecom) has sponsored the leading scientific conference on advances in theory, systems, and applications for electronic commerce. The natural focus of the conference is on computer science issues, but the conference is interdisciplinary in nature, including research in economics and research related to (but not limited to) the following three non-exclusive focus areas: TF: Theory and Foundations (Computer Science Theory; Economic Theory) AI: Artificial Intelligence (AI, Agents, Machine Learning, Data Mining) EA: Experimental and Applications (Empirical Research, Experience with E-Commerce Applications) In addition to the main technical program, EC'12 featured four workshops and five tutorials. EC'12 was also co-located with the Autonomous Agents and Multiagent Systems...
Although some algorithms are better than others on average, there is rarely a best algo-rithm for... more Although some algorithms are better than others on average, there is rarely a best algo-rithm for a given problem. Instead, different algorithms often perform well on different problem instances. Not surprisingly, this phenomenon is most pronounced among algo-rithms for ...
Proceeding of the fifteenth annual conference companion on Genetic and evolutionary computation conference companion - GECCO '13 Companion, 2013
ABSTRACT We benchmark a sequential model-based optimization procedure, SMAC-BBOB, on the BBOB set... more ABSTRACT We benchmark a sequential model-based optimization procedure, SMAC-BBOB, on the BBOB set of blackbox functions. We demonstrate that with a small budget of 10xD evaluations of D-dimensional functions, SMAC-BBOB in most cases outperforms the state-of-the-art blackbox optimizer CMA-ES. However, CMA-ES benefits more from growing the budget to 100xD, and for larger number of function evaluations SMAC-BBOB also requires increasingly large computational resources for building and using its models.
Uploads
Papers by Kevin Leyton-brown