I am a researcher in Artificial Intelligence, with a background in Mathematics and Theoretical Physics. I obtained a master's degree in Mathematical Physics in 2008 at the Universiteit van Amsterdam under supervision of Robert Dijkgraaf. In May 2015 I obtained my PhD in Artificial Intelligence at the IIIA-CSIC in Barcelona, under supervision of Carles Sierra. Currently I am working with Dongmo Zhang at Western Sydney University.
My main interest is in Automated Negotiations where utility functions do not have an explicit expression, but instead are defined in terms of some hard, time-consuming problem that may involve Logic, Game Theory and Constraint Satisfaction. One typical example of such a domain is the game of Diplomacy, which I have been using as a test-bed for my research. Furthermore, I am especially interested in applying techniques from General Game Playing to the field of Automated Negotiations.
In May 2014 I won the second prize in the Automated Negotiating Agents Competition and in July 2015 I have won the first prize in the first Computer Diplomacy Challenge which was part of the ICGA Computer Olympiad 2015.
The advancement of technologies for autonomous vehicles (AVs) provides great potential for intell... more The advancement of technologies for autonomous vehicles (AVs) provides great potential for intelligent traffic control and management in the future. The deployment of Vehicle-to-Vehicle (V2V), Vehicle-to-Infrastructure (V2I) and Vehicle-to-Everything (V2X) communications enable traffic control on road segments, intersections or regional road networks with more options, either centralized or decentralized. However, choosing these options is not purely technical but a trade-off between autonomous decision-making and system optimization. One useful quantitative criterion for such a trade-off is the price of anarchy (PoA) of autonomous decision-making. This paper analyses the price of anarchy for road networks with traffic of autonomous vehicles. We model a traffic network as a routing game in which vehicles are selfish agents who choose routes to travel autonomously to minimize travel delays caused by road congestion. Unlike existing research in which the latency function of road conge...
This book constitutes the revised post-conference proceedings of the 17th European Conference on ... more This book constitutes the revised post-conference proceedings of the 17th European Conference on Multi-Agent Systems, EUMAS 2020, and the 7th International Conference on Agreement Technologies, AT 2020, which were originally planned to be held as a joint event in Thessaloniki, Greece, in April 2020. Due to COVID-19 pandemic the conference was postponed to September 2020 and finally became a fully virtual conference. The 38 full papers presented in this volume were carefully reviewed and selected from a total of 53 submissions. The papers report on both early and mature research and cover a wide range of topics in the field of autonomous agents and multi-agent systems
Multiuser museum interactives are computer systems installed in museums or galleries that allow s... more Multiuser museum interactives are computer systems installed in museums or galleries that allow several visitors to interact together with digital representations of artefacts and information from the museum’s collection. WeCurate is such a system, that allows users to collaboratively create a virtual exhibition from a cultural image archive. It provides a synchronised image browser across multiple devices to enable a group of users to work together to curate a collection of images. WeCurate uses electronic institutions to coordinate and synchronise the interactions between individuals, and it relies on agreement technologies (such as argumentation and computational social choice) for collective decision making. This paper provides an overview of the WeCurate application, describes its underlying electronic institution, and presents a brief introduction to its collective decision making mechanism.
The notion of electronic institution draws inspiration from traditional institutions. Both can be... more The notion of electronic institution draws inspiration from traditional institutions. Both can be seen as “coordination artefacts that serve as an interface between the internal decision making of individuals and their (collective) goals”. However, electronic institutions, unlike the conventional ones, are intended to work on-line and may involve the participation of humans as well as software agents. The EI/EIDE framework that we present in this chapter includes the formal metamodel (EI) for electronic institutions (EI), and a particular development environment (EIDE) for implementing EI-based models. One models an electronic institution as a network of scenes where agents establish and discharge commitments, through “conversations” that are constrained by procedural and functional conventions. The EI metamodel includes the formal languages used to specify an institution and the data structure, operations and operational semantics that need to be supported by a technological environment to run it
Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence
The Automated Negotiating Agents Competition (ANAC) is an annual competition that compares the st... more The Automated Negotiating Agents Competition (ANAC) is an annual competition that compares the state-of-the-art algorithms in the field of automated negotiation. Although in recent years ANAC has given more and more attention to more complex scenarios, the linear and bilateral negotiation domains that were used for its first few editions are still widely used as the default benchmark in automated negotiations research. In this paper, however, we argue that these domains should no longer be used, because they are too simplistic. We demonstrate this with an extremely simple new negotiation strategy called MiCRO, which does not employ any form of opponent modeling or machine learning, but nevertheless outperforms the strongest participants of ANAC 2012, 2013, 2018 and 2019. Furthermore, we provide a theoretical analysis which explains why MiCRO performs so well in the ANAC domains. This analysis may help researchers to design more challenging negotiation domains in the future.
There are a number of available tools that support teachers in the management of lesson plans on ... more There are a number of available tools that support teachers in the management of lesson plans on the web. However, none of them is task-centred and support any form of lesson plan’s execution over the web. PeerLearn is an application that allows both the design and the execution of lesson plans, where lesson plans are designed with respect to a selected rubric. PeerLearn uses electronic institutions to coordinate interactions, ensuring the rules set by the lesson plan are followed, and it relies on a trust-based model to calculate automated marks. The automated marks provide tremendous support for teachers when their online classrooms have massive numbers of students. This chapter provides an overview of the PeerLearn application, describes its underlying electronic institution, and presents a brief introduction to its automated assessment technology.
We introduce a new multiagent negotiation algorithm that explores the space of joint plans of act... more We introduce a new multiagent negotiation algorithm that explores the space of joint plans of action:NB3. Each negotiator generates a search tree by considering both actions performed by itself and actions performed by others. In order to test the algorithm we present a new variant of the Traveling Salesman Problem, in which there is not one, but many salesmen. The salesmen need to negotiate with each other in order to minimize the distances they have to cover. Finally we present the results of some tests we did with a simple implementation of the algorithm for
This book and most of the research reported here came out of the European FP7 project PRAISE (EU ... more This book and most of the research reported here came out of the European FP7 project PRAISE (EU FP7 number 388770), funded by the European Commission under program FP7-ICT-2011-8.
The advancement of technologies for autonomous vehicles (AVs) provides great potential for intell... more The advancement of technologies for autonomous vehicles (AVs) provides great potential for intelligent traffic control and management in the future. The deployment of Vehicle-to-Vehicle (V2V), Vehicle-to-Infrastructure (V2I) and Vehicle-to-Everything (V2X) communications enable traffic control on road segments, intersections or regional road networks with more options, either centralized or decentralized. However, choosing these options is not purely technical but a trade-off between autonomous decision-making and system optimization. One useful quantitative criterion for such a trade-off is the price of anarchy (PoA) of autonomous decision-making. This paper analyses the price of anarchy for road networks with traffic of autonomous vehicles. We model a traffic network as a routing game in which vehicles are selfish agents who choose routes to travel autonomously to minimize travel delays caused by road congestion. Unlike existing research in which the latency function of road conge...
This book constitutes the revised post-conference proceedings of the 17th European Conference on ... more This book constitutes the revised post-conference proceedings of the 17th European Conference on Multi-Agent Systems, EUMAS 2020, and the 7th International Conference on Agreement Technologies, AT 2020, which were originally planned to be held as a joint event in Thessaloniki, Greece, in April 2020. Due to COVID-19 pandemic the conference was postponed to September 2020 and finally became a fully virtual conference. The 38 full papers presented in this volume were carefully reviewed and selected from a total of 53 submissions. The papers report on both early and mature research and cover a wide range of topics in the field of autonomous agents and multi-agent systems
Multiuser museum interactives are computer systems installed in museums or galleries that allow s... more Multiuser museum interactives are computer systems installed in museums or galleries that allow several visitors to interact together with digital representations of artefacts and information from the museum’s collection. WeCurate is such a system, that allows users to collaboratively create a virtual exhibition from a cultural image archive. It provides a synchronised image browser across multiple devices to enable a group of users to work together to curate a collection of images. WeCurate uses electronic institutions to coordinate and synchronise the interactions between individuals, and it relies on agreement technologies (such as argumentation and computational social choice) for collective decision making. This paper provides an overview of the WeCurate application, describes its underlying electronic institution, and presents a brief introduction to its collective decision making mechanism.
The notion of electronic institution draws inspiration from traditional institutions. Both can be... more The notion of electronic institution draws inspiration from traditional institutions. Both can be seen as “coordination artefacts that serve as an interface between the internal decision making of individuals and their (collective) goals”. However, electronic institutions, unlike the conventional ones, are intended to work on-line and may involve the participation of humans as well as software agents. The EI/EIDE framework that we present in this chapter includes the formal metamodel (EI) for electronic institutions (EI), and a particular development environment (EIDE) for implementing EI-based models. One models an electronic institution as a network of scenes where agents establish and discharge commitments, through “conversations” that are constrained by procedural and functional conventions. The EI metamodel includes the formal languages used to specify an institution and the data structure, operations and operational semantics that need to be supported by a technological environment to run it
Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence
The Automated Negotiating Agents Competition (ANAC) is an annual competition that compares the st... more The Automated Negotiating Agents Competition (ANAC) is an annual competition that compares the state-of-the-art algorithms in the field of automated negotiation. Although in recent years ANAC has given more and more attention to more complex scenarios, the linear and bilateral negotiation domains that were used for its first few editions are still widely used as the default benchmark in automated negotiations research. In this paper, however, we argue that these domains should no longer be used, because they are too simplistic. We demonstrate this with an extremely simple new negotiation strategy called MiCRO, which does not employ any form of opponent modeling or machine learning, but nevertheless outperforms the strongest participants of ANAC 2012, 2013, 2018 and 2019. Furthermore, we provide a theoretical analysis which explains why MiCRO performs so well in the ANAC domains. This analysis may help researchers to design more challenging negotiation domains in the future.
There are a number of available tools that support teachers in the management of lesson plans on ... more There are a number of available tools that support teachers in the management of lesson plans on the web. However, none of them is task-centred and support any form of lesson plan’s execution over the web. PeerLearn is an application that allows both the design and the execution of lesson plans, where lesson plans are designed with respect to a selected rubric. PeerLearn uses electronic institutions to coordinate interactions, ensuring the rules set by the lesson plan are followed, and it relies on a trust-based model to calculate automated marks. The automated marks provide tremendous support for teachers when their online classrooms have massive numbers of students. This chapter provides an overview of the PeerLearn application, describes its underlying electronic institution, and presents a brief introduction to its automated assessment technology.
We introduce a new multiagent negotiation algorithm that explores the space of joint plans of act... more We introduce a new multiagent negotiation algorithm that explores the space of joint plans of action:NB3. Each negotiator generates a search tree by considering both actions performed by itself and actions performed by others. In order to test the algorithm we present a new variant of the Traveling Salesman Problem, in which there is not one, but many salesmen. The salesmen need to negotiate with each other in order to minimize the distances they have to cover. Finally we present the results of some tests we did with a simple implementation of the algorithm for
This book and most of the research reported here came out of the European FP7 project PRAISE (EU ... more This book and most of the research reported here came out of the European FP7 project PRAISE (EU FP7 number 388770), funded by the European Commission under program FP7-ICT-2011-8.
We investigate a problem that lies at the intersection of three research areas, namely Automated ... more We investigate a problem that lies at the intersection of three research areas, namely Automated Negotiation, Vehicle Routing, and Multi-Objective Optimization. Specifically, we investigate the scenario that multiple competing logistics companies aim to cooperate by delivering truck loads for one another, in order to improve efficiency and reduce the distance they drive. In order to do so, these companies need to find ways to exchange their truck loads such that each of them individually benefits. We present a new heuristic algorithm that, given one set of orders to deliver for each company, tries to find the set of all order-exchanges that are Pareto-optimal and individually rational. Furthermore, we present experiments based on real-world test data from two major logistics companies, which show that our algorithm is able to find hundreds of solutions in a matter of minutes.
In this paper we present a new algorithm for negotiations in non-zero-sum games. Although games h... more In this paper we present a new algorithm for negotiations in non-zero-sum games. Although games have been studied extensively, most game playing algorithms have been developed under the assumption that players do not communicate. Many real-world problems, however, can be modeled as non-zero-sum games in which players may mutually benefit if they coordinate their actions, which requires negotiation. The field of Automated Negotiations is another important topic in AI, but in this field one usually assumes that utility functions have explicit expressions and can therefore be calculated easily. Traditional approaches do not apply to domains in which the utility values are instead determined by the rules of a complex game. In this paper we aim to bridge the gap between General Game Playing and Automated Negotiations. Our algorithm is an adaptation of Monte Carlo Tree Search that allows players to negotiate. It is completely domain-independent in the sense that it is not tailored to any specific game. It can be applied to any non-zero-sum game, provided that its rules are described in Game Description Language.
Electronic institutions provide a computational analogue of human institutions to engineer open e... more Electronic institutions provide a computational analogue of human institutions to engineer open environments in which agents can interact in an autonomous way while complying with the norms of an institution. We survey the currently available infrastructures to engineer open environments as electronic institutions: (i) AMELI, the coordination infrastructure which is core to run EIs; and (ii) the conversion of the AMELI infrastructure to run over a peer to peer network. We also discuss the type of applications that both infrastructures target at.
We introduce a new multiagent negotiation algorithm that explores the space of joint plans of ac... more We introduce a new multiagent negotiation algorithm that explores the space of joint plans of action: NB3. Each negotiator generates a search tree by considering both actions performed by itself and actions performed by others. In order to test the algorithm we present a new variant of the Traveling Salesman Problem, in which there is not one, but many salesmen. The salesmen need to negotiate with each other in order to minimize the distances they have to cover. Finally we present the results of some tests we did with a simple implementation of the algorithm for this problem.
We introduce a new multiagent negotiation algorithm for large and complex domains, called NB3. It... more We introduce a new multiagent negotiation algorithm for large and complex domains, called NB3. It applies Branch & Bound to search for good offers to propose. To analyze its performance we present a new problem called the Negotiating Salesmen Problem. We have conducted some experiments with NB3 from which we conclude that it manages to decrease the traveling cost of the agents significantly, that it outperforms random search and that it scales well with the complexity of the problem.
We propose an application that allows users to request other users for help with every-day tasks.... more We propose an application that allows users to request other users for help with every-day tasks. Users can pay each other for these tasks by issuing contracts in which the requester promises to return the favor in the future by performing some task for the other. Such contracts can be seen as an alternative currency, coined by the users themselves. Trust is an essential aspect of this system, as the issuer of a contract may fail to fulfill its commitments. Therefore, the application comes with a social network where users can leave comments about other users. Furthermore, our application includes a market place where users can exchange service contracts between each other, and a negotiation
Recently, it has been proposed that Game Description Language (GDL) could be used to define negot... more Recently, it has been proposed that Game Description Language (GDL) could be used to define negotiation domains. This would open up an entirely new, declarative, approach to Automated Negotiations in which a single algorithm could negotiate over any domain, as long as that domain is expressible in GDL. However, until now, the feasibility of this approach has only been demonstrated on a few toy-world problems. Therefore, in this paper we show that GDL is a truly unifying language that can also be used to define more general and more complex negotiation domains. We demonstrate this by showing that some of the most commonly used test-beds in the Automated Negotiations literature, namely Genius and Colored Trails, can be described in GDL. More specifically, we formally prove that the set of possible agreements of any negotiation domain from Genius (either linear or non-linear) can be modeled as a set of strategies over a deterministic extensive-form game. Furthermore, we show that this game can be effectively described in GDL and we show experimentally that, given only this GDL description, we can explore the agreement space efficiently using entirely generic domain-independent algorithms. In addition, we show that the same holds for negotiation domains in the Colored Trails framework. This means that one could indeed implement a single negotiating agent that is capable of negotiating over a broad class of negotiation domains, including Genius and Colored Trails.
Uploads
Papers by Dave de Jonge