research-article

Sequential resource allocation in multiagent systems with uncertainties

Authors:

Jianhui Wu,

Edmund H. DurfeeAuthors Info & Claims

AAMAS '07: Proceedings of the 6th international joint conference on Autonomous agents and multiagent systems

Article No.: 114, Pages 1 - 8

https://doi.org/10.1145/1329125.1329265

Published: 14 May 2007 Publication History

Get Access

Abstract

Exchanging scarce resources during execution among a group of agents is one way to improve the overall performance in multiagent systems with limited shared resources, but implementing optimal sequential resource allocation is often a nontrivial problem in complex systems with uncertainties. In this paper, we present an MILP-based algorithm that can automatically break a large mission into multiple phases and make optimal resource (re)allocations at the entry of each phase. We illustrate our algorithms through several increasingly complex classes of sequential resource allocation problems, and show through experiments that our techniques can increase agents' rewards for varying levels of constraints on resources and constraints on exchanging resources.

References

[1]

E. Altman. Constrained Markov decision processes with total cost criteria: Lagrange approach and dual LP. Methods and Models in Operations Research, 48:387--417, 1998.

Crossref

Google Scholar

[2]

E. Altman. Constrained Markov Decision Processes. Chapman and HALL/CRC, New York, 1999.

Google Scholar

[3]

A. Bockmayr and Y. Dimopolous. Mixed integer programming models for planning problems. In CP-98 Constraint Problem Reformulation Workshop, 1998.

Google Scholar

[4]

W. Cook, W. Cunningham, W. Pulleyblank, and A. Schrijver. Combinatorial Optimization. John Wiley & Sons, New York, 1998.

Digital Library

Google Scholar

[5]

D. A. Dolgov and E. H. Durfee. Constructing optimal policies for agents with constrained architectures. Technical Report CSE-TR-476-03, University of Michigan, 2003.

Digital Library

Google Scholar

[6]

D. A. Dolgov and E. H. Durfee. Computationally efficient combinatorial auctions for resource allocation in weakly-coupled MDPs. In Proceedings of the Fourth International Joint Conference on Autonomous Agents and Multiagent Systems, July 2005.

Digital Library

Google Scholar

[7]

D. A. Dolgov and E. H. Durfee. Resource allocation among agents with MDP-induced preferences. Journal of Artificial Intelligence Research (JAIR-06), 27, November 2006.

Digital Library

Google Scholar

[8]

H. Kautz and J. Walser. Integer optimization models of AI planning problems. Knowledge Engineering Review, 15(1):101--117, 2000.

Digital Library

Google Scholar

[9]

N. Meuleau, M. Hauskrecht, K.-E. Kim, L. Peshkin, L. P. Kaelbling, T. Dean, and C. Boutilier. Solving very large weakly coupled Markov decision processes. In Proceedings of the fifteenth national/tenth conference on Artificial intelligence/innovative applications of artificial intelligence, pages 165--172, 1998.

Digital Library

Google Scholar

[10]

M. L. Puterman. Markov Decision Processes. John Wiley & Sons, New York, 1994.

Digital Library

Google Scholar

[11]

T. Vossen, M. Ball, A. Lotem, and D. Nau. On the use of integer programming models in AI planning. In Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence, pages 304--309, 1999.

Digital Library

Google Scholar

[12]

L. A. Wolsey. Integer Programming. John Wiley & Sons, New York, 1998.

Google Scholar

[13]

J. Wu and E. H. Durfee. Automated resource-driven mission phasing techniques for constrained agents. In Proceedings of the Fourth International Joint Conference on Autonomous Agents and Multiagent Systems, pages 331--338, 2005.

Digital Library

Google Scholar

[14]

J. Wu and E. H. Durfee. Mixed-integer linear programming for transition-independent decentralized MDPs. In Proceedings of the Fifth International Joint Conference on Autonomous Agents and Multiagent Systems, pages 1058--1060, 2006.

Digital Library

Google Scholar

Cited By

View all

Henrichs ELesch VStraesser MKounev SKrupitzer C(2022)A literature review on optimization techniques for adaptation planning in adaptive systemsInformation and Software Technology10.1016/j.infsof.2022.106940149:COnline publication date: 1-Sep-2022
https://dl.acm.org/doi/10.1016/j.infsof.2022.106940
Merdan MMoser TVrba PBiffl S(2010)Investigating the robustness of re-scheduling policies with multi-agent system simulationThe International Journal of Advanced Manufacturing Technology10.1007/s00170-010-3049-955:1-4(355-367)Online publication date: 1-Dec-2010
https://doi.org/10.1007/s00170-010-3049-9
Durfee E(2008)Planning for Coordination and Coordination for PlanningProceedings of the 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology - Volume 0110.1109/WIIAT.2008.389(1-3)Online publication date: 9-Dec-2008
https://dl.acm.org/doi/10.1109/WIIAT.2008.389
Show More Cited By

Index Terms

Sequential resource allocation in multiagent systems with uncertainties
1. Computing methodologies
  1. Artificial intelligence
2. Theory of computation
  1. Design and analysis of algorithms
    1. Algorithm design techniques
      1. Dynamic programming

Recommendations

Sequential Resource Allocation for Nonprofit Operations

This paper studies a sequential resource allocation problem motivated by distribution operations of a nonprofit organization. The alternate objectives that arise in nonprofit as opposed to commercial operations lead to new variations on traditional ...
Resource reconstruction algorithms for on-demand allocation in virtual computing resource pool

Resource reconstruction algorithms are studied in this paper to solve the problem of resource on-demand allocation and improve the efficiency of resource utilization in virtual computing resource pool. Based on the idea of resource virtualization and ...
Optimizing cloud resource allocation: A long short-term memory and DForest-based load balancing approach

Load balancing is an element that must exist for a cloud server to function properly. Without it, there would be substantial lag and the server won’t be able to operate as intended. In a Cloud computing (CC) establishing, load balancing is the process of ...

Comments

Information & Contributors

Information

Published In

AAMAS '07: Proceedings of the 6th international joint conference on Autonomous agents and multiagent systems

May 2007

1585 pages

ISBN:9788190426275

DOI:10.1145/1329125

Conference Chairs:
Edmund Durfee
University of Michigan
,
Makoto Yokoo
Kyushu University
,
Program Chairs:
Michael Huhns
University of South Carolina
,
Onn Shehory
IBM Haifa Research Lab, Israel

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 May 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Air Force Research Laboratory

Conference

AAMAS07

Sponsor:

AAMAS07: International Conference on Autonomous Agents and Mulitagent Systems

May 14 - 18, 2007

Hawaii, Honolulu

Acceptance Rates

Overall Acceptance Rate 1,155 of 5,036 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
216
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Henrichs ELesch VStraesser MKounev SKrupitzer C(2022)A literature review on optimization techniques for adaptation planning in adaptive systemsInformation and Software Technology10.1016/j.infsof.2022.106940149:COnline publication date: 1-Sep-2022
https://dl.acm.org/doi/10.1016/j.infsof.2022.106940
Merdan MMoser TVrba PBiffl S(2010)Investigating the robustness of re-scheduling policies with multi-agent system simulationThe International Journal of Advanced Manufacturing Technology10.1007/s00170-010-3049-955:1-4(355-367)Online publication date: 1-Dec-2010
https://doi.org/10.1007/s00170-010-3049-9
Durfee E(2008)Planning for Coordination and Coordination for PlanningProceedings of the 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology - Volume 0110.1109/WIIAT.2008.389(1-3)Online publication date: 9-Dec-2008
https://dl.acm.org/doi/10.1109/WIIAT.2008.389
Savarimuthu BCranefield SPurvis MPurvis M(2007)Norm Emergence in Agent Societies Formed by Dynamically Changing NetworksProceedings of the 2007 IEEE/WIC/ACM International Conference on Intelligent Agent Technology10.1109/IAT.2007.76(464-470)Online publication date: 2-Nov-2007
https://dl.acm.org/doi/10.1109/IAT.2007.76

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Sequential Resource Allocation for Nonprofit Operations

Resource reconstruction algorithms for on-demand allocation in virtual computing resource pool

Optimizing cloud resource allocation: A long short-term memory and DForest-based load balancing approach