article

Automated Test Case Generation for BDI Agents

Authors:

Ralph RónnquistAuthors Info & Claims

Autonomous Agents and Multi-Agent Systems, Volume 2, Issue 4

Pages 311 - 332

https://doi.org/10.1023/A:1010011219782

Published: 01 November 1999 Publication History

Abstract

We propose a coverage oriented test case generation methodology for BDI multi-agent systems. The coverage criteria involve plans and nodes within plans of multi-agent systems. We organise the criteria into a subsumption hierarchy to show the coverage relationships between the criteria. Then we apply the criteria on multi-agent systems to analyse some empirical data. The data analysed is the effect on the number of test cases generated automatically for each criterion. We use a tool, BDITESTER, to obtain the empirical data and to show that our proposal is pragmatic. Finally, we suggest some guidelines to select a criterion to automatically generate test cases for BDI agents.

References

[1]

1. AAII, "The dMARS version 1.6.12 system overview." Australian Artificial Intelligence Institute, Melbourne, Australia, 1997.

[2]

2. N. L. Biggs, Algebraic Graph Theory, Cambridge, University Press: Cambridge, UK, second edition, 1993.

[3]

3. D. B. Brown, S. Maghsoodloo, and W. H. Deason, "A cost model for determining the optimal number of software test cases," IEEE Transactions on Software Engineering vol. 15(2), pp. 218-221, 1989.

Digital Library

[4]

4. P. Busetta and R. Kotagiri, "An architecture for mobile BDI agents," Department of Computer Science, University of Melbourne, Melbourne, Australia, Technical Report TR 97/16, 1997.

[5]

5. T. Y. Chen and M. F. Lau, "Dividing strategies for the optimization of a test suite," Information Processing Letters vol. 60, pp. 135-141, 1996.

Digital Library

[6]

6. C.-G. Chung and J.-G. Lee, "An enhanced zero-one optimal path set selection method," The Journal of Systems and Software vol. 39(2), pp. 145-164, 1997.

Digital Library

[7]

7. R. Ferguson and B. Korel, "The chaining approach for software test data generation," ACM Transactions on Software Engineering and Methodology vol. 5(1), pp. 63-86, 1996.

Digital Library

[8]

8. P. G. Frankl and S. N. Weiss, "An experimental comparison of the effectiveness of branch testing and data flow testing," IEEE Transactions on Software Engineering vol. 19(8), pp. 774-787, 1993.

Digital Library

[9]

9. P. G. Frankl and E. J. Weyuker, "A analytical comparison of the fault-detecting ability of data flow testing techniques," in Proceedings of the 15th International Conference on Software Engineering (ICSE-93), 1993, pp. 415-424.

Digital Library

[10]

10. P. G. Frankl and E. J. Weyuker, "A formal analysis of the fault-detecting ability of testing methods," IEEE Transactions on Software Engineering vol. 19(3), pp. 202-213, 1997.

Digital Library

[11]

11. M. J. Gallagher, "ADTEST: A test data generation suite for ada software systems," IEEE Transactions on Software Engineering vol. 23(8), pp. 473-484, 1997.

Digital Library

[12]

12. M. R. Genesereth and S. P. Ketchpel, "Software agents," Communications of the ACM vol. 37(7), pp. 48-53, 1994.

Digital Library

[13]

13. D. D. Givone, Introduction to Switching Circuit Theory, McGraw-Hill: New York, 1970.

[14]

14. R. V. Guha and D. B. Lenat, "Enabling agents to work together," Communications of the ACM vol. 37(7), pp. 127-142, 1994.

Digital Library

[15]

15. A. Haddadi and K. Sundermeyer, "Belief desire intention agent architectures," in G. M. P. O'Hare and N. R. Jennings (eds.), Foundations of Distributed Artificial Intelligence, Wiley, New York, Chap. 5, 1996.

Digital Library

[16]

16. B. Korel, "Automated software test data generation," IEEE Transactions on Software Engineering vol. 16(8), pp. 870-879, 1990.

Digital Library

[17]

17. S. C. Laufmann, "Towards agent-based software engineering for information-dependent enterprise applications," IEE Proceedings--Software Engineering vol. 144(1), pp. 38-50, 1997.

[18]

18. H. K. N. Leung and L. White, "Insights into regression testing," in Proceedings of Conference on Software Maintenance, 1989, pp. 60-69.

[19]

19. H. J. Levesque, P. R. Cohen, and J. H. T. Nunes, "On acting together," in Proceedings of the 8th National Conference on Artificial Intelligence (AAAI-90), 1996, pp. 94-99.

Digital Library

[20]

20. C. K. Low, "BIBSEARCH: A multi-agent bibliographic searcher system," Department of Computer Science, University of Melbourne, Melbourne, Australia, Technical Report TR 97/18.

[21]

21. G. Myers, The Art of Software Testing, Wiley: New York, 1979.

Digital Library

[22]

22. H. S. Nwana, "Software agents: An overview," The Knowledge Engineering Review vol. 11(3), pp. 205-245, 1996.

[23]

23. T. Oates, M. V. Nagendra Prasad, and V. R. Lesser, "Cooperative information-gathering: A distributed problem-solving approach," IEE Proceedings--Software Engineering vol. 144(1), pp. 72-88, 1997.

[24]

24. A. S. Rao and M. P. Georgeff, 'BDI agents: From theory to practice," in: Proceedings of the 1st International Conference on Multi-Agent Systems (ICMAS-95), 1995, pp. 312-319.

[25]

25. Y. Shoham, "Agent-oriented programming," Artificial Intelligence vol. 60, pp. 51-92, 1993.

Digital Library

[26]

26. K. Sycara, K. Decker, A. Pannu, M. Williamson, and D. Zeng, "Distributed intelligent agents," IEEE Expert, vol. 11(6), pp. 36-46, 1996.

Digital Library

[27]

27. L. J. White and B. Wiszniewski, "Path testing of computer programs with loops using a tool for simple loop patterns," Software--Practice and Experience vol. 21(10), pp. 1075-1102, 1991.

Digital Library

[28]

28. M. Wooldridge and N. R. Jennings, "Intelligent agents: Theory and practice," The Knowledge Engineering Review, vol. 10(2), pp. 115-152, 1995.

Cited By

Peischl BTazl OWotawa F(2022)Testing anticipatory systemsJournal of Systems and Software10.1016/j.jss.2022.111387192:COnline publication date: 25-Aug-2022
https://dl.acm.org/doi/10.1016/j.jss.2022.111387
Bakar NSelamat A(2018)Agent systems verificationApplied Intelligence10.1007/s10489-017-1112-z48:5(1251-1274)Online publication date: 1-May-2018
https://dl.acm.org/doi/10.1007/s10489-017-1112-z
Hernández-Orallo J(2015)On environment difficulty and discriminating powerAutonomous Agents and Multi-Agent Systems10.1007/s10458-014-9257-129:3(402-454)Online publication date: 1-May-2015
https://dl.acm.org/doi/10.1007/s10458-014-9257-1
Show More Cited By

Index Terms

Automated Test Case Generation for BDI Agents
1. Computing methodologies
  1. Artificial intelligence
    1. Distributed artificial intelligence
      1. Multi-agent systems
2. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Index terms have been assigned to the content through auto-classification.

Recommendations

An Evaluation of Specification Based Test Generation Techniques Using Model Checkers
TAIC-PART '09: Proceedings of the 2009 Testing: Academic and Industrial Conference - Practice and Research Techniques

Test case generation can be represented as a model checking problem, such that model checking tools automatically generate test cases. This has previously been applied to testing techniques such as coverage criteria, combinatorial testing, mutation ...
An approach for experimentally evaluating effectiveness and efficiency of coverage criteria for software testing

Experimental work in software testing has generally focused on evaluating the effectiveness and effort requirements of various coverage criteria. The important issue of testing efficiency has not been sufficiently addressed. In this paper, we describe ...
A unified framework for evaluating test criteria in model-checking-assisted test case generation

Testing is often cited as one of the most costly operations in testing dependable systems (Heimdahl et al. 2001 ). A particular challenging task in testing is test-case generation. To improve the efficiency of test-case generation and reduce its cost, ...

Comments

Information & Contributors

Information

Published In

cover image Autonomous Agents and Multi-Agent Systems

Autonomous Agents and Multi-Agent Systems Volume 2, Issue 4

November 1999

97 pages

ISSN:1387-2532

Issue’s Table of Contents

Copyright © Copyright © 1999 Kluwer Academic Publishers.

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 November 1999

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Peischl BTazl OWotawa F(2022)Testing anticipatory systemsJournal of Systems and Software10.1016/j.jss.2022.111387192:COnline publication date: 25-Aug-2022
https://dl.acm.org/doi/10.1016/j.jss.2022.111387
Bakar NSelamat A(2018)Agent systems verificationApplied Intelligence10.1007/s10489-017-1112-z48:5(1251-1274)Online publication date: 1-May-2018
https://dl.acm.org/doi/10.1007/s10489-017-1112-z
Hernández-Orallo J(2015)On environment difficulty and discriminating powerAutonomous Agents and Multi-Agent Systems10.1007/s10458-014-9257-129:3(402-454)Online publication date: 1-May-2015
https://dl.acm.org/doi/10.1007/s10458-014-9257-1
Bagić Babac MJevtić D(2014)AgentTestNeurocomputing10.1016/j.neucom.2014.04.060146:C(230-248)Online publication date: 15-Oct-2014
https://dl.acm.org/doi/10.1016/j.neucom.2014.04.060
.Savarimuthu SWinikoff M(2013)Mutation operators for the GOAL agent languageProceedings of the First International Conference on Engineering Multi-Agent Systems10.5555/3100666.3100680(255-273)Online publication date: 6-May-2013
https://dl.acm.org/doi/10.5555/3100666.3100680
Miller TPadgham LThangarajah J(2010)Test coverage criteria for agent interaction testingProceedings of the 11th international conference on Agent-oriented software engineering10.5555/2050167.2050175(91-105)Online publication date: 10-May-2010
https://dl.acm.org/doi/10.5555/2050167.2050175
Kissoum YSahnoun ZBarkaoui K(2010)Model-based testing approach for mobile agents using the paradigm of reference netMultiagent and Grid Systems10.5555/1923401.19234026:4(271-292)Online publication date: 1-Dec-2010
https://dl.acm.org/doi/10.5555/1923401.1923402
Zhang ZThangarajah JPadgham L(2008)Automated unit testing intelligent agents in PDTProceedings of the 7th international joint conference on Autonomous agents and multiagent systems: demo papers10.5555/1402744.1402759(1673-1674)Online publication date: 12-May-2008
https://dl.acm.org/doi/10.5555/1402744.1402759
Sudeikat JBraubach LPokahr ALamersdorf WRenz W(2006)Validation of BDI agentsProceedings of the 4th international conference on Programming multi-agent systems10.5555/1759324.1759339(185-200)Online publication date: 9-May-2006
https://dl.acm.org/doi/10.5555/1759324.1759339
Luck MMcBurney PPreist C(2004)A Manifesto for Agent TechnologyAutonomous Agents and Multi-Agent Systems10.1023/B:AGNT.0000038027.29035.7c9:3(203-252)Online publication date: 1-Nov-2004
https://dl.acm.org/doi/10.1023/B%3AAGNT.0000038027.29035.7c

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents