Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Behavior Learning of Autonomous Agents in Continuous State Using Function Approximation

  • Conference paper
Knowledge-Based Intelligent Information and Engineering Systems (KES 2004)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 3213))

  • 733 Accesses

Abstract

This paper presents a method for behavior learning of an autonomous agent using modified Learning Vector Quantization (LVQ) with fuzzy sets in continuous state space. When the environment is a continuous state space, it has infinitely many state values. So, it is impossible to learn a good action to take in each of the state values. This paper uses a function approximation technique based on the LVQ algorithm to learn actions of agent in continuous state space. An advantage of this technique is that it can represent the mapping between the continuous-valued state space and appropriate actions with a finite number of parameters. An example illustrates its validity in continuous space problems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)

    Google Scholar 

  2. Watkins, C.J.C.H., Dynan, P.: Techmical note: Q-Learning. Machine Learning (1992)

    Google Scholar 

  3. Shon., M.K., Murata, J., Hirasawa, K.: Behavior learning of Autonomous Robots by Modified Learning Vector Quantization. Trans. of the Society of Instrument and Control Engineers (2001)

    Google Scholar 

  4. Kohonen, T.: Self-Organizing Maps. Springer Series in Information Sciences. Springer, Heidelberg (1995)

    Google Scholar 

  5. Kohonen., T.: Learning Vector Quantization for Pattern Recognition, Technical Report TKK-F-A602 (1990)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Shon, MK., Murata, J. (2004). Behavior Learning of Autonomous Agents in Continuous State Using Function Approximation. In: Negoita, M.G., Howlett, R.J., Jain, L.C. (eds) Knowledge-Based Intelligent Information and Engineering Systems. KES 2004. Lecture Notes in Computer Science(), vol 3213. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30132-5_164

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-30132-5_164

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-23318-3

  • Online ISBN: 978-3-540-30132-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics