article

A survey of algorithmic methods for partially observed Markov decision processes

Author:

William S. LovejoyAuthors Info & Claims

Annals of Operations Research, Volume 28, Issue 1-4

Pages 47 - 66

https://doi.org/10.1007/BF02055574

Published: 01 June 1991 Publication History

Abstract

No abstract available.

Cited By

View all

Núñez-Molina CMesejo PFernández-Olivares J(2024)A Review of Symbolic, Subsymbolic and Hybrid Methods for Sequential Decision MakingACM Computing Surveys10.1145/366336656:11(1-36)Online publication date: 28-Jun-2024
https://dl.acm.org/doi/10.1145/3663366
Ammar HAdve RShahbazpanahi SBoudreau GSrinivas K(2024)Handoffs in User-Centric Cell-Free MIMO Networks: A POMDP FrameworkIEEE Transactions on Wireless Communications10.1109/TWC.2024.337137923:8_Part_2(10319-10335)Online publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1109/TWC.2024.3371379
Mitchell M(2024)A hybrid connectionist/LCS for hidden-state problemsNeural Computing and Applications10.1007/s00521-024-09758-z36:22(13579-13603)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1007/s00521-024-09758-z
Show More Cited By

Index Terms

A survey of algorithmic methods for partially observed Markov decision processes

Recommendations

Computationally Feasible Bounds for Partially Observed Markov Decision Processes

<P>A partially observed Markov decision process POMDP is a sequential decision problem where information concerning parameters of interest is incomplete, and possible actions include sampling, surveying, or otherwise collecting additional information. ...
Solution Procedures for Partially Observed Markov Decision Processes

We present three algorithms to solve the infinite horizon, expected discounted total reward partially observed Markov decision process POMDP. Each algorithm integrates a successive approximations algorithm for the POMDP due to A. Smallwood and E. Sondik ...
State of the Art-A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms

This paper surveys models and algorithms dealing with partially observable Markov decision processes. A partially observable Markov decision process POMDP is a generalization of a Markov decision process which permits uncertainty regarding the state of ...

Comments

Information & Contributors

Information

Published In

cover image Annals of Operations Research

Annals of Operations Research Volume 28, Issue 1-4

April 1991

306 pages

ISSN:0254-5330

Editor:
Peter L. Hammer
Rutgers Univ., New Brunswick, NJ

Issue’s Table of Contents

Publisher

J. C. Baltzer AG, Science Publishers

United States

Publication History

Published: 01 June 1991

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

101
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 04 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Núñez-Molina CMesejo PFernández-Olivares J(2024)A Review of Symbolic, Subsymbolic and Hybrid Methods for Sequential Decision MakingACM Computing Surveys10.1145/366336656:11(1-36)Online publication date: 28-Jun-2024
https://dl.acm.org/doi/10.1145/3663366
Ammar HAdve RShahbazpanahi SBoudreau GSrinivas K(2024)Handoffs in User-Centric Cell-Free MIMO Networks: A POMDP FrameworkIEEE Transactions on Wireless Communications10.1109/TWC.2024.337137923:8_Part_2(10319-10335)Online publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1109/TWC.2024.3371379
Mitchell M(2024)A hybrid connectionist/LCS for hidden-state problemsNeural Computing and Applications10.1007/s00521-024-09758-z36:22(13579-13603)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1007/s00521-024-09758-z
Kara AYüksel S(2023)Convergence of Finite Memory Q Learning for POMDPs and Near Optimality of Learned Policies Under Filter StabilityMathematics of Operations Research10.1287/moor.2022.133148:4(2066-2093)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1287/moor.2022.1331
Helmeczi RKavaklioglu CCevik M(2023)Linear programming-based solution methods for constrained partially observable Markov decision processesApplied Intelligence10.1007/s10489-023-04603-753:19(21743-21769)Online publication date: 10-Jun-2023
https://dl.acm.org/doi/10.1007/s10489-023-04603-7
Zhang H(2022)Dynamic Learning and Decision Making via Basis Weight VectorsOperations Research10.1287/opre.2021.224070:3(1835-1853)Online publication date: 1-May-2022
https://dl.acm.org/doi/10.1287/opre.2021.2240
Sharma VSzalachowski PZhou JSuga YSakurai KDing XSako K(2022)Evaluating Blockchain Protocols with Abusive ModelingProceedings of the 2022 ACM on Asia Conference on Computer and Communications Security10.1145/3488932.3497757(109-122)Online publication date: 30-May-2022
https://dl.acm.org/doi/10.1145/3488932.3497757
Zhu ZZhao H(2022)A Survey of Deep RL and IL for Autonomous Driving Policy LearningIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2021.313470223:9(14043-14065)Online publication date: 1-Sep-2022
https://dl.acm.org/doi/10.1109/TITS.2021.3134702
Huang WXue YXu ZPeng GWu Y(2022)Polyphonic music generation generative adversarial network with Markov decision processMultimedia Tools and Applications10.1007/s11042-022-12925-w81:21(29865-29885)Online publication date: 1-Sep-2022
https://dl.acm.org/doi/10.1007/s11042-022-12925-w
Baier CHermanns HKatoen J(2022)The 10,000 Facets of MDP Model CheckingComputing and Software Science10.1007/978-3-319-91908-9_21(420-451)Online publication date: 11-Mar-2022
https://dl.acm.org/doi/10.1007/978-3-319-91908-9_21
Show More Cited By

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

Cited By

Index Terms

Recommendations

Computationally Feasible Bounds for Partially Observed Markov Decision Processes

Solution Procedures for Partially Observed Markov Decision Processes

State of the Art-A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms

Comments

Information

Published In

Publisher

Publication History

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Get Access

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations