Skip to Main Content
 

Global Search Box

 
 
 
 

Files

File List


Hons_Paper.pdf (318.24 KB)

ETD Abstract Container

Abstract Header

Increasing the Value of Information During Planning in Uncertain Environments

Pokharel, Gaurab
http://orcid.org/0000-0003-3188-4470
http://rave.ohiolink.edu/etdc/view?acc_num=oberlin1624976272271825

Abstract Details

2021, BA, Oberlin College, Computer Science.
Prior studies have demonstrated that for many real-world problems, POMDPs can be solved through online algorithms both quickly and with near optimality [10, 8, 6]. However, on an important set of problems where there is a large time delay between when the agent can gather information and when it needs to use that information, these solutions fail to adequately consider the value of information. As a result, information gathering actions, even when they are critical in the optimal policy, will be ignored by existing solutions, leading to sub-optimal decisions by the agent. In this research, we develop a novel solution that rectifies this problem by introducing a new algorithm that improves upon state-of-the-art online planning by better reflecting on the value of actions that gather information. We do this by adding Entropy to the UCB1 heuristic in the POMCP algorithm. We test this solution on the hallway problem. Results indicate that our new algorithm performs significantly better than POMCP.
Adam Eck (Advisor)
22 p.
Artificial Intelligence; Computer Science
POMDPs; Artificial Intelligence; Computer Science; Planning; Uncertainty; Domain; Markov Decision Process; POMCP

Recommended Citations

Citations

  • Pokharel, G. (2021). Increasing the Value of Information During Planning in Uncertain Environments [Undergraduate thesis, Oberlin College]. OhioLINK Electronic Theses and Dissertations Center. http://rave.ohiolink.edu/etdc/view?acc_num=oberlin1624976272271825

    APA Style (7th edition)

  • Pokharel, Gaurab. Increasing the Value of Information During Planning in Uncertain Environments. 2021. Oberlin College, Undergraduate thesis. OhioLINK Electronic Theses and Dissertations Center, http://rave.ohiolink.edu/etdc/view?acc_num=oberlin1624976272271825.

    MLA Style (8th edition)

  • Pokharel, Gaurab. "Increasing the Value of Information During Planning in Uncertain Environments." Undergraduate thesis, Oberlin College, 2021. http://rave.ohiolink.edu/etdc/view?acc_num=oberlin1624976272271825

    Chicago Manual of Style (17th edition)

oberlin1624976272271825
110
© 2021, some rights reserved.Creative Commons License Increasing the Value of Information During Planning in Uncertain Environments by Gaurab Pokharel is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License. Based on a work at etd.ohiolink.edu.
This open access ETD is published by Oberlin College Honors Theses and OhioLINK.