Skip to Main Content
 

Global Search Box

 
 
 
 

Files

File List


case1354813154.pdf (600.04 KB)

ETD Abstract Container

Abstract Header

Integrating Deterministic Planning and Reinforcement Learning for Complex Sequential Decision Making

Ernsberger, Timothy S.
http://rave.ohiolink.edu/etdc/view?acc_num=case1354813154

Abstract Details

2013, Master of Sciences (Engineering), Case Western Reserve University, EECS - Computer and Information Sciences.
This thesis presents a novel approach to solving decision-making problems in discrete, stochastic domains. The method for solving these problems is often dictated by the availability of information about how the environment responds to actions taken by the agent. When the agent is given a model of the environment, it can plan out its actions beforehand, whereas an agent without a model must learn to differentiate good and bad decisions through direct experience. Until now, little attention has been paid to situations in which a model is only available for a part of the environment. We propose an algorithm which combines automated planning with hierarchical reinforcement learning in order to take advantage of the model when it is available and sample from the environment when it is not. We prove that the same guarantees of optimality that apply to hierarchical reinforcement learning also apply to to this approach. Using experiments performed in two different domains, we demonstrate that hierarchically integrated planning and reinforcement learning outperforms pure RL and pure planning hierarchies and that this approach can scale to larger problems than are reasonably computable by other approaches.
Soumya Ray (Advisor)
Podgurski Andy (Committee Member)
Lewicki Michael (Committee Member)
Artificial Intelligence
reinforcement learning; automated planning; Markov decision process

Recommended Citations

Citations

  • Ernsberger, T. S. (2013). Integrating Deterministic Planning and Reinforcement Learning for Complex Sequential Decision Making [Master's thesis, Case Western Reserve University]. OhioLINK Electronic Theses and Dissertations Center. http://rave.ohiolink.edu/etdc/view?acc_num=case1354813154

    APA Style (7th edition)

  • Ernsberger, Timothy. Integrating Deterministic Planning and Reinforcement Learning for Complex Sequential Decision Making. 2013. Case Western Reserve University, Master's thesis. OhioLINK Electronic Theses and Dissertations Center, http://rave.ohiolink.edu/etdc/view?acc_num=case1354813154.

    MLA Style (8th edition)

  • Ernsberger, Timothy. "Integrating Deterministic Planning and Reinforcement Learning for Complex Sequential Decision Making." Master's thesis, Case Western Reserve University, 2013. http://rave.ohiolink.edu/etdc/view?acc_num=case1354813154

    Chicago Manual of Style (17th edition)

case1354813154
685
© 2012, some rights reserved.Creative Commons License Integrating Deterministic Planning and Reinforcement Learning for Complex Sequential Decision Making by Timothy S. Ernsberger is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License. Based on a work at etd.ohiolink.edu.
This open access ETD is published by Case Western Reserve University School of Graduate Studies and OhioLINK.