Applying MDP Approaches for Estimating Outcome of Interaction in Collaborative Human-Computer Settings
DSpace/Manakin Repository
Applying MDP Approaches for Estimating Outcome of Interaction in Collaborative Human-Computer Settings
| Title: | Applying MDP Approaches for Estimating Outcome of Interaction in Collaborative Human-Computer Settings |
| Author: |
Kamar, Ece; Grosz, Barbara
Note: Order does not necessarily reflect citation order of authors. |
| Citation: | Kramer, Ece and Barbara J. Grosz. 2007. Applying MDP approaches for estimating outcome of interaction in collaborative human-computer settings. Workshop paper presented at Multi-Agent Sequential Decision Making in Uncertain Domains (MSDM) workshop, Honolulu, Hawaii, May 14-18, 2007. |
| Full Text & Related Files: |
Grosz_ApplyingMDP.pdf (285.7Kb; PDF) 
|
| Abstract: | This paper investigates the problem of determining when a computer agent should interrupt a person with whom it is working collaboratively as part of a distributed, multi-agent team, which is operating in environments in which conditions may be rapidly changing, actions occur at a fast pace, and decisions must be made within tightly constrained time frames. An interruption would enable the agent to obtain information useful for performing its role in the team task, but the person will incur a cost in responding. The paper presents a formalization of interruptions as multi-agent decision making. It defines a novel, efficient approximation method that decouples the multi-agent decision model into separate MDPs, thereby overcoming the complexity of finding optimal solutions of the Dec-POMDP model. For single-shot situations, the separate outcomes can be combined to give an exact value for the interruption. In more general settings, the closeness of the approximation to the optimal solution depends on the structure of the problem. The paper describes domain specific heuristic functions that improve the efficiency of the approximation further for a specific application. |
| Published Version: | http://cs.usc.edu/~maheswar/msdm2007/msdm2007proceedings.pdf |
| Terms of Use: | This article is made available under the terms and conditions applicable to Other Posted Material, as set forth at http://nrs.harvard.edu/urn-3:HUL.InstRepos:dash.current.terms-of-use#LAA |
| Citable link to this page: | http://nrs.harvard.edu/urn-3:HUL.InstRepos:2562367 |
| Downloads of this work: |
This item appears in the following Collection(s)
-
FAS Scholarly Articles [10848]
Contact administrator regarding this item (to report mistakes or request changes)
