Applying MDP Approaches for Estimating Outcome of Interaction in Collaborative Human-Computer Settings

View/ Open
Author
Kamar, Ece
Note: Order does not necessarily reflect citation order of authors.
Published Version
http://cs.usc.edu/~maheswar/msdm2007/msdm2007proceedings.pdfMetadata
Show full item recordCitation
Kramer, Ece and Barbara J. Grosz. 2007. Applying MDP approaches for estimating outcome of interaction in collaborative human-computer settings. Workshop paper presented at Multi-Agent Sequential Decision Making in Uncertain Domains (MSDM) workshop, Honolulu, Hawaii, May 14-18, 2007.Abstract
This paper investigates the problem of determining when a computer agent should interrupt a person with whom it is working collaboratively as part of a distributed, multi-agent team, which is operating in environments in which conditions may be rapidly changing, actions occur at a fast pace, and decisions must be made within tightly constrained time frames. An interruption would enable the agent to obtain information useful for performing its role in the team task, but the person will incur a cost in responding. The paper presents a formalization of interruptions as multi-agent decision making. It defines a novel, efficient approximation method that decouples the multi-agent decision model into separate MDPs, thereby overcoming the complexity of finding optimal solutions of the Dec-POMDP model. For single-shot situations, the separate outcomes can be combined to give an exact value for the interruption. In more general settings, the closeness of the approximation to the optimal solution depends on the structure of the problem. The paper describes domain specific heuristic functions that improve the efficiency of the approximation further for a specific application.Terms of Use
This article is made available under the terms and conditions applicable to Other Posted Material, as set forth at http://nrs.harvard.edu/urn-3:HUL.InstRepos:dash.current.terms-of-use#LAACitable link to this page
http://nrs.harvard.edu/urn-3:HUL.InstRepos:2562367
Collections
- FAS Scholarly Articles [17582]
Contact administrator regarding this item (to report mistakes or request changes)