Applying MDP Approaches for Estimating Outcome of Interaction in Collaborative Human-Computer Settings

DSpace/Manakin Repository

Applying MDP Approaches for Estimating Outcome of Interaction in Collaborative Human-Computer Settings

Citable link to this page

. . . . . .

Title: Applying MDP Approaches for Estimating Outcome of Interaction in Collaborative Human-Computer Settings
Author: Kamar, Ece; Grosz, Barbara

Note: Order does not necessarily reflect citation order of authors.

Citation: Kramer, Ece and Barbara J. Grosz. 2007. Applying MDP approaches for estimating outcome of interaction in collaborative human-computer settings. Workshop paper presented at Multi-Agent Sequential Decision Making in Uncertain Domains (MSDM) workshop, Honolulu, Hawaii, May 14-18, 2007.
Full Text & Related Files:
Abstract: This paper investigates the problem of determining when a computer agent should interrupt a person with whom it is working collaboratively as part of a distributed, multi-agent team, which is operating in environments in which conditions may be rapidly changing, actions occur at a fast pace, and decisions must be made within tightly constrained time frames. An interruption would enable the agent to obtain information useful for performing its role in the team task, but the person will incur a cost in responding. The paper presents a formalization of interruptions as multi-agent decision making. It defines a novel, efficient approximation method that decouples the multi-agent decision model into separate MDPs, thereby overcoming the complexity of finding optimal solutions of the Dec-POMDP model. For single-shot situations, the separate outcomes can be combined to give an exact value for the interruption. In more general settings, the closeness of the approximation to the optimal solution depends on the structure of the problem. The paper describes domain specific heuristic functions that improve the efficiency of the approximation further for a specific application.
Published Version: http://cs.usc.edu/~maheswar/msdm2007/msdm2007proceedings.pdf
Terms of Use: This article is made available under the terms and conditions applicable to Other Posted Material, as set forth at http://nrs.harvard.edu/urn-3:HUL.InstRepos:dash.current.terms-of-use#LAA
Citable link to this page: http://nrs.harvard.edu/urn-3:HUL.InstRepos:2562367

Show full Dublin Core record

This item appears in the following Collection(s)

  • FAS Scholarly Articles [7470]
    Peer reviewed scholarly articles from the Faculty of Arts and Sciences of Harvard University
 
 

Search DASH


Advanced Search
 
 

Submitters