Enabling Environment Design via Active Indirect Elicitation

DSpace/Manakin Repository

Enabling Environment Design via Active Indirect Elicitation

Citable link to this page


Title: Enabling Environment Design via Active Indirect Elicitation
Author: Zhang, Haoqi; Parkes, David

Note: Order does not necessarily reflect citation order of authors.

Citation: Zhang, Haoqi, and David C. Parkes. 2008. Enabling environment design via active indirect elicitation. Paper presented at the 4th Multidisciplinary Workshop on Advances in Preference Handling (MRPERF'08) Chicago IL, July 2008
Full Text & Related Files:
Abstract: Many situations arise in which an interested party wishes to
affect the decisions of an agent; e.g., a teacher that seeks to
promote particular study habits, a Web 2.0 site that seeks to
encourage users to contribute content, or an online retailer
that seeks to encourage consumers to write reviews. In the
problem of environment design, one assumes an interested
party who is able to alter limited aspects of the environment
for the purpose of promoting desirable behaviors. A critical
aspect of environment design is understanding preferences,
but by assumption direct queries are unavailable. We work in
the inverse reinforcement learning framework, adopting here
the idea of active indirect preference elicitation to learn the reward function of the agent by observing behavior in response
to incentives. We show that the process is convergent and
obtain desirable bounds on the number of elicitation rounds.
We briefly discuss generalizations of the elicitation method to
other forms of environment design, e.g., modifying the state
space, transition model, and available actions.
Published Version: http://www.eecs.harvard.edu/econcs/pubs/zp-mpref08.pdf
Terms of Use: This article is made available under the terms and conditions applicable to Other Posted Material, as set forth at http://nrs.harvard.edu/urn-3:HUL.InstRepos:dash.current.terms-of-use#LAA
Citable link to this page: http://nrs.harvard.edu/urn-3:HUL.InstRepos:3122493
Downloads of this work:

Show full Dublin Core record

This item appears in the following Collection(s)


Search DASH

Advanced Search