Socrates Sim: A Dialog Simulation Framework to Support Task Completion Dialog Research

Abstract

In this thesis, we propose an end-to-end dialog simulation framework, called Socrates Sim, to support task completion dialog research. The goal of the framework is to provide a set of tools that will simulate conversations between a user simulator and a dialog agent in order evaluate the performance of the dialog agent and generate annotated data. Specifically, Socrates Sim framework allows the researcher to define the custom dialog domains, build user simulators, and run multiple simulations with a provided dialog agent. To demonstrate the flexibility of the framework to generalize to new domains, we will implement end-to-end simulations for the restaurant recom- mendation and move booking use case. The framework is implemented in Python 3.6 and made available on github (https://github.com/dhairyadalal/socrates).