# What's to know? Uncertainty as a Guide to Asking Goal-oriented Questions

**Authors:** Ehsan Abbasnejad, Qi Wu, Javen Shi, Anton van den Hengel

arXiv: 1812.06401 · 2018-12-18

## TL;DR

This paper introduces a Bayesian uncertainty model for visual dialogue agents that guides question asking to efficiently gather information and determine when enough has been acquired, improving goal-oriented performance.

## Contribution

It presents a novel Bayesian approach to quantify uncertainty in dialogue agents, enabling active information seeking and better decision-making in goal-oriented tasks.

## Key findings

- Outperforms baseline models on visual collaboration tasks
- Effective in negotiation-based dialogue scenarios
- Reduces ambiguity by selecting questions that minimize predicted regret

## Abstract

One of the core challenges in Visual Dialogue problems is asking the question that will provide the most useful information towards achieving the required objective. Encouraging an agent to ask the right questions is difficult because we don't know a-priori what information the agent will need to achieve its task, and we don't have an explicit model of what it knows already. We propose a solution to this problem based on a Bayesian model of the uncertainty in the implicit model maintained by the visual dialogue agent, and in the function used to select an appropriate output. By selecting the question that minimises the predicted regret with respect to this implicit model the agent actively reduces ambiguity. The Bayesian model of uncertainty also enables a principled method for identifying when enough information has been acquired, and an action should be selected. We evaluate our approach on two goal-oriented dialogue datasets, one for visual-based collaboration task and the other for a negotiation-based task. Our uncertainty-aware information-seeking model outperforms its counterparts in these two challenging problems.

## Full text

_Full body text omitted from this summary view._ Fetch the complete paper as Markdown: https://tomesphere.com/paper/1812.06401/full.md

## Figures

4 figures with captions in the complete paper: https://tomesphere.com/paper/1812.06401/full.md

## References

38 references — full list in the complete paper: https://tomesphere.com/paper/1812.06401/full.md

---
Source: https://tomesphere.com/paper/1812.06401