Learning Data-Driven Objectives to Optimize Interactive Systems
Ziming Li, Julia Kiseleva, Alekh Agarwal, Maarten de Rijke

TL;DR
This paper introduces a data-driven approach to infer user objectives from interactions and optimize interactive systems accordingly, improving user experience without manual objective crafting.
Contribution
It presents a novel algorithm for inferring objectives from user interactions and demonstrates its effectiveness in optimizing systems across various simulations.
Findings
High effectiveness in simulation-based tests
Ability to infer objectives without prior knowledge
Improved system optimization results
Abstract
Effective optimization is essential for interactive systems to provide a satisfactory user experience. However, it is often challenging to find an objective to optimize for. Generally, such objectives are manually crafted and rarely capture complex user needs in an accurate manner. We propose an approach that infers the objective directly from observed user interactions. These inferences can be made regardless of prior knowledge and across different types of user behavior. We introduce interactive system optimization, a novel algorithm that uses these inferred objectives for optimization. Our main contribution is a new general principled approach to optimizing interactive systems using data-driven objectives. We demonstrate the high effectiveness of interactive system optimization over several simulations.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsArtificial Intelligence in Games · Human Motion and Animation · Educational Games and Gamification
