Multidimensional beyond worst-case and almost-sure problems for mean-payoff objectives
Lorenzo Clemente, Jean-Fran\c{c}ois Raskin

TL;DR
This paper extends the analysis of beyond worst-case problems for mean-payoff objectives to multidimensional cases, exploring strategy memory requirements and introducing a relaxed problem with efficient solutions.
Contribution
It generalizes the BWC problem to multidimensional mean-payoff objectives, determines complexity bounds for finite and infinite-memory strategies, and introduces a tractable relaxation called BAS.
Findings
Multidimensional BWC problem is coNP-complete for both strategy types.
Special case with unidimensional worst-case objective reduces complexity to NP∩coNP.
BAS problem is solvable in polynomial time.
Abstract
The beyond worst-case threshold problem (BWC), recently introduced by Bruy\`ere et al., asks given a quantitative game graph for the synthesis of a strategy that i) enforces some minimal level of performance against any adversary, and ii) achieves a good expectation against a stochastic model of the adversary. They solved the BWC problem for finite-memory strategies and unidimensional mean-payoff objectives and they showed membership of the problem in NPcoNP. They also noted that infinite-memory strategies are more powerful than finite-memory ones, but the respective threshold problem was left open. We extend these results in several directions. First, we consider multidimensional mean-payoff objectives. Second, we study both finite-memory and infinite-memory strategies. We show that the multidimensional BWC problem is coNP-complete in both cases. Third, in the special case when…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsOptimization and Search Problems · Reinforcement Learning in Robotics · Computability, Logic, AI Algorithms
