Deducing Vertex Weights from Empirical Occupation Times
Joshua N. Cooper

TL;DR
This paper investigates whether vertex weights in a graph can be deduced from empirical occupation times of random walkers, proposing an iterative numerical method and exploring theoretical conditions for solution existence.
Contribution
It introduces an iterative numerical approach for reconstructing vertex weights from occupation times and proves the conjecture for trees and complete graphs.
Findings
An iterative method for weight reconstruction from occupation times.
A new result on differentiation of matrix pseudoinverses.
Confirmation of the conjecture for trees and complete graphs.
Abstract
We consider the following problem arising from the study of human problem solving: Let be a vertex-weighted graph with marked "in" and "out" vertices. Suppose a random walker begins at the in-vertex, steps to neighbors of vertices with probability proportional to their weights, and stops upon reaching the out-vertex. Could one deduce the weights from the paths that many such walkers take? We analyze an iterative numerical solution to this reconstruction problem, in particular, given the empirical mean occupation times of the walkers. In the process, a result concerning the differentiation of a matrix pseudoinverse is given, which may be of independent interest. We then consider the existence of a choice of weights for the given occupation times, formulating a natural conjecture to the effect that -- barring obvious obstructions -- a solution always exists. It is shown that the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsReinforcement Learning in Robotics · Model Reduction and Neural Networks
