Filter Equivariant Functions: A symmetric account of length-general extrapolation on lists
Owen Lewis, Neil Ghani, Andrew Dudzik, Christos Perivolaropoulos, Razvan Pascanu, Petar Veli\v{c}kovi\'c

TL;DR
This paper introduces filter equivariant functions, a new class of list functions that behave predictably under element removal, providing a geometric perspective and an algorithm for perfect length-general extrapolation.
Contribution
It defines filter equivariant functions, relates them to map equivariance, and presents an algorithm for constructing length-general extrapolations based on sublist behavior.
Findings
Contains interesting examples of filter equivariant functions
Proves basic theorems relating to filter equivariance
Provides an algorithm for perfect length-general extrapolation
Abstract
What should a function that extrapolates beyond known input/output examples look like? This is a tricky question to answer in general, as any function matching the outputs on those examples can in principle be a correct extrapolant. We argue that a "good" extrapolant should follow certain kinds of rules, and here we study a particularly appealing criterion for rule-following in list functions: that the function should behave predictably even when certain elements are removed. In functional programming, a standard way to express such removal operations is by using a filter function. Accordingly, our paper introduces a new semantic class of functions -- the filter equivariant functions. We show that this class contains interesting examples, prove some basic theorems about it, and relate it to the well-known class of map equivariant functions. We also present a geometric account of filter…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
