Deep Affordance Foresight: Planning Through What Can Be Done in the Future
Danfei Xu, Ajay Mandlekar, Roberto Mart\'in-Mart\'in, Yuke Zhu, Silvio, Savarese, Li Fei-Fei

TL;DR
This paper introduces Deep Affordance Foresight, a novel approach enabling robots to reason about long-term action effects for improved multi-step planning in complex environments.
Contribution
It proposes a new affordance representation for long-term planning and develops a learning-to-plan method called DAF that models affordances of motor skills through trial-and-error.
Findings
DAF effectively learns to perform multi-step tasks.
It can share affordance representations across different tasks.
It successfully plans with high-dimensional image inputs.
Abstract
Planning in realistic environments requires searching in large planning spaces. Affordances are a powerful concept to simplify this search, because they model what actions can be successful in a given situation. However, the classical notion of affordance is not suitable for long horizon planning because it only informs the robot about the immediate outcome of actions instead of what actions are best for achieving a long-term goal. In this paper, we introduce a new affordance representation that enables the robot to reason about the long-term effects of actions through modeling what actions are afforded in the future, thereby informing the robot the best actions to take next to achieve a task goal. Based on the new representation, we develop a learning-to-plan method, Deep Affordance Foresight (DAF), that learns partial environment models of affordances of parameterized motor skills…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsRobot Manipulation and Learning · Reinforcement Learning in Robotics · Machine Learning and Algorithms
