Knowledge Retrieval using Foon

TL;DR

This paper introduces Foon, a knowledge retrieval method using graph search to help robots adapt their task plans by leveraging knowledge from video sources, aiming to improve flexible task planning.

Contribution

The paper presents Foon, a novel knowledge retrieval approach that enhances robot task planning by integrating knowledge from multiple video sources through graph search.

Findings

Foon enables robots to adapt plans more flexibly.

Knowledge retrieval improves task success rates.

The method handles unforeseen challenges effectively.

Abstract

Flexible task planning is still a significant challenge for robots. The inability of robots to creatively adapt their task plans to new or unforeseen challenges is largely attributable to their limited understanding of their activities and the environment. Cooking, for example, requires a person to occasionally take risks that a robot would find extremely dangerous. We may obtain manipulation sequences by employing knowledge that is drawn from numerous video sources thanks to knowledge retrieval through graph search.