A Survey of Embodied AI: From Simulators to Research Tasks

TL;DR

This survey comprehensively reviews embodied AI, focusing on simulators and research tasks like navigation and question answering, highlighting current tools, challenges, and future directions for advancing AI with human-like environmental interactions.

Contribution

It provides an extensive evaluation of nine embodied AI simulators using seven features and analyzes three key research tasks, offering guidance for future research and simulator selection.

Findings

Evaluated nine simulators with seven key features.

Analyzed state-of-the-art approaches for three main tasks.

Identified limitations and future directions for embodied AI.

Abstract

There has been an emerging paradigm shift from the era of "internet AI" to "embodied AI", where AI algorithms and agents no longer learn from datasets of images, videos or text curated primarily from the internet. Instead, they learn through interactions with their environments from an egocentric perception similar to humans. Consequently, there has been substantial growth in the demand for embodied AI simulators to support various embodied AI research tasks. This growing interest in embodied AI is beneficial to the greater pursuit of Artificial General Intelligence (AGI), but there has not been a contemporary and comprehensive survey of this field. This paper aims to provide an encyclopedic survey for the field of embodied AI, from its simulators to its research. By evaluating nine current embodied AI simulators with our proposed seven features, this paper aims to understand the simulators in their provision for use in embodied AI research and their limitations. Lastly, this paper surveys the three main research tasks in embodied AI -- visual exploration, visual navigation and embodied question answering (QA), covering the state-of-the-art approaches, evaluation metrics and datasets. Finally, with the new insights revealed through surveying the field, the paper will provide suggestions for simulator-for-task selections and recommendations for the future directions of the field.