Enhancing Agent Communication and Learning through Action and Language

TL;DR

This paper presents a new class of GC-agents that utilize combined action and language communication modes to improve teaching and learning efficiency, inspired by human pedagogical strategies.

Contribution

The paper introduces a novel multi-modal communication framework for GC-agents, integrating pedagogy and pragmatism to enhance agent teaching and learning capabilities.

Findings

Multi-modal communication improves learning outcomes.

Incorporating pedagogical strategies enhances agent teaching effectiveness.

Action and language modes complement each other for better understanding.

Abstract

We introduce a novel category of GC-agents capable of functioning as both teachers and learners. Leveraging action-based demonstrations and language-based instructions, these agents enhance communication efficiency. We investigate the incorporation of pedagogy and pragmatism, essential elements in human communication and goal achievement, enhancing the agents' teaching and learning capabilities. Furthermore, we explore the impact of combining communication modes (action and language) on learning outcomes, highlighting the benefits of a multi-modal approach.