LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey

TL;DR

This survey comprehensively reviews LLM-based human-agent collaboration systems, highlighting their core components, applications, challenges, and future research directions to improve reliability, safety, and effectiveness.

Contribution

It provides the first structured overview of LLM-HAS, clarifying concepts, components, applications, and challenges to foster further research in human-AI collaboration.

Findings

Systematic presentation of core components of LLM-HAS

Discussion of emerging applications and challenges

Resource list including paper and tools at a GitHub repository

Abstract

Recent advances in large language models (LLMs) have sparked growing interest in building fully autonomous agents. However, fully autonomous LLM-based agents still face significant challenges, including limited reliability due to hallucinations, difficulty in handling complex tasks, and substantial safety and ethical risks, all of which limit their feasibility and trustworthiness in real-world applications. To overcome these limitations, LLM-based human-agent systems (LLM-HAS) incorporate human-provided information, feedback, or control into the agent system to enhance system performance, reliability, and safety. These human-agent collaboration systems enable humans and LLM-based agents to collaborate effectively by leveraging their complementary strengths. This paper provides the first comprehensive and structured survey of LLM-HAS. It clarifies fundamental concepts, systematically presents core components shaping these systems, including environment and profiling, human feedback, interaction types, orchestration, and communication, explores emerging applications, and discusses unique challenges and opportunities arising from human-AI collaboration. By consolidating current knowledge and offering a structured overview, we aim to foster further research and innovation in this rapidly evolving interdisciplinary field. Paper lists and resources are available at https://github.com/HenryPengZou/Awesome-Human-Agent-Collaboration-Interaction-Systems.