Unifying Dynamic Tool Creation and Cross-Task Experience Sharing through Cognitive Memory Architecture

TL;DR

This paper presents SMITH, a cognitive architecture that unifies dynamic tool creation and cross-task experience sharing using hierarchical memory, significantly improving adaptive capabilities of language model agents.

Contribution

Introduces SMITH, a novel framework integrating tool creation and experience sharing via hierarchical memory, formalized as iterative code generation and episodic retrieval, with demonstrated superior performance.

Findings

Achieves 81.8% Pass@1 accuracy on GAIA benchmark.

Outperforms state-of-the-art methods Alita and Memento.

Demonstrates effective capability expansion and experience reuse.

Abstract

Large Language Model agents face fundamental challenges in adapting to novel tasks due to limitations in tool availability and experience reuse. Existing approaches either rely on predefined tools with limited coverage or build tools from scratch without leveraging past experiences, leading to inefficient exploration and suboptimal performance. We introduce SMITH (Shared Memory Integrated Tool Hub), a unified cognitive architecture that seamlessly integrates dynamic tool creation with cross-task experience sharing through hierarchical memory organization. SMITH organizes agent memory into procedural, semantic, and episodic components, enabling systematic capability expansion while preserving successful execution patterns. Our approach formalizes tool creation as iterative code generation within controlled sandbox environments and experience sharing through episodic memory retrieval with semantic similarity matching. We further propose a curriculum learning strategy based on agent-ensemble difficulty re-estimation. Extensive experiments on the GAIA benchmark demonstrate SMITH's effectiveness, achieving 81.8% Pass@1 accuracy and outperforming state-of-the-art baselines including Alita (75.2%) and Memento (70.9%). Our work establishes a foundation for building truly adaptive agents that continuously evolve their capabilities through principled integration of tool creation and experience accumulation.