Re-Invoke: Tool Invocation Rewriting for Zero-Shot Tool Retrieval
Yanfei Chen, Jinsung Yoon, Devendra Singh Sachan, Qingze Wang, Vincent, Cohen-Addad, Mohammadhossein Bateni, Chen-Yu Lee, Tomas Pfister

TL;DR
Re-Invoke is an unsupervised method that improves large-scale tool retrieval for LLM-powered agents by generating synthetic queries, extracting query context, and ranking tools based on intent similarity, outperforming existing methods.
Contribution
It introduces a novel unsupervised approach combining synthetic query generation and multi-view intent-based ranking for scalable tool retrieval without training.
Findings
20% improvement in nDCG@5 for single-tool retrieval
39% improvement in nDCG@5 for multi-tool retrieval
Outperforms state-of-the-art methods in large toolset scenarios
Abstract
Recent advances in large language models (LLMs) have enabled autonomous agents with complex reasoning and task-fulfillment capabilities using a wide range of tools. However, effectively identifying the most relevant tools for a given task becomes a key bottleneck as the toolset size grows, hindering reliable tool utilization. To address this, we introduce Re-Invoke, an unsupervised tool retrieval method designed to scale effectively to large toolsets without training. Specifically, we first generate a diverse set of synthetic queries that comprehensively cover different aspects of the query space associated with each tool document during the tool indexing phase. Second, we leverage LLM's query understanding capabilities to extract key tool-related context and underlying intents from user queries during the inference phase. Finally, we employ a novel multi-view similarity ranking…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
Taxonomy
TopicsScientific Computing and Data Management · Semantic Web and Ontologies
MethodsSparse Evolutionary Training
