MeNTi: Bridging Medical Calculator and LLM Agent with Nested Tool Calling
Yakun Zhu, Shaohang Wei, Xu Wang, Kui Xue, Xiaofan Zhang, Shaoting Zhang

TL;DR
This paper introduces MeNTi, a novel LLM agent architecture that effectively integrates medical tools and nested calling mechanisms to improve performance in complex medical calculator tasks.
Contribution
It presents MeNTi, a universal LLM agent framework with meta-tool and nested calling capabilities tailored for medical calculator scenarios, along with a new benchmark CalcQA.
Findings
MeNTi significantly improves LLM performance on medical calculator tasks.
CalcQA benchmark effectively evaluates LLMs in clinical calculation scenarios.
Nested tool calling enhances the handling of complex medical tasks.
Abstract
Integrating tools into Large Language Models (LLMs) has facilitated the widespread application. Despite this, in specialized downstream task contexts, reliance solely on tools is insufficient to fully address the complexities of the real world. This particularly restricts the effective deployment of LLMs in fields such as medicine. In this paper, we focus on the downstream tasks of medical calculators, which use standardized tests to assess an individual's health status. We introduce MeNTi, a universal agent architecture for LLMs. MeNTi integrates a specialized medical toolkit and employs meta-tool and nested calling mechanisms to enhance LLM tool utilization. Specifically, it achieves flexible tool selection and nested tool calling to address practical issues faced in intricate medical scenarios, including calculator selection, slot filling, and unit conversion. To assess the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
Taxonomy
TopicsArtificial Intelligence in Healthcare
MethodsFocus
