Unified Tool Integration for LLMs: A Protocol-Agnostic Approach to Function Calling

TL;DR

This paper introduces a unified, protocol-agnostic framework for integrating tools with Large Language Models, reducing development complexity and improving execution efficiency through automation and optimized concurrency.

Contribution

It presents a novel protocol-agnostic tool integration approach that automates schema generation and enhances performance, simplifying LLM tool development.

Findings

60-80% code reduction in integration tasks

Performance improvements up to 3.1x with optimized concurrency

Full compatibility with existing function calling standards

Abstract

The proliferation of tool-augmented Large Language Models (LLMs) has created a fragmented ecosystem where developers must navigate multiple protocols, manual schema definitions, and complex execution workflows. We address this challenge by proposing a unified approach to tool integration that abstracts protocol differences while optimizing execution performance. Our solution demonstrates how protocol-agnostic design principles can significantly reduce development overhead through automated schema generation, dual-mode concurrent execution, and seamless multi-source tool management. Experimental results show 60-80% code reduction across integration scenarios, performance improvements up to 3.1x through optimized concurrency, and full compatibility with existing function calling standards. This work contributes both theoretical insights into tool integration architecture and practical solutions for real-world LLM application development.