Towards Intelligent Urban Park Development Monitoring: LLM Agents for Multi-Modal Information Fusion and Analysis

TL;DR

This paper introduces a multi-modal LLM agent framework that leverages semantic understanding and reasoning to improve urban park development monitoring, addressing limitations of traditional remote sensing methods.

Contribution

It proposes a novel multi-modal LLM agent framework with data alignment and domain-specific toolkits for enhanced urban park monitoring.

Findings

Enhanced multi-modal data fusion and analysis capabilities.

Improved robustness over vanilla GPT-4o and other agents.

Scalable solutions for diverse urban park monitoring scenarios.

Abstract

As an important part of urbanization, the development monitoring of newly constructed parks is of great significance for evaluating the effect of urban planning and optimizing resource allocation. However, traditional change detection methods based on remote sensing imagery have obvious limitations in high-level and intelligent analysis, and thus are difficult to meet the requirements of current urban planning and management. In face of the growing demand for complex multi-modal data analysis in urban park development monitoring, these methods often fail to provide flexible analysis capabilities for diverse application scenarios. This study proposes a multi-modal LLM agent framework, which aims to make full use of the semantic understanding and reasoning capabilities of LLM to meet the challenges in urban park development monitoring. In this framework, a general horizontal and vertical data alignment mechanism is designed to ensure the consistency and effective tracking of multi-modal data. At the same time, a specific toolkit is constructed to alleviate the hallucination issues of LLM due to the lack of domain-specific knowledge. Compared to vanilla GPT-4o and other agents, our approach enables robust multi-modal information fusion and analysis, offering reliable and scalable solutions tailored to the diverse and evolving demands of urban park development monitoring.