Automatizaci\'on de Informes Geot\'ecnicos para Macizos Rocosos con IA

TL;DR

This paper presents an AI-based system for automatically generating geotechnical reports from field images and data, improving speed and accuracy over manual methods, and validated by expert-like performance metrics.

Contribution

It introduces a multimodal large language model approach with prompt engineering for automated geotechnical report generation, avoiding costly fine-tuning.

Findings

BLEU score of 0.455 indicates good quality descriptions.

ROUGE-L score of 0.653 shows strong similarity to expert reports.

System is accessible via web with export features.

Abstract

Geotechnical reports are crucial for assessing the stability of rock formations and ensuring safety in modern engineering. Traditionally, these reports are prepared manually based on field observations using compasses, magnifying glasses, and notebooks. This method is slow, prone to errors, and subjective in its interpretations. To overcome these limitations, the use of artificial intelligence techniques is proposed for the automatic generation of reports through the processing of images and field data. The methodology was based on the collection of photographs of rock outcrops and manual samples with their respective descriptions, as well as on the reports prepared during the Geotechnical Studies course. These resources were used to define the report outline, prompt engineering, and validate the responses of a multimodal large language model (MLLM). The iterative refinement of prompts until structured and specific instructions were obtained for each section of the report proved to be an effective alternative to the costly process of fine-tuning the MLLM. The system evaluation establishes values of 0.455 and 0.653 for the BLEU and ROUGE-L metrics, respectively, suggesting that automatic descriptions are comparable to those made by experts. This tool, accessible via the web, with an intuitive interface and the ability to export to standardized formats, represents an innovation and an important contribution for professionals and students of field geology.