The mapKurator System: A Complete Pipeline for Extracting and Linking Text from Historical Maps

TL;DR

The mapKurator system provides an end-to-end pipeline for extracting, linking, and processing text from large historical map scans, facilitating data analysis and improving accessibility of geographic information.

Contribution

It introduces a comprehensive system that automates extraction and linkage of text from large historical maps, integrating machine learning with GIS-compatible output.

Findings

Processed over 60,000 maps and 100 million text labels.

Enabled integration with a collaborative web platform.

Improved accessibility and reusability of historical map data.

Abstract

Scanned historical maps in libraries and archives are valuable repositories of geographic data that often do not exist elsewhere. Despite the potential of machine learning tools like the Google Vision APIs for automatically transcribing text from these maps into machine-readable formats, they do not work well with large-sized images (e.g., high-resolution scanned documents), cannot infer the relation between the recognized text and other datasets, and are challenging to integrate with post-processing tools. This paper introduces the mapKurator system, an end-to-end system integrating machine learning models with a comprehensive data processing pipeline. mapKurator empowers automated extraction, post-processing, and linkage of text labels from large numbers of large-dimension historical map scans. The output data, comprising bounding polygons and recognized text, is in the standard GeoJSON format, making it easily modifiable within Geographic Information Systems (GIS). The proposed system allows users to quickly generate valuable data from large numbers of historical maps for in-depth analysis of the map content and, in turn, encourages map findability, accessibility, interoperability, and reusability (FAIR principles). We deployed the mapKurator system and enabled the processing of over 60,000 maps and over 100 million text/place names in the David Rumsey Historical Map collection. We also demonstrated a seamless integration of mapKurator with a collaborative web platform to enable accessing automated approaches for extracting and linking text labels from historical map scans and collective work to improve the results.