Vector Symbolic Open Source Information Discovery

TL;DR

This paper introduces a novel integration of transformer models with vector symbolic architectures to enable efficient, low-bandwidth open source information discovery for complex government and multinational operations.

Contribution

It presents a new method combining transformers and VSA for semantic data alignment, suitable for low-bandwidth, high-security environments.

Findings

Demonstrated a proof-of-concept data discovery portal

Achieved minimal metadata curation and low communication bandwidth

Bridged low-TRL research to potential deployment

Abstract

Combined, joint, intra-governmental, inter-agency and multinational (CJIIM) operations require rapid data sharing without the bottlenecks of metadata curation and alignment. Curation and alignment is particularly infeasible for external open source information (OSINF), e.g., social media, which has become increasingly valuable in understanding unfolding situations. Large language models (transformers) facilitate semantic data and metadata alignment but are inefficient in CJIIM settings characterised as denied, degraded, intermittent and low bandwidth (DDIL). Vector symbolic architectures (VSA) support semantic information processing using highly compact binary vectors, typically 1-10k bits, suitable in a DDIL setting. We demonstrate a novel integration of transformer models with VSA, combining the power of the former for semantic matching with the compactness and representational structure of the latter. The approach is illustrated via a proof-of-concept OSINF data discovery portal that allows partners in a CJIIM operation to share data sources with minimal metadata curation and low communications bandwidth. This work was carried out as a bridge between previous low technology readiness level (TRL) research and future higher-TRL technology demonstration and deployment.