Assessing Semantic Annotation Activities with Formal Concept Analysis

TL;DR

This paper presents a formal concept analysis-based method for evaluating semantic annotation activities, enabling domain experts to improve ontologies and annotation quality through visual concept lattices.

Contribution

It introduces a novel FCA-based approach for assessing and refining semantic annotation processes with practical implementation and case study.

Findings

Effective visualization of annotation usage through concept lattices

Improved ontology refinement guided by expert analysis

Positive evaluation results demonstrating method's usefulness

Abstract

This paper describes an approach to assessing semantic annotation activities based on formal concept analysis (FCA). In this approach, annotators use taxonomical ontologies created by domain experts to annotate digital resources. Then, using FCA, domain experts are provided with concept lattices that graphically display how their ontologies were used during the semantic annotation process. In consequence, they can advise annotators on how to better use the ontologies, as well as how to refine them to better suit the needs of the semantic annotators. To illustrate the approach, we describe its implementation in @note, a Rich Internet Application (RIA) for the collaborative annotation of digitized literary texts, we exemplify its use with a case study, and we provide some evaluation results using the method.