SemSketches-2021: experimenting with the machine processing of the pilot semantic sketches corpus

TL;DR

This paper introduces the SemSketches-2021 corpus of semantic sketches, explores approaches to machine processing of these sketches, and details a shared task for developing processing tools.

Contribution

It presents the first open corpus of semantic sketches and organizes a shared task to develop machine processing methods for the corpus.

Findings

Successful organization of the SemSketches-2021 Shared Task

Development of initial machine processing tools for semantic sketches

Insights into challenges of automating semantic sketch analysis

Abstract

The paper deals with elaborating different approaches to the machine processing of semantic sketches. It presents the pilot open corpus of semantic sketches. Different aspects of creating the sketches are discussed, as well as the tasks that the sketches can help to solve. Special attention is paid to the creation of the machine processing tools for the corpus. For this purpose, the SemSketches-2021 Shared Task was organized. The participants were given the anonymous sketches and a set of contexts containing the necessary predicates. During the Task, one had to assign the proper contexts to the corresponding sketches.