RELink: A Research Framework and Test Collection for Entity-Relationship Retrieval
Pedro Saleiro, Natasa Milic-Frayling, Eduarda Mendes Rodrigues, Carlos, Soares

TL;DR
RELink introduces a comprehensive framework and test collection for entity-relationship retrieval, enabling advanced research on complex E-R queries with publicly available resources and tools.
Contribution
It provides the first large-scale, publicly available test collection and a framework for entity-relationship retrieval research, supporting complex query evaluation.
Findings
Created 600 E-R queries and relevance judgments from Wikipedia tables.
Developed an open-source framework with Lucene-based E-R search capabilities.
Facilitated large-scale E-R retrieval research with new resources.
Abstract
Improvements of entity-relationship (E-R) search techniques have been hampered by a lack of test collections, particularly for complex queries involving multiple entities and relationships. In this paper we describe a method for generating E-R test queries to support comprehensive E-R search experiments. Queries and relevance judgments are created from content that exists in a tabular form where columns represent entity types and the table structure implies one or more relationships among the entities. Editorial work involves creating natural language queries based on relationships represented by the entries in the table. We have publicly released the RELink test collection comprising 600 queries and relevance judgments obtained from a sample of Wikipedia List-of-lists-of-lists tables. The latter comprise tuples of entities that are extracted from columns and labelled by corresponding…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsTopic Modeling · Data Quality and Management · Web Data Mining and Analysis
