Towards quantitative measures in applied ontology
Robert Hoehndorf, Michel Dumontier, Georgios V. Gkoutos

TL;DR
This paper advocates for domain-specific, ontology-based quantitative evaluation methods to objectively assess research outcomes in applied ontology, integrating diverse disciplinary insights.
Contribution
It introduces a framework for quantitative, domain-specific evaluation of applied ontology research results, emphasizing the importance of task-based assessment.
Findings
Proposes domain-specific evaluation criteria
Highlights the need for quantitative measures
Discusses integration of interdisciplinary methods
Abstract
Applied ontology is a relatively new field which aims to apply theories and methods from diverse disciplines such as philosophy, cognitive science, linguistics and formal logics to perform or improve domain-specific tasks. To support the development of effective research methodologies for applied ontology, we critically discuss the question how its research results should be evaluated. We propose that results in applied ontology must be evaluated within their domain of application, based on some ontology-based task within the domain, and discuss quantitative measures which would facilitate the objective evaluation and comparison of research results in applied ontology.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSemantic Web and Ontologies · Biomedical Text Mining and Ontologies · Natural Language Processing Techniques
