External Evaluation of Event Extraction Classifiers for Automatic Pathway Curation: An extended study of the mTOR pathway

TL;DR

This study assesses how different event extraction systems and classifiers affect the quality of automatically curated biological pathways, focusing on the mTOR pathway.

Contribution

It provides an extended evaluation of event extraction classifiers and training data impact on pathway curation quality.

Findings

Some classifiers improve pathway extraction quality

Training data sets significantly influence results

Evaluation highlights key factors for effective pathway curation

Abstract

This paper evaluates the impact of various event extraction systems on automatic pathway curation using the popular mTOR pathway. We quantify the impact of training data sets as well as different machine learning classifiers and show that some improve the quality of automatically extracted pathways.