Feature extraction and evaluation for BioMedical Question Answering

TL;DR

This paper evaluates the BioASQ pipeline's feature extraction and sentence selection modules across various question types, providing insights and metrics to guide future improvements in biomedical question answering systems.

Contribution

It offers an empirical evaluation of pipeline modules for biomedical QA, highlighting their effectiveness and proposing metrics for future research.

Findings

Different modules impact question types variably

Error analysis identifies key areas for improvement

Metrics established to guide future pipeline enhancements

Abstract

In this paper, we present our work on the BioASQ pipeline. The goal is to answer four types of questions: summary, yes/no, factoids, and list. Our goal is to empirically evaluate different modules involved: the feature extractor and the sentence selection block. We used our pipeline to test the effectiveness of each module for all kinds of question types and perform error analysis. We defined metrics that are useful for future research related to the BioASQ pipeline critical to improve the performance of the training pipeline.