Extracting ORR Catalyst Information for Fuel Cell from Scientific Literature

TL;DR

This paper develops a transformer-based information extraction method to automatically identify and relate ORR catalyst information from scientific literature, improving data collection for fuel cell research.

Contribution

It introduces a novel dataset and fine-tuned BERT models for extracting ORR catalyst entities and relations, demonstrating improved accuracy over general models.

Findings

PubMedBERT achieves 82.19% NER F1-score.

MatSciBERT attains 66.10% relation extraction F1-score.

Domain-specific BERT models outperform general scientific models.

Abstract

The oxygen reduction reaction (ORR) catalyst plays a critical role in enhancing fuel cell efficiency, making it a key focus in material science research. However, extracting structured information about ORR catalysts from vast scientific literature remains a significant challenge due to the complexity and diversity of textual data. In this study, we propose a named entity recognition (NER) and relation extraction (RE) approach using DyGIE++ with multiple pre-trained BERT variants, including MatSciBERT and PubMedBERT, to extract ORR catalyst-related information from the scientific literature, which is compiled into a fuel cell corpus for materials informatics (FC-CoMIcs). A comprehensive dataset was constructed manually by identifying 12 critical entities and two relationship types between pairs of the entities. Our methodology involves data annotation, integration, and fine-tuning of transformer-based models to enhance information extraction accuracy. We assess the impact of different BERT variants on extraction performance and investigate the effects of annotation consistency. Experimental evaluations demonstrate that the fine-tuned PubMedBERT model achieves the highest NER F1-score of 82.19% and the MatSciBERT model attains the best RE F1-score of 66.10%. Furthermore, the comparison with human annotators highlights the reliability of fine-tuned models for ORR catalyst extraction, demonstrating their potential for scalable and automated literature analysis. The results indicate that domain-specific BERT models outperform general scientific models like BlueBERT for ORR catalyst extraction.