Aletheia-Probe: A Tool for Automated Journal Assessment

TL;DR

Aletheia-Probe is an open-source tool that automates journal legitimacy assessment by aggregating multiple authoritative data sources, providing transparent, confidence-scored evaluations to assist researchers.

Contribution

It introduces a systematic, transparent, and integrated approach for automated journal assessment, reducing manual effort and improving reliability.

Findings

Aggregates data from multiple authoritative sources.

Provides confidence scores and transparency in assessments.

Reduces manual effort in journal legitimacy evaluation.

Abstract

Assessing journal legitimacy during literature reviews, publication venue selection, and citation verification requires consulting information scattered across multiple incompatible data-sets. This paper introduces Aletheia-Probe, an open-source tool that systematically aggregates curated databases and pattern analysis from multiple authoritative sources to provide transparent, confidence-scored journal assessments. The tool explicitly reports which sources were consulted, what each found, and where evidence conflicts. The tool integrates into research workflows through command-line and programmatic interfaces. It reduces manual assessment overhead while explicitly flagging uncertain cases. We present the tool's architecture, core design principles, and practical integration approach. Comprehensive empirical validation will be presented in forthcoming work.