sciwrite-lint: Verification Infrastructure for the Age of Science Vibe-Writing
Sergey V Samsonau

TL;DR
sciwrite-lint is an open-source tool that verifies scientific manuscripts by checking references, supporting claims, and assessing reliability, aiming to improve quality assurance in science.
Contribution
it introduces a novel, fully local verification pipeline and a new SciLint Score combining integrity and contribution assessments based on philosophy of science.
Findings
the pipeline successfully verified references in 30 unseen papers
error injection and false positive analysis demonstrate robustness
the SciLint Score operationalizes scientific argument frameworks
Abstract
Science currently offers two options for quality assurance, both inadequate. Journal gatekeeping claims to verify both integrity and contribution, but actually measures prestige: peer review is slow, biased, and misses fabricated citations even at top venues. Open science provides no quality assurance at all: the only filter between AI-generated text and the public record is the author's integrity. AI-assisted writing makes both worse by producing more papers faster than either system can absorb. We propose a third option: measure the paper itself. sciwrite-lint (pip install sciwrite-lint) is an open-source linter for scientific manuscripts that runs entirely on the researcher's machine (free public databases, a single consumer GPU, and open-weights models) with no manuscripts sent to external services. The pipeline verifies that references exist, checks retraction status, compares…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
