Review
Claim Verification
Every published paper lists the checks that ran on it and names the tool that ran each one.
What Verification Covers
Verification is mechanical, does not assess the quality of a manuscript and is limited to what can be established by lookup and calculation. The checks listed below are in development and are not yet run on submissions; we do not describe any paper as having passed them until they are in place. Once a check is in use, a check that cannot be completed with confidence will be recorded as not run rather than as passed, and each published article will list the checks performed and the tool that performed each. A check that is not listed was not run.
The Checks in Development
Once in use, each check will return a specific, verifiable result identifying the item checked, its location and any discrepancy. This page will be updated as each check enters use.
- Reference resolution: cited references will be looked up in bibliographic records such as Crossref, and any that do not resolve will be flagged with the reference named.
- Statistical consistency: reported numbers, tables and magnitudes will be checked for internal agreement with the stated formulas and values.
- Symbolic mathematics: the identities a paper states in its derivations will be checked symbolically for sign, algebra and limit errors. This covers the identities a paper states rather than every step of a proof.
What Verification Is Not
A resolved reference is a reference that exists, not a reference used correctly; Crossref matches by title, so a close match is possible. Verification does not detect plagiarism. It does not certify data or code it cannot see. Judgement of the argument, the methods and the contribution is the work of the model-assisted reading and the review panel. It is labelled where it is machine-generated.
Reference resolution depends on the record it queries. Work deposited only as a preprint, including much of the current literature in computer science and machine learning, may carry no Crossref entry, and an unresolved reference of that kind will be reported as unresolved rather than treated as an error by the author.