Peer review

Alex Reinhart – Updated August 1, 2017 notebooks · refsmmat.com

See also Scientific publishing.

Peer review is our vaunted bulwark against non-science nonsense. We say not to trust work until it’s peer reviewed. It’s a stamp of Seriousness and Authority. It’s also basically a lottery.

Experiments on review consistency and bias

Review quality

I get the impression from the following studies that reviewers don’t have a clear idea how to review papers, don’t consistently improve the quality of papers they review, and frequently miss errors. Are there ways of doing better? Are there super-reviewers who consistently give really good reviews?