I have written a letter to Dr. Eric Eich, editor in chief of Psychological Science. I have proposed a suggestion for improvement of the current peer-review system. First I outlined the problems associated with the current system. Peer-review is underappreciated in the current system: it is often seen as a burden and has to be done in one’s spare time, and is not much rewarded. Also, the author often does not know who the reviewer is. Therefore, it is easy for the reviewer to not spend a lot of time on the review, or even be plain mean. Also, the lack of time spent on the review, makes it more likely for studies in which the researchers have engaged in questionable researchers to slip through.
I have proposed a new peer-review system. In this system, the reviewer does not know who the author is, to prevent certain biases (such as the status of the author, whether he has published many articles in high-impact journals, et cetera). Reviewers receive rewards in the form of review-credits. The authors assigns 1-4 review-credits to the reviewer, based on the quality of the feedback and the usefulness of the review. The editor can then subtract or add one research credit, based on whether the review contains a clear recommendation for the editor concerning publication. The reviewer eventually thus ends up with 0-5 review-credits.
These credits become publicly available, at first on a website but could perhaps also become visible in search engines, next to the number of publications a researcher has. This is a scientist’s review index, with the total number of credits, the number of articles reviewed, and the average number of credits obtained per article. Universities may eventually consider including reviewing in the job descriptions and thus paying for reviews, as good reviewers have a high status.
The review-index will result in reviewers doing a better job on reviews. This results in higher quality of published research articles, as questionable articles are less likely to slip through. Therefore, also authors need to pay attention to clear writing and the prevention of QRPs. Also, the overall review quality will be enhanced, as extrinsic motivation is stimulated. This way, the ship of science will be prevented from sinking.