Pubpeer: vigilante science, journal club or alarm raiser? The controversies over anonymity in post-publication peer review - HAL-SHS - Sciences de l'Homme et de la Société
Communication Dans Un Congrès Année : 2018

Pubpeer: vigilante science, journal club or alarm raiser? The controversies over anonymity in post-publication peer review

Didier Torny

Résumé

The more journal peer review (JPR) became a scientific topic, the more it has been the subject of criticisms and controversies. Repeated fake reports, confirmed reviewers’ biases, lack of reproducibility, and a recurrent inability to detect fraud and misconduct have apparently condemned JPR in its supposedly traditional form. In fact, just like previous historical reforms and inventions, JPR has again been the object of many proposals to “fix it” since the beginning of the 21st century. Though these proposals are very diverse, two main directions have been identified: open peer review on one side, post-publication peer review (PPPR) on the other. These two “fixes” share a common device, the open commenting of published articles, which is both an open peer review practice as it is visible to all readers and PPPR as it comes after the publication and often the certification of articles. At their intersection, it should thus thrive and indeed many journals have proposed this feature, but with no success. Nevertheless, there is an exception to the disappointment with open commentary in PPPR, which is the empirical case for this presentation: PubPeer, where commentators come in herds and comments flourish. The only explanation given for this peculiar success is the possibility, largely used, to publish anoymized comments on the platform. So, how can you embrace the openness of discussion and, at the same time, enable anonymous commentators? What kind of PPPR practices is it connected with? Does it inform our views on traditional peer review and how? To answer these questions, we will first describe how the platform has been built and works, then to what kind of dynamics it leads as far as anonymity is concerned, then typify the arguments used for and against anonymity in PPPR, discuss its effects on published papers, before concluding on the way debates could be organized in PPPR. These first results are based on the systematic qualitative analysis of both threads on PubPeer, articles on specialized websites on PubPeer and anonymity (Scholarly Kitchen, RetractionWatch…) and on editorials from scientific journals that have commented on anonymity in PPPR.
Fichier principal
Vignette du fichier
PubPeerRome_Torny.pdf (194.63 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

halshs-01700198 , version 1 (03-02-2018)

Licence

Identifiants

  • HAL Id : halshs-01700198 , version 1

Citer

Didier Torny. Pubpeer: vigilante science, journal club or alarm raiser? The controversies over anonymity in post-publication peer review. PEERE International Conference on Peer Review, PEERE COST Network, Mar 2018, Rome, Italy. ⟨halshs-01700198⟩
1754 Consultations
2824 Téléchargements

Partager

More