Pré-Publication, Document De Travail Année : 2015

Star Wars: The Empirics Strike Back

Résumé

Journals favor rejection of the null hypothesis. This selection upon tests may distort the behavior of researchers. Using 50,000 tests published between 2005 and 2011 in the AER, JPE, and QJE, we identify a residual in the distribution of tests that cannot be explained by selection. The distribution of p-values exhibits a two humped camel shape with abundant p-values above 0.25, a valley between 0.25 and 0.10, and a bump slightly below 0.05. The missing tests (with p-values between 0.25 and 0.10) can be retrieved just after the 0.05 threshold and represent 10% to 20% of marginally rejected tests. Our interpretation is that researchers might be tempted to inflate the value of those just-rejected tests by choosing a “significant” specification. We propose a method to measure this residual and describe how it varies by article and author characteristics.

Fichier principal
Vignette du fichier
WP 2015 - Nr 23.pdf (2.09 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence
Loading...
HAL

A comme version hal-01447851 Article Abel Brodeur, Mathias Lé, Marc Sangnier, Yanos Zylberberg. Star Wars: The Empirics Strike Back. American Economic Journal: Applied Economics, 2016, 8 (1), pp.1-32. ⟨10.1257/app.20150044⟩. ⟨hal-01447851⟩

Dates et versions

halshs-01158500 , version 1 (01-06-2015)

Licence

Identifiants

  • HAL Id : halshs-01158500 , version 1

Citer

Abel Brodeur, Mathias Lé, Marc Sangnier, Yanos Zylberberg. Star Wars: The Empirics Strike Back. 2015. ⟨halshs-01158500⟩
531 Consultations
1130 Téléchargements

Partager

  • More