While the social sciences have made impressive progress in adopting transparent research practices that facilitate verification, replication, and re-use of materials, the problem of publication bias persists. Bias on the part of peer reviewers and journal editors, as well as the use of outdated research practices by authors, continue to skew literature toward statistically significant effects, many of which may be false positives. To mitigate this bias, we propose a framework to enable authors to Report All Results Efficiently (RARE) with an initial focus on experimental and other prospective empirical social science research that utilizes public study registries. This framework depicts an integrated system that leverages the capacities of existing infrastructure in the form of public registries, Institutional Review Boards, journals, and granting agencies, as well as investigators themselves, to efficiently incentivize full reporting and thereby improve confidence in social science findings. In addition to increasing access to the results of scientific endeavors, a well-coordinated research ecosystem can prevent scholars from wasting time investigating the same questions in ways that have not worked in the past, and reduce wasted funds on the part of granting agencies.

Reporting all results efficiently: a RARE proposal to open up the file drawer

Alrababa'h, Ala';Williamson, Scott
2021

Abstract

While the social sciences have made impressive progress in adopting transparent research practices that facilitate verification, replication, and re-use of materials, the problem of publication bias persists. Bias on the part of peer reviewers and journal editors, as well as the use of outdated research practices by authors, continue to skew literature toward statistically significant effects, many of which may be false positives. To mitigate this bias, we propose a framework to enable authors to Report All Results Efficiently (RARE) with an initial focus on experimental and other prospective empirical social science research that utilizes public study registries. This framework depicts an integrated system that leverages the capacities of existing infrastructure in the form of public registries, Institutional Review Boards, journals, and granting agencies, as well as investigators themselves, to efficiently incentivize full reporting and thereby improve confidence in social science findings. In addition to increasing access to the results of scientific endeavors, a well-coordinated research ecosystem can prevent scholars from wasting time investigating the same questions in ways that have not worked in the past, and reduce wasted funds on the part of granting agencies.
2021
2021
Laitin, David D.; Miguel, Edward; Alrababa'H, Ala'; Bogdanoski, Aleksander; Grant, Sean; Hoeberling, Katherine; Mo, Cecilia; Moore, Don; Vazire, Simine; Weinstein, Jeremy; Williamson, Scott
File in questo prodotto:
File Dimensione Formato  
e2106178118.full.pdf

accesso aperto

Descrizione: article
Tipologia: Pdf editoriale (Publisher's layout)
Licenza: Creative commons
Dimensione 1.05 MB
Formato Adobe PDF
1.05 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11565/4042205
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 8
  • ???jsp.display-item.citation.isi??? 8
social impact