Academic Publications


Publication Bias

A form of bias that favors the publication of results that are in a particular direction or that demonstrate a particular significance level.


Ashenfelter, O., Harmon, C., & Oosterbeek, H. (1999). A review of estimates of the schooling/earnings relationship, with tests for publication bias. Labour Economics, 6(4), 453-470.

Begg, C. B. (1994). Publication bias. The Handbook of Research Synthesis, 25, 299-409.

Begg, C. B., & Berlin, J. A. (1989). Publication bias and dissemination of clinical research. Journal of the National Cancer Institute, 81(2), 107-115.

Begg, C. B., & Berlin, J. A. (1988). Publication bias: a problem in interpreting medical data. Journal of the Royal Statistical Society. Series A (Statistics in Society), 419-463.

Begg, C. B., & Mazumdar, M. (1994). Operating characteristics of a rank correlation test for publication bias. Biometrics, 1088-1101.

Calnan, M., Smith, G. D., & Sterne, J. A. (2006). The publication process itself was the major cause of publication bias in genetic epidemiology. Journal of Clinical Epidemiology, 59(12), 1312-1318.

Chalmers, T. C., Frank, C. S., & Reitman, D. (1990). Minimizing the three stages of publication bias. JAMA, 263(10), 1392-1395.

Coats, A. J. (2009). Ethical authorship and publishing. International Journal of Cardiology, 131(2), 149-150.

Daroff, R. B. (2007). Scientific misconduct and breach of publication ethics: one editor’s experience. Medicine and Law, 26(3), 527-533.

Dickersin, K. (1997). How important is publication bias? A synthesis of available data. AIDS Education and Prevention, 9, 15-21.

Dickersin, K. (1990). The existence of publication bias and risk factors for its occurrence. JAMA, 263(10), 1385-1389.

Dickersin, K., & Min, Y. I. (1993). NIH clinical trials and publication bias. The Online Journal of Current Clinical Trials, 4967-words.

Dickersin, K., & MIN, Y. I. (1993). Publication bias: the problem that won’t go away. Annals of the New York Academy of Sciences, 703(1), 135-148.

Dickersin, K., Min, Y. I., & Meinert, C. L. (1992). Factors influencing publication of research results: follow-up of applications submitted to two institutional review boards. JAMA, 267(3), 374-378.

Dubben, H., & Beck-Bornholdt, H. (2005). Systematic review of publication bias in studies on publication bias. BMJ : British Medical Journal, 331(7514), 433.

Duval, S., & Tweedie, R. (2000). Trim and fill: a simple funnel‐plot–based method of testing and adjusting for publication bias in meta‐analysis. Biometrics, 56(2), 455-463.

Duval, S., & Tweedie, R. (2000). A nonparametric “trim and fill” method of accounting for publication bias in meta-analysis. Journal of the American Statistical Association, 95(449), 89-98.

Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A. W., Cronin, E., … & Williamson, P. R. (2008). Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PloS One3(8), e3081.

Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991). Publication bias in clinical research. The Lancet, 337(8746), 867-872.

Faneli, D., Costas, R., & Ioannidisa, J. P. (2017). Meta-assessment of bias in science. PNAS, 114(14), 3714-3719.

Fanelli, D. (2010). Do pressures to publish increase scientists’ bias? An empirical support from US States Data. PloS One, 5(4), e10271.

Fanelli, D. (2012). Negative results are disappearing from most disciplines and countries. Scientometrics, 90(3), 891-904.

Fanelli, D. (2010). “Positive” results increase down the hierarchy of sciences. PLoS One 5(4): e10068.

Flacco, M. E., Manzoli, L., Boccia, S., Capasso, L., Aleksovska, K., Rosso, A., … & Ioannidis, J. P. (2015). Head-to-head randomized trials are mostly industry sponsored and almost always favor the industry sponsor. Journal of Clinical Epidemiology.

Ferguson, C. J., & Heene, M. (2012). A vast graveyard of undead theories publication bias and psychological science’s aversion to the null. Perspectives on Psychological Science, 7(6), 555-561.

Forbes, R. B., & McCarron, M. (2005). Review of publication bias in studies on publication bias: Systematic review is needed. BMJ : British Medical Journal, 331(7517), 638.

Francis, G. (2012). Evidence that publication bias contaminated studies relating social class and unethical behavior. Proceedings of the National Academy of Sciences, 109(25), E1587-E1587.

Francis, G. (2012). The same old New Look: Publication bias in a study of wishful seeing. i-Perception, 3(3), 176.

Francis, G. (2012). Too good to be true: Publication bias in two prominent studies from experimental psychology. Psychonomic Bulletin & Review, 19(2), 151-156.

Francis, G. (2013). Publication bias in “Red, rank, and romance in women viewing men,” by Elliot et al.(2010).

Francis, G. (2013). Replication, statistical consistency, and publication bias. Journal of Mathematical Psychology, 57(5), 153-169.

Franco, A., Malhotra, N., & Simonovits, G. (2014). Publication bias in the social sciences: Unlocking the file drawer. Science, 345, 1502-1505.

Gerber, A. S., Green, D. P., & Nickerson, D. (2001). Testing for publication bias in political science. Political Analysis, 9(4), 385-392.

Gerber, A., & Malhotra, N. (2008). Do statistical reporting standards affect what is published? Publication bias in two leading political science journals. Quarterly Journal of Political Science, 3(3), 313-326.

Gerber, A. S., & Malhotra, N. (2008). Publication bias in empirical sociological research: Do arbitrary significance levels distort published results?. Sociological Methods & Research.

Gerber, A. S., Malhotra, N., Dowling, C. M., & Doherty, D. (2010). Publication bias in two political behavior literatures. American Politics Research.

Giner-Sorolla, R. (2012). Science or art? How aesthetic standards grease the way through the publication bottleneck but undermine science. Perspectives on Psychological Science, 7(6), 562-571.

Glymour, M. M., & Kawachi, I. (2005). Review of publication bias in studies on publication bias: Here’s a proposal for editors that may help reduce publication bias. BMJ : British Medical Journal, 331(7517), 638.

Gullo, M. J., & O’Gorman, J. G. (2012). DSM-5 task force proposes controversial diagnosis for dishonest scientists. Perspectives on Psychological Science, 7, 689.

Hedges, L. V. (1992). Modeling publication selection effects in meta-analysis. Statistical Science, 246-255.

Ioannidis, J. P. (2006). Journals should publish all “null” results and should sparingly publish “positive” results. Cancer Epidemiology Biomarkers & Prevention, 15(1), 186-186.

Ioannidis, J. P., Munafò, M. R., Fusar-Poli, P., Nosek, B. A., & David, S. P. (2014). Publication and other reporting biases in cognitive sciences: detection, prevalence, and prevention. Trends in Cognitive Sciences, 18(5), 235-241.

Ioannidis, J. P., & Khoury, M. J. (2014). Assessing value in biomedical research: the PQRST of appraisal and reward. JAMA, 312(5), 483-484.

Macaskill, P., Walter, S. D., & Irwig, L. (2001). A comparison of methods to detect publication bias in meta‐analysis. Statistics in Medicine, 20(4), 641-654.

Mann, J. (2005). Review of publication bias in studies on publication bias: Mandatory publication of data may help. BMJ : British Medical Journal, 331(7517), 638.

Manzoli, L., Flacco, M. E., D’Addario, M., Capasso, L., De Vito, C., Marzuillo, C., … & Ioannidis, J. (2014). Non-publication and delayed publication of randomized trials on vaccines: survey. BMJ, 348.

Nakagawa, S. (2004). A farewell to Bonferroni: the problems of low statistical power and publication bias. Behavioral Ecology, 15(6), 1044-1045.

Ngai, S., Gold, J. L., Gill, S. S., & Rochon, P. A. (2005). Haunted manuscripts: Ghost authorship in the medical literature. Accountability in Research, 12(2), 103-114.

Peh, W. C., & Ng, K. H. (2010). Publication ethics and scientific misconduct. Singapore Medical Journal, 51(12), 908-912.

Peters, J. L., Sutton, A. J., Jones, D. R., Abrams, K. R., & Rushton, L. (2006). Comparison of two methods to detect publication bias in meta-analysis. JAMA, 295(6), 676-680.

Reynolds, T. (2000). Eliminating publication bias: The effect of negative trial results. Journal of the National Cancer Institute, 92(9), 682.

Roest, A. M., de Jonge, P., Williams, C. D., de Vries, Y. A., Schoevers, R. A., & Turner, E. H. (2015). Reporting Bias in Clinical Trials Investigating the Efficacy of Second-Generation Antidepressants in the Treatment of Anxiety Disorders. JAMA.

Rothstein, H. R., Sutton, A. J., & Borenstein, M. (Eds.). (2006). Publication bias in meta-analysis: Prevention, assessment and adjustments. John Wiley & Sons.

Schulz, K. F., Chalmers, I., Hayes, R. J., & Altman, D. G. (1995). Empirical evidence of bias: dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA, 273(5), 408-412.

Shaheen, N. J., Crosby, M. A., Bozymski, E. M., & Sandler, R. S. (2000). Is there publication bias in the reporting of cancer risk in Barrett’s esophagus?. Gastroenterology, 119(2), 333-338.

Shewan, L. G., & Coats, A. J. (2010). Ethics in the authorship and publishing of scientific articles. International Journal of Cardiology, 144(1), 1-2.

Simes, R. J. (1986). Publication bias: the case for an international registry of clinical trials. Journal of Clinical Oncology, 4(10), 1529-1541.

Simonsohn, U., Nelson, L. D., & Simmons, J. P. (2014). p-Curve and Effect Size Correcting for Publication Bias Using Only Significant Results. Perspectives on Psychological Science, 9(6), 666-681.

Simonsohn, U. (2012). It does not follow evaluating the one-off publication bias critiques by Francis (2012a, 2012b, 2012c, 2012d, 2012e, in Press). Perspectives on Psychological Science, 7(6), 597-599.

Sohn, D. (1996). Publication bias and the evaluation of psychotherapy efficacy in reviews of the research literature. Clinical Psychology Review, 16(2), 147-156.

Song, F. (2005). Review of publication bias in studies on publication bias: Studies on publication bias are probably susceptible to the bias they study. BMJ : British Medical Journal, 331(7517), 637.

Sterling, T. D. (1959). Publication decisions and their possible effects on inferences drawn from tests of significance—or vice versa. Journal of the American Statistical Association, 54(285), 30-34.

Sterling, T. D., Rosenbaum, W. L., & Weinkam, J. J. (1995). Publication decisions revisited: The effect of the outcome of statistical tests on the decision to publish and vice versa. The American Statistician, 49(1), 108-112.

Stern, J. M., & Simes, R. J. (1997). Publication bias: evidence of delayed publication in a cohort study of clinical research projects. BMJ, 315(7109), 640-645.

Sterne, J. A., Gavaghan, D., & Egger, M. (2000). Publication and related bias in meta-analysis: power of statistical tests and prevalence in the literature. Journal of Clinical Epidemiology, 53(11), 1119-1129.

Thornton, A., & Lee, P. (2000). Publication bias in meta-analysis: its causes and consequences. Journal of Clinical Epidemiology, 53(2), 207-216.

Turner, E. H., Matthews, E. M., Linardatos, E., Tell, R.A., & Rosenthal, R. (2008). Selective publication of Antidepressant Trials and Its Influence on Apparent Efficacy. The New England Journal of Medicine, 358(3), 252-260.

van der Schot, A., A., & Phillips, C. (2013). Publication bias in animal welfare scientific literature. Journal of Agricultural and Environmental Ethics, 26(5), 945-958.

Young, N. S., Ioannidis, J. P., & Al-Ubaydli, O. (2008). Why current publication practices may distort science. PLoS Medicine, 5(10), e201.