Academic Publications | Credibility and Validity

Credibility & Validity

The standards by which qualitative and quantitative research are judged to be true and trustworthy.

Begley, C. G., & Ellis, L. M. (2012). Drug development: Raise standards for preclinical cancer research. Nature, 483(7391), 531-533.

Becker, B. J. (1991). The quality and credibility of research reviews: What the editors say. Personality and Social Psychology Bulletin, 17(3), 267.

Beyond internal validity: Towards a broader understanding of credibility in development policy research. (2020). World Development, 127, 1.

Bosch, X. (2007). Dealing with scientific misconduct. BMJ: British Medical Journal, 335(7619), 524.

Bossuyt, P. M., Reitsma, J. B., E Bruns, D., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., … & De Vet, H. C. (2003). Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Clinical Chemistry and Laboratory Medicine, 41(1), 68-73.

Bostanci, A. (2002). Germany gets in step with scientific misconduct rules. Science, 296(5574), 1778-1778.

Carsey, T. M. (2014). Making DA-RT a Reality. PS: Political Science & Politics, 47(01), 72-77.

Carver, R. P. (1978). The case against statistical significance testing. Harvard Educational Review, 48(3), 378-399.

Casadevall, A., & Fang, F. C. (2012). Reforming science: methodological and cultural reforms. Infection and Immunity, 80(3), 891-896.

Chalmers, I., Bracken, M. B., Djulbegovic, B., Garattini, S., Grant, J., Gülmezoglu, A. M., … & Oliver, S. (2014). How to increase value and reduce waste when research priorities are set. The Lancet, 383(9912), 156-165.

Clarke, M. (2008, July). Interpreting the results of systematic reviews. In Seminars in Hematology (Vol. 45, No. 3, pp. 176-180). WB Saunders.

Chinn, C. A., & Rinehart, R. W. (2016). Commentary: Advances in research on sourcing–source credibility and reliable processes for producing knowledge claims. Reading and Writing, 29(8), 1701-1717.

Coffman, L. C., & Niederle, M. (2015). Pre-analysis Plans Have Limited Upside, Especially Where Replications Are Feasible. Journal of Economic Perspectives, 29(3): 81-98.

Cummings, K. M., & Proctor, R. N. (2014). The changing public image of smoking in the United States: 1964–2014. Cancer Epidemiology Biomarkers & Prevention, 23(1), 32-36.

Dafoe, A. (2014). Science deserves better: the imperative to share complete replication files. PS: Political Science & Politics, 47(01), 60-66.

Dal-Ré, R., Bracken, M. B., & Ioannidis, J. P. (2015). Call to improve transparency of trials of non-regulated interventions. BMJ, 350, h1323.

Dal-Ré, R., Ioannidis, J. P., Bracken, M. B., Buffler, P. A., Chan, A. W., Franco, E. L., … & Weiderpass, E. (2014). Making prospective registration of observational research a reality. Science Translational Medicine, 6(224), 224cm1-224cm1.

Djulbegovic, B., Hozo, I., & Ioannidis, J. P. (2014). Improving the drug development process: more not less randomized trials. JAMA, 311(4), 355-356.

Doberstein, C. (2017). Whom do bureaucrats believe? A randomized controlled experiment testing perceptions of credibility of policy research. Policy Studies Journal, 45(2), 384-405.

Donoho, D. L. (2010). An invitation to reproducible computational research. Biostatistics, 11(3), 385-388.

Donoho, D. L., Maleki, A., Rahman, I. U., Shahram, M., & Stodden, V. (2009). Reproducible research in computational harmonic analysis. Computing in Science & Engineering, 11(1), 8-18.

Doshi, P., Goodman, S. N., & Ioannidis, J. P. (2013). Raw data from clinical trials: within reach?. Trends in Pharmacological Sciences, 34(12), 645-647.

Drotar, D. (2008). Editorial: Thoughts on establishing research significance and preserving scientific integrity. Journal of Pediatric Psychology, 33(1), 1-5.

Duarte, J. L., Crawford, J. T., Stern, C., Haidt, J., Jussim, L., & Tetlock, P. E. (in press). Political diversity will improve social psychological science.  Behavioral and Brain Sciences.

Eich, E. (2014). Business not as usual. Psychological Science, 25(1), 3-6.

Elliott, K. C. (2014). Financial conflicts of interest and criteria for research credibility. Erkenntnis, 79, 917-937.

Elman, C., & Kapiszewski, D. (2014). Data Access and Research Transparency in the Qualitative Tradition. PS: Political Science & Politics, 47(01), 43-47.

Epstein, S. (1995). The construction of lay expertise: AIDS activism and the forging of credibility in the reform of clinical trials. Science, Technology & Human Values, 20(4), 408-437.

Eysenbach, G. (2000). Report of a case of cyberplagiarism-and reflections on detecting and preventing academic misconduct using the Internet. Journal of Medical Internet Research, 2(1).

Faden, R. R., Kass, N. E., Goodman, S. N., Pronovost, P., Tunis, S., & Beauchamp, T. L. (2013). An ethics framework for a learning health care system: a departure from traditional research ethics and clinical ethics. Hastings Center Report, 43(s1), S16-S27.

Fanelli, D. (2013). Redefine misconduct as distorted reporting. Nature, 494(7436), 149-149.

Fanelli, D. (2015). We need more research on causes and consequences, as well as on solutions. Addiction, 110(1), 11-13.

Farthing, M. J. (1998). Coping with fraud. The Lancet, 352, S11.

Finkel, E. J., Eastwick, P. W., & Reis, H. T. (2015). Best research practices in psychology: Illustrating epistemological and pragmatic considerations with the case of relationship science. Journal of Personality and Social Psychology, 108(2), 275.

Fleurence, R. L., Forsythe, L. P., Lauer, M., Rotter, J., Ioannidis, J. P., Beal, A., … & Selby, J. V. (2014). Engaging patients and stakeholders in research proposal review: The Patient-Centered Outcomes Research Institute. Annals of Internal Medicine, 161(2), 122-130.

Foy, J. E., LoCasto, P. C., Briner, S. W., & Dyar, S. (2017). Would a madman have been so wise as this? The effects of source credibility and message credibility on validation. Memory & Cognition, 45(2), 281-295.

Funder, D.C., Levine, J.M., Mackie, D.M., Morf, C.M., Sansone, C., Vazire, S., & West, S.G.      (2014).  Improving dependability of research in personality and social psychology:  Recommendations for research and educational practice.  Personality and Social Psychology Review, 18, 3-12.

Goodman, S. N. (2015). Clinical trial data sharing: what do we do now?. Annals of Internal Medicine, 162(4), 308-309.

Goodman, S. N., & Redberg, R. F. (2014). Opening the FDA black box. JAMA, 311(4), 361-363.

Gøtzsche, P. C., Kassirer, J. P., Woolley, K. L., Wager, E., Jacobs, A., Gertel, A., & Hamilton, C. (2009). What should be done to tackle ghostwriting in the medical literature?. PLoS Medicine, 6(2), e1000023.

Goldberg, D. (2003). Research fraud: A sui generis problem demands a sui generis solution (plus a little due process). Thomas M. Cooley Law Review, 20(47).

Gunsalus, C. K. (1997). Rethinking unscientific attitudes about scientific misconduct. The Chronicle of Higher Education, 28, B4-5.

Gunsalus, C. K. (1993). Institutional structure to ensure research integrity. Academic Medicine, 68(9), S33-8.

Halvorson, M. A., Finlay, A. K., Cronkite, R. C., Bi, X., Hayashi, K., Maisel, N. C., … & Finney, J. W. (2014). Ten-Year Publication Trajectories of Health Services Research Career Development Award Recipients Collaboration, Awardee Characteristics, and Productivity Correlates. Evaluation & the Health Professions, 0163278714542848.

Hartman, R. O., Dieckmann, N. F., Sprenger, A. M., Stastny, B. J., & DeMarree, K. G. (2017). Modeling attitudes toward science: Development and validation of the credibility of science scale. Basic and Applied Social Psychology, 39(6), 358-371.

Ioannidis, J. (2014). Errors (my very own) and the fearful uncertainty of numbers. European Journal of Clinical Investigation, 44(7), 617-618.

Ioannidis, J. (2015). Handling the fragile vase of scientific practices. Addiction,110(1), 9-10.

Ioannidis, J. P. (2014). How to make more published research true. PLoS Medicine, 11(10), e1001747.

Ioannidis, J. P. (2015). Stealth research: is biomedical innovation happening outside the peer-reviewed literature?. JAMA, 313(7), 663-664.

Ioannidis, J. (2010). Meta‐research: The art of getting it wrong. Research Synthesis Methods, 1(3‐4), 169-184.

Ioannidis, J. P. (2012). Scientific communication is down at the moment, please check again later. Psychological Inquiry, 23(3), 267-270.

Ioannidis, J. (2015). Translational Research May Be Most Successful When It Fails. Hastings Center Report, 45(2), 39-40.

Ioannidis, J. P., Boyack, K. W., & Klavans, R. (2014). Estimates of the continuously publishing core in the scientific workforce. PloS One, 9(7), e101698.

Ioannidis, J., Boyack, K. W., Small, H., Sorensen, A. A., & Klavans, R. (2014). Bibliometrics: Is your most cited work your best?. Nature, 514, 561-562.

Ioannidis, J. P., Greenland, S., Hlatky, M. A., Khoury, M. J., Macleod, M. R., Moher, D., … & Tibshirani, R. (2014). Increasing value and reducing waste in research design, conduct, and analysis. The Lancet, 383(9912), 166-175.

Ioannidis, J. P., & Khoury, M. J. (2013). Are randomized trials obsolete or more important than ever in the genomic era. Genome Med, 5(4), 32.

Ishiyama, J. (2014). Replication, research transparency, and journal publications: Individualism, community models, and the future of replication studies. PS: Political Science & Politics, 47(01), 78-83.

Jones, N. L., Peiffer, A. M., Lambros, A., Guthold, M., Johnson, A. D., Tytell, M., … & Eldridge, J. C. (2010). Developing a problem-based learning (PBL) curriculum for professionalism and scientific integrity training for biomedical graduate students. Journal of Medical Ethics, 36(10), 614-619.

Karr, A. F. (2014). Why data availability is such a hard problem. Statistical Journal of the IAOS: Journal of the International Association for Official Statistics, 30(2), 101-107.

Kass, N. E., Faden, R. R., Goodman, S. N., Pronovost, P., Tunis, S., & Beauchamp, T. L. (2013). The Research‐Treatment Distinction: A Problematic Approach for Determining Which Activities Should Have Ethical Oversight. Hastings Center Report, 43(s1), S4-S15.

Ketefian, S., & Lenz, E. R. (1995). Promoting scientific integrity in nursing research, part II: Strategies. Journal of Professional Nursing, 11(5), 263-269.

Khoury MJ, Ioannidis JP. (2014) Big Data Meets Public Health. Science. 346(6213):1054-5

Knottnerus, J. A., & Tugwell, P. (2010). Credibility and methodology of effectiveness research keep us busy. Journal of Clinical Epidemiology, 63(2), 115-6.

Kunz, R., Djulbegovic, B., Schunemann, H. J., Stanulla, M., Muti, P., & Guyatt, G. (2008, July). Misconceptions, challenges, uncertainty, and progress in guideline recommendations. In Seminars in Hematology (Vol. 45, No. 3, pp. 167-175). WB Saunders.

Laine, C., Goodman, S. N., Griswold, M. E., & Sox, H. C. (2007). Reproducible research: moving toward research the public can really trust. Annals of Internal Medicine, 146(6), 450-453.

LeBel, E. P., Borsboom, D., Giner-Sorolla, R., Hasselman, F., Peters, K. R., Ratliff, K. A., & Smith, C. T. (2013). PsychDisclosure. org Grassroots Support for Reforming Reporting Standards in Psychology. Perspectives on Psychological Science, 8(4), 424-432.

Leek, J. T., & Peng, R. D. (2015). Opinion: Reproducible research can still be wrong: Adopting a prevention approach. Proceedings of the National Academy of Sciences, 112(6), 1645-1646.

LeVeque, R. J., Mitchell, I. M., & Stodden, V. (2012). Reproducible research for scientific computing: Tools and strategies for changing the culture. Computing in Science and Engineering, 14(4), 13.

Lupia, A. (2008). Procedural transparency and the credibility of election surveys. Electoral Studies, 27(4), 732-739.

Lupia, A. (2014). What Is the Value of Social Science? Challenges for Researchers and Government Funders. PS: Political Science & Politics, 47(01), 1-7.

Lupia, A., & Alter, G. (2014). Data Access and Research Transparency in the Quantitative Tradition. PS: Political Science & Politics, 47(01), 54-59.

Lupia, A., & Elman, C. (2014). Openness in Political Science: Data Access and Research Transparency. PS: Political Science & Politics, 47(01), 19-42.

Lyddy, F. (1999). Netting research credibility. Psychologist, 12(3), 146.

MacCoun, R. J. (2014). New evidence on the tenuous state of evidence‐based drug policy. Addiction, 109(8), 1234-1235.

Macilwain, C. (2012). Scientific misconduct: more cops, more robbers?. Cell, 149(7), 1417-1419.

Macleod, M. R., Michie, S., Roberts, I., Dirnagl, U., Chalmers, I., Ioannidis, J. P., … & Glasziou, P. (2014). Biomedical research: increasing value, reducing waste. The Lancet, 383(9912), 101-104.

MacCoun, R. J. (2018). Enhancing research credibility when replication is not feasible. Behavioral and Brain Sciences, 41.

Macrina, F. L., & Munro, C. L. (1995). The case study approach to teaching scientific integrity in nursing and the biomedical sciences. Journal of Professional Nursing, 11(1), 40-44.

Magnus, D., Parsi, K., & Sharp, R. (2014). AJOB 2.0: Taking Bioethics to a New Level. The American Journal of Bioethics, 14(8), 1-2.

Marusic, A., Katavic, V., & Marusic, M. (2007). Role of editors and journals in detecting and preventing scientific misconduct: strengths, weaknesses, opportunities, and threats. Medicine and law, 26(3), 545.

Marusic A., Wager E., Utrobicic A., Rothstein H. R., & Sambunjak D. (2016). Interventions to prevent misconduct and promote integrity in research and publication. Cochrance Database of Systematic Reviews, 4(38).

McDermott, R. (2014). Research Transparency and Data Archiving for Experiments. PS: Political Science & Politics, 47(01), 67-71.

Mello, M. M., Francer, J. K., Wilenzick, M., Teden, P., Bierer, B. E., & Barnes, M. (2013). Preparing for responsible sharing of clinical trial data. New England Journal of Medicine, 369(17), 1651-1658.

Miguel, E., Camerer, C., Casey, K., Cohen, J., Esterling, K. M., Gerber, A., … & Van der Laan, M. (2014). Promoting transparency in social science research. Science, 343(6166), 30.

Mischak, H., Critselis, E., Hanash, S., Gallagher, W. M., Vlahou, A., & Ioannidis, J. P. (2015). Epidemiologic Design and Analysis for Proteomic Studies: A Primer on-Omic Technologies. American Journal of Epidemiology, kwu462.

Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., … & Altman, D. G. (2010). CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. Journal of Clinical Epidemiology, 63(8), e1-e37.

Montori, V. M., Saha, S., & Clarke, M. (2004). A call for systematic reviews. Journal of General Internal Medicine, 19(12), 1240-1241.

Moravcsik, A. (2014). Transparency: The Revolution in Qualitative Research. PS: Political Science & Politics, 47(01), 48-53.

Neuroskeptic. The Nine Circles of Scientific Hell. Perspectives on Psychological Science, 7, 643-644.

Nordhagen, S., Calverley, D., Foulds, C., O’keefe, L., & Wang, X. (2014). Climate change research and credibility: Balancing tensions across professional, personal, and public domains. Climatic Change, 125(2), 149-162.

Nosek, B. A., & Bar-Anan, Y. (2012). Scientific utopia: I. Opening scientific communication. Psychological Inquiry, 23(3), 217-243.

Nosek, B. A., & Lakens, D. (2014). Registered reports: A Method to Increase the Credibility of Published Results. Social Psychology,45(3), 137-141.

Nosek, B. A., Spies, J. R., & Motyl, M., (2012). Scientific Utopia: II. Restructuring Incentives and Practices to Promote Truth Over Publishability. Perspectives on Psychological Science, 7(6), 615-631.

Nyhan, B. (2015). Increasing the credibility of political science research: A proposal for journal reforms. PS, Political Science & Politics, 48, 78-83.

Nylenna, M., & Simonsen, S. (2006). Scientific misconduct: a new approach to prevention. The Lancet, 367(9526), 1882-1884.

Olken, B. A. (2015). Promises and Perils of Pre-analysis Plans. Journal of Economic Perspectives, 29(3): 61-80.

Open Science Collaboration. (2012). An open, large-scale, collaborative effort to estimate the reproducibility of psychological science. Perspectives on Psychological Science, 7(6), 657-660.

Owens, D. K., & Goldhaber-Fiebert, J. D. (2013). Prioritizing guideline-recommended interventions. Annals of Internal Medicine, 159(3), 223-224.

Parrish, D. M. (1997). Improving the scientific misconduct hearing process. JAMA, 277(16), 1315-1319.

Poldrack, R. A., & Gorgolewski, K. J. (2014). Making big data open: data sharing in neuroimaging. Nature Neuroscience, 17(11), 1510-1517.

Poon, P. (1995). Legal protections for the scientific misconduct whistleblower.The Journal of Law, Medicine & Ethics, 23(1), 88-95.

Reiter, J. P., & Kinney, S. K. (2011). Commentary: Sharing Confidential Data for Research Purposes: A Primer. Epidemiology, 22(5), 632-635.

Rifai, N., Bossuyt, P. M., Ioannidis, J. P., Bray, K. R., McShane, L. M., Golub, R. M., & Hooft, L. (2014). Registering diagnostic and prognostic trials of tests: is it the right thing to do?. Clinical Chemistry, 60(9), 1146-1152.

Robinson, A. (1994). Science and scandal: what can be done about scientific misconduct?. CMAJ: Canadian Medical Association Journal, 151(6), 831.

Roehr, B. (2012). Creating credibility and value in comparative effectiveness research. BMJ : British Medical Journal (Online), 345.

Sakaluk, J., Williams, A., & Biernat, M. (2014). Analytic Review as a Solution to the Misreporting of Statistical Results in Psychological Science. Perspectives on Psychological Science, 9(6), 652-660.

Schroter, S., Morris, J., Chaudhry, S., Smith, R., & Barratt, H. (2004). Does the type of competing interest statement affect readers’ perceptions of the credibility of research? randomised trial. BMJ : British Medical Journal, 328(7442), 742.

Sherman, S. E. (1995). The False Claims Act. Litigating scientific misconduct. Public Health Reports, 110(6)

Shore, E. G. (1995). Effectiveness of research guidelines in prevention of scientific misconduct. Science and Engineering Ethics, 1(4), 383-387.

Snyder, E. Y., & Loring, J. F. (2006). Beyond fraud—stem-cell research continues. New England Journal of Medicine, 354(4), 321-324.

Sovacool, B. K. (2005). Using criminalization and due process to reduce scientific misconduct. The American Journal of Bioethics, 5(5), W1-W7.

Spindler, J. C. (2006). Conflict or credibility: Research analyst conflicts of interest and the market for underwriting business. Journal of Legal Studies, 35(2), 303-325.

Sponholz, G. (2000). Teaching scientific integrity and research ethics. Forensic Science International, 113(1), 511-514.

Steneck, N. H. (2006). Fostering integrity in research: Definitions, current knowledge, and future directions. Science and Engineering Ethics, 12(1), 53-74.

Stewart, H., & Gapp, R. (2017). Exploring the alchemy of qualitative management research: Seeking trustworthiness, credibility and rigor through crystallization. The Qualitative Report, 22(1), 1-19.

Stodden, V., Guo, P., & Ma, Z. (2013). Toward reproducible computational research: an empirical analysis of data and code policy adoption by journals. PloS One, 8(6), e67111.

Stodden, V., Miguez, S., & Seiler, J. (2015). ResearchCompendia. org: Cyberinfrastructure for Reproducibility and Collaboration in Computational Science. Computing in Science & Engineering, 17(1), 12-19.

Underhill, R. G. (1995). How can we improve the credibility and status of qualitative research studies? School Science and Mathematics, 95(3), 113.

Wagenmakers, E. J., Wetzels, R., Borsboom, D., van der Maas, H. L., & Kievit, R. A. (2012). An agenda for purely confirmatory research. Perspectives on Psychological Science, 7(6), 632-638.

Warner, T. D., & Roberts, L. W. (2004). Scientific integrity, fidelity and conflicts of interest in research. Current Opinion in Psychiatry, 17(5), 381-385.

Weed, D. L. (1998). Preventing scientific misconduct. American Journal of Public Health, 88(1), 125-129.

White, C. (2000). Plans for tackling research fraud may not go far enough. BMJ: British Medical Journal, 321(7275), 1487.

Witten, D. M., & Tibshirani, R. (2012). Scientific research in the age of omics: the good, the bad, and the sloppy. Journal of the American Medical Informatics Association, amiajnl-2012.

Wocial, L. D. (1995). The role of mentors in promoting integrity and preventing scientific misconduct in nursing research. Journal of Professional nursing,11(5), 276-280.