Examples

A list of example replication studies.

Jump to: Typology of replication studies / Example studies in Public Administration, Development Studies, Social Issues


Types of replication studies


My colleague Dr. René Bekkers gave a clear summary of different types of replication studies according to (Freese & Peterson, 2017, p. 152) in his course Replication and Preregistration in Social Science:

  • You conduct a verification: from the description of the decisions with respect to the preprocessing and analysis of the data in the paper, you try to reproduce the results reported. This is a good format when the paper reports on data made available to you by the author(s), but there is no code. Which decisions are crucial in order to obtain the results reported?
  • You conduct a robustness analysis, e.g. by a multiverse analysis examining how alternative decisions in data preparation, analytical strategy, and model specification affect the findings. This is a good format when the paper reports on available data and code. Among all the possible analyses, how unique are the findings in the analysis as originally reported?
  • You conduct a repetition by analyzing different data. Are the results for the different data set similar to the results reported in the original article? Are the results significantly different?
    • The paper reports on data and code that is available, and you find an alternative data set including similar information.
    • The paper reports on data that is not available, but you find an alternative data set including identical (or at least similar) data on different units. You conduct a repetition, for instance by analyzing a later or earlier edition of the same (panel) study in the same country; a different data set from the same country and the same year; a data set from a different country in the same year.
    • The paper reports on publicly data from a single country embedded in a multinational dataset, such as the ESS, the EVS, the WVS, or the ISSP.ESS: European data set; EVS: European Values study; WVS: World Values Survey; ISSP: International social survey program. You select a different country for which you can do the same analysis.
    • The paper reports a study that you run again in an online setting, e.g. through MTurk, Crowdflower, Prolific, or some other platform.
  • You conduct a generalization by analyzing different data with different methods. Find another dataset with similar yet slightly different measures, collect new data with modifications to the original protocol, or analyze new data with different methods or statistical models.

Example studies


These example articles are generated through Web of Science by 1) searching “replication” in the title field and 2) specifying the “Web of Science Categories”. You can use this strategy and other keywords to generate more relevant articles in the areas of your interest.

Public Administration

  • Van Ryzin, \relax G. G., Grosso, A., & Charbonneau, E. (2021). Evidence of an Output Bias in the Judgment of Public Performance: A Replication and Extension. PUBLIC PERFORMANCE & MANAGEMENT REVIEW, 44(3), 451–470. https://doi.org/10.1080/15309576.2020.1835679
  • Cepiku, D., & Mastrodascio, M. (2021). Leadership Behaviours in Local Government Networks: An Empirical Replication Study. PUBLIC MANAGEMENT REVIEW, 23(3), 354–375. https://doi.org/10.1080/14719037.2019.1679233
  • Andersen, \relax S. C., Nielsen, \relax H. S., & Thomsen, \relax M. K. (2020). How to Increase Citizen Coproduction: Replication and Extension of Existing Research. INTERNATIONAL PUBLIC MANAGEMENT JOURNAL, 23(5), 696–712. https://doi.org/10.1080/10967494.2018.1518851
  • George, B., Desmidt, S., Nielsen, \relax P. A., & Baekgaard, M. (2017). Rational Planning and Politicians’ Preferences for Spending and Reform: Replication and Extension of a Survey Experiment. PUBLIC MANAGEMENT REVIEW, 19(9), 1251–1271. https://doi.org/10.1080/14719037.2016.1210905
  • Grimmelikhuijsen, S., & Porumbescu, \relax G. A. (2017). Reconsidering the Expectancy Disconfirmation Model. Three Experimental Replications. PUBLIC MANAGEMENT REVIEW, 19(9), 1272–1292. https://doi.org/10.1080/14719037.2017.1282000
  • Scruggs, L., & Allan, J. (2006). Welfare-State Decommodification in 18 OECD Countries: A Replication and Revision. JOURNAL OF EUROPEAN SOCIAL POLICY, 16(1), 55–72. https://doi.org/10.1177/0958928706059833
  • Sievert, M. A Replication of “Representative Bureaucracy and the Willingness to Coproduce”. PUBLIC ADMINISTRATION. https://doi.org/10.1111/padm.12743
  • Snel, E., Reelick, F., & Groenenboom, N. (2013). Time and Poverty Revisited: A Replication of Leisering and Leibfried. JOURNAL OF EUROPEAN SOCIAL POLICY, 23(2), 179–191. https://doi.org/10.1177/0958928712471227

Development Studies

  • Alinaghi, N. (2019). Mobile Money, Risk Sharing, and Transaction Costs: A Replication Study of Evidence from Kenya’s Mobile Money Revolution. JOURNAL OF DEVELOPMENT EFFECTIVENESS, 11(4), 342–359. https://doi.org/10.1080/19439342.2019.1684343
  • Atanda, \relax A. A. (2019). Biometric Smartcards and Payment Disbursement: A Replication Study of Building State Capacity in India. JOURNAL OF DEVELOPMENT EFFECTIVENESS, 11(4), 360–372. https://doi.org/10.1080/19439342.2019.1646782
  • Basurto, \relax M. P., Burga, R., Toro, \relax J. L. F., & Huaroto, C. (2019). Note - Walking on Solid Ground: A Replication Study of ’Housing Health and Happiness.’ JOURNAL OF DEVELOPMENT STUDIES, 55(5), 1042–1046. https://doi.org/10.1080/00220388.2018.1506579
  • Carvalho, N., & Rokicki, S. (2019). The Impact of India’s Janani Suraksha Yojana Conditional Cash Transfer Programme: A Replication Study. JOURNAL OF DEVELOPMENT STUDIES, 55(5), 989–1006. https://doi.org/10.1080/00220388.2018.1506578
  • Donato, K., & Mosqueira, \relax A. G. (2019). Information Improves Provider Behaviour: A Replication Study of a Community-Based Monitoring Programme in Uganda. JOURNAL OF DEVELOPMENT STUDIES, 55(5), 967–988. https://doi.org/10.1080/00220388.2018.1506577
  • Kuecken, M., & Valfort, \relax M. A. (2019). Information Reduces Corruption and Improves Enrolment (But Not Schooling): A Replication Study of a Newspaper Campaign in Uganda. JOURNAL OF DEVELOPMENT STUDIES, 55(5), 1007–1029. https://doi.org/10.1080/00220388.2018.1506575
  • Lhachimi, \relax S. K., & Seuring, T. (2019). Thou Shalt Be given … but How? A Replication Study and Extended Cost-Effectiveness Analysis of a Randomized Experiment on Food Assistance in Northern Ecuador. JOURNAL OF DEVELOPMENT EFFECTIVENESS, 11(4), 373–390. https://doi.org/10.1080/19439342.2019.1666901
  • Meneses, \relax J. P., Ventura, \relax E. T., Elorreaga, \relax O. A., Huaroto, C., Aguilar, \relax G. G., & Beteta, \relax E. P. (2019). Improving Well-Being through Mobile Money: A Replication Study in Niger. JOURNAL OF DEVELOPMENT EFFECTIVENESS, 11(4), 327–341. https://doi.org/10.1080/19439342.2019.1679860
  • Stage, J., & Thangavelu, T. (2019). Savings Revisited: A Replication Study of a Savings Intervention in Malawi. JOURNAL OF DEVELOPMENT EFFECTIVENESS, 11(4), 313–326. https://doi.org/10.1080/19439342.2019.1679859
  • Wang, \relax H. M., & Luo, \relax J. T. (2019). The Short-Term Impact of Unconditional Cash Transfers: A Replication Study of a Randomized Controlled Trial in Kenya. JOURNAL OF DEVELOPMENT EFFECTIVENESS, 11(4), 391–408. https://doi.org/10.1080/19439342.2019.1666900
  • Whitney, \relax E. M., Cameron, \relax D. B., & Winters, \relax P. C. (2019). Heterogeneous Effects of Urban Land Titling: A Replication of ’Property Rights for the Poor.’ JOURNAL OF DEVELOPMENT STUDIES, 55(5), 1030–1033. https://doi.org/10.1080/00220388.2018.1506576
  • Wood, \relax B. D. K., & Dong, M. (2019). Recalling Extra Data: A Replication Study of Finding Missing Markets. JOURNAL OF DEVELOPMENT STUDIES, 55(5), 926–945. https://doi.org/10.1080/00220388.2018.1506574

Social Issues

  • Faisal, \relax R. A., Jobe, \relax M. C., Ahmed, O., & Sharker, T. Replication Analysis of the COVID-19 Worry Scale. DEATH STUDIES. https://doi.org/10.1080/07481187.2020.1815104
  • Cannatelli, B. (2017). Exploring the Contingencies of Scaling Social Impact: A Replication and Extension of the SCALERS Model. VOLUNTAS, 28(6), 2707–2733. https://doi.org/10.1007/s11266-016-9789-x
  • Snel, E., Reelick, F., & Groenenboom, N. (2013). Time and Poverty Revisited: A Replication of Leisering and Leibfried. JOURNAL OF EUROPEAN SOCIAL POLICY, 23(2), 179–191. https://doi.org/10.1177/0958928712471227
  • Helmig, B., Spraul, K., & Tremp, K. (2012). Replication Studies in Nonprofit Research: A Generalization and Extension of Findings Regarding the Media Publicity of Nonprofit Organizations. Nonprofit and Voluntary Sector Quarterly, 41(3), 360–385. https://doi.org/10.1177/0899764011404081
  • Scruggs, L., & Allan, J. (2006). Welfare-State Decommodification in 18 OECD Countries: A Replication and Revision. JOURNAL OF EUROPEAN SOCIAL POLICY, 16(1), 55–72. https://doi.org/10.1177/0958928706059833