On Data ‘Janitor Work’ in Political Science: The Case of Thermostatic Support for Democracy

attitudes
democracy
measurement
dcpo
Authors
Affiliations

Pennsylvania State University

Pennsylvania State University

University of Iowa

Published

May 30, 2022

  • Hu, Yue, Yuehong Cassandra Tai, and Frederick Solt. 2022. “On Data ‘Janitor Work’ in Political Science: The Case of Thermostatic Support for Democracy.” SocArXiv.

  • No matching items

    Abstract

    Data ‘janitor work’, the task of getting data into a format appropriate for analysis, has grown increasingly important as political science research has come to depend on data drawn from hundreds and thousands of sources. One tempting solution is to simply enter the data by hand, but this approach raises serious risks of data-entry error, a difficult-to-catch problem with the potential to fatally undermine our conclusions. Underscoring these points, we identify data-entry errors in a prominent recent article, the 2020 study by Claassen that examines the effect of changes in democracy on public support for democracy. We then show that when these errors are corrected, the work’s models provide no support for its conclusion that publics react thermostatically to changes in democracy. Researchers should refrain from hand-entering data as much as possible, and we offer additional suggestions for avoiding errors.

    Important figures

    Figure 1: Comparing Democracy-Supporting Responses in the Publication Data and the Corrected Data

    Figure 2: The Effect of Democracy on Change in Public Support

    Figure 3: Simulated Effects of Change in Democracy on Public Support

    BibTeX citation

    @misc{HuTaiSolt2022,
     author={Hu, Yue and Tai, Yuehong Cassandra and Solt, Frederick},
     title={On Data 'Janitor Work' in Political Science: The Case of Thermostatic Support for Democracy},
     publisher={SocArXiv},
     year={2022},
     month={June}, 
     url={osf.io/preprints/socarxiv/kd7mu},
     doi={10.31235/osf.io/kd7mu}
    }