Social Desirability Bias in Measures of Norm Violations and Compliance during the COVID-19 Pandemic: Results of an Experimental Survey in Europe

Abstract

Social desirability bias is a problem in surveys collecting data on norm violations and compliance. If confronted with sensitive questions, respondents systematically underreport norm violations and overreport norm compliance. This leads to biased survey estimates and poor data quality. To improve the measurement of norm violations and compliance, the item count technique (ICT) has been developed. The ICT anonymizes the question-and-answer process. In their experimental survey ( n  = 2,510), the authors use the ICT to study norm violations and compliance during the coronavirus disease 2019 (COVID-19) pandemic in Europe. More specifically, they estimate the prevalence of vaccination certificate falsification and self-isolation with COVID-19 symptoms. Estimates obtained using standard direct questioning (DQ; n  = 1,006) are compared with ICT estimates ( n  = 1,504). As a result, the authors find no significant difference between estimates of vaccination certificate falsification (4.8 percent with DQ vs. 4.5 percent with the ICT). At the same time, they find a significant difference between estimates of self-isolation with COVID-19 symptoms (87.7 percent with DQ vs. 76.0 percent with the ICT). Conventional survey measures based on DQ thus likely overestimate the extent of norm compliance in a pandemic such as COVID-19.