Exhaustive or Exhausting? Evidence on Respondent Fatigue in Long Surveys
By Dahyeon Jeong, Shilpa Aggarwal, Jonathan Robinson, Naresh Kumar, Alan Spearot, David Park
Journal of Development Economics | March 2023
DOI
www.sciencedirect.com/science/article/pii/S0304387822001341
Citation
Jeong, Dahyeon., Aggarwal, Shilpa., Robinson, Jonathan., Kumar, Naresh., Spearot, Alan., Park, David. (2023). Exhaustive or Exhausting? Evidence on Respondent Fatigue in Long Surveys Journal of Development Economics www.sciencedirect.com/science/article/pii/S0304387822001341.
Copyright
Journal of Development Economics, 2023
Share:
Abstract
Living standards measurement surveys require sustained attention for several hours. We quantify survey fatigue by randomizing the order of questions in in-person surveys (lasting 2.5 hours on average) fielded in an evaluation of cash transfers in rural Liberia and Malawi. An additional hour of survey time increases the probability that a respondent skips a question by 10-64%. Because skips are more common, the total monetary value of aggregated categories such as assets or expenditures declines as the survey goes on, and this effect is sizeable for some categories: for example, an extra hour of survey time lowers food expenditures by 25%. Evidence from a similar experiment within high-frequency phone surveys shows that the results are not driven by the respondents deliberately choosing to skip questions in order to hasten the end of the survey, suggesting that cognitive burden is the key driver of survey fatigue.

Shilpa Aggarwal is an Associate Professor of Economics and Public Policy at the Indian School of Business (ISB). She is a development economist, whose research aims to explore market linkages in developing countries. For her PhD dissertation, she examined the effects of a road construction programme in India that connected remote rural areas to nearby markets. Her ongoing research is focused on agricultural supply chains in India and East Africa. She also works on issues pertaining to domestic trade, microfinance, and food policy.

Professor Aggarwal holds a PhD from the University of California, Santa Cruz, an MA from the Delhi School of Economics, and a BA from Shri Ram College of Commerce, University of Delhi.

Shilpa Aggarwal (1)
Shilpa Aggarwal