RTI uses cookies to offer you the best experience online. By clicking “accept” on this website, you opt in and you agree to the use of cookies. If you would like to know more about how RTI uses cookies and how to manage them please view our Privacy Policy here. You can “opt out” or change your mind by visiting: http://optout.aboutads.info/. Click “accept” to agree.
A compendium of web and mobile survey pretesting methods
Geisen, E. M., & Murphy, J. (2019). A compendium of web and mobile survey pretesting methods. In P. Beatty, D. Collins, L. Kaye, J.-L. Padilla, G. Willis, & A. Wilmot (Eds.), Advances in questionnaire design, development, evaluation and testing (1st ed., pp. 289-314). Wiley. https://doi.org/10.1002/9781119263685.ch12
The purpose of this chapter is to introduce emerging survey pretesting methodologies and compare these with traditional methods in the light of modern data collection technologies to consider where the standard approaches for pretesting can be improved. We begin by discussing the key limitations of traditional pretesting methods such as expert review, cognitive interviewing, and pilot testing for evaluating “modern” surveys. We then provide an overview of emerging pretesting methods including usability testing, eye tracking, and online pretesting. We discuss the advantages offered by these methods – particularly in terms of budget and schedule – and provide examples of how these methods can improve data quality. We conclude with a theoretical mode for the optimal combination of traditional and newer methods for pretesting modern surveys.
