Think-Aloud Surveys – A Method for Eliciting Enhanced Insights During User Studies

In a user experiment, we tried out a novel data collection approach consisting of combining surveys with the think aloud method. We coin the phrase “think-aloud survey method”, where participants think-aloud while completing a questionnaire. We analyzed the transcripts and found that the think aloud survey provides deeper insights into the reasoning behind the participants’ Likert scale choices and responses to open-ended questions, along with an enhanced understanding of the tasks and prompting the participants to explicate their choices. All resulting in more insights for design. The think- aloud survey method further offers other insights into usability issues and encourages the participants to provide system improvement proposals. The think-aloud survey method is useful for researchers and practitioners applying a large number of usability evaluations and wanting to dig deeper into the motivations for choice

Think-Aloud Surveys – A Method for Eliciting Enhanced Insights During User Studies

In a user experiment, we tried out a novel data collection approach consisting of combining surveys with the think aloud method. We coin the phrase “think-aloud survey method”, where participants think-aloud while completing a questionnaire.

We analyzed the transcripts and found that the think aloud survey provides deeper insights into the reasoning behind the participants’ Likert scale choices and responses to open-ended questions, along with an enhanced understanding of the tasks and prompting the participants to explicate their choices. All resulting in more insights for design.

The think- aloud survey method further offers other insights into usability issues and encourages the participants to provide system improvement proposals. The think-aloud survey method is useful for researchers and practitioners applying a large number of usability evaluations and wanting to dig deeper into the motivations for choice

Nielsen, L., Salminen, J., Jung, S.G., and Jansen, B. J. (2021) Think-Aloud Surveys – A Method for Eliciting Enhanced Insights During User Studies, INTERACT 2021 18th IFIP TC13 International Conference on Human–Computer Interaction. 30 Aug. – 3 Sept. Bari, Italy.

Share