Affiliation:
1. University of Canterbury, Christchurch, Canterbury, New Zealand
2. University of Saskatchewan, Saskatoon, Saskatchewan, Canada
Abstract
The implicit-association test (IAT) is a method for measuring subconscious associations between concepts in memory. It is widely used in social psychology research for assessing associations that people may be unable or unwilling to articulate, including those relating to race, gender, self harm, and risk-taking behaviour. We describe the motivation for adapting the IAT to user interface evaluation, including its potential to support rapid A/B testing that is amenable to online crowd-source dissemination, while also potentially reducing the validity risks caused by biases such as the good subject effect. We present a method (the UI-IAT) for conducting implicit association tests for A/B user interface evaluation, and we present results of two experiments demonstrating that, although the method can successfully discriminate between 'good' and 'bad' interfaces, its sensitivity is low. We discuss implications for practical use of the UI-IAT and for further work.
Funder
New Zealand Royal Society Marsden Grant
Publisher
Association for Computing Machinery (ACM)
Reference56 articles.
1. Hal R. Arkes and Philip E. Tetlock. 2004. Attributions of Implicit Prejudice, or "Would Jesse Jackson 'Fail' the Implicit Association Test?". Psychological inquiry 15, 4 (2004), 257--278.
2. Using Implicit Measures to Assess User Experience in Children: A Case Study on the Application of the Implicit Association Test (IAT)
3. Deciding Advantageously Before Knowing the Advantageous Strategy
4. Reducing Implicit Gender Bias Using a Virtual Workplace Environment
5. John Brooke. 1996. SUS: A 'Quick' and 'Dirty' Usability Scale. In Usability Evaluation in Industry, Patrick W. Jordan, Bruce Thomas, Bernard A. Weerdmeester, and Ian Lyall McClelland (Eds.). Taylor and Francis, Chapter 21, 189--194.