+44 (0)1509 263171
Please use this identifier to cite or link to this item:
|Title: ||Usability problem reports for comparative studies: consistency and inspectability|
|Authors: ||Vermeeren, Arnold P.O.S.|
de Ridder, Huib
von Doorn, Andrea J.
Berkman, Ali E.
|Issue Date: ||2008|
|Publisher: ||© Taylor & Francis|
|Citation: ||VERMEEREN, A.P.O.S. ... et al, 2008. Usability problem reports for comparative studies: consistency and inspectability. Human-Computer Interaction, 23 (4), pp. 329-380.|
|Abstract: ||The present study explores issues of consistency and inspectability in
usability test data analysis processes and reports. Problem reports resulting
from usability tests performed by three professional usability labs in three
different countries are compared. Each of the labs conducted a usability test
on the same product, applying an agreed test protocol that was collaboratively
developed by the labs. Each lab first analyzed their own findings as they
always do in their regular professional practice. A few weeks later, they again
analyzed their findings but then everyone applied the same method
(SlimDEVAN: a simplified version of DEVAN, a method developed for
facilitating comparison of findings from usability tests in an academic setting).
It was found that levels of agreement between labs did not improve when they
all used SlimDEVAN there was inherent subjectivity in their analyses. It was
found that consistency of single analysts in analyzing their data can be
improved by using a method like SlimDEVAN. Such methods can also help in
making the analysis process and findings more inspectable. Inspectability is
helpful in comparative studies based on identified usability problems because
it allows for the traceability of findings to original observations, as well as for
laying bare the subjective parts of the data analysis.|
|Description: ||This article was published in the journal, Human-Computer Interaction [© Taylor & Francis] and the definitive version is available at: http://dx.doi.org/10.1080/07370020802536396|
|Version: ||Accepted for publication|
|Appears in Collections:||Published Articles (Design School)|
Files associated with this item:
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.