[Back]

M. Smuc, E. Mayr, T. Lammarsch, W. Aigner, S. Miksch, J. Gärtner:
"To Score or Not to Score? Tripling Insights for Participatory Design";
IEEE Computer Graphics and Applications, 29 (2009), 3; 29 - 38.

Studies recording the number of user insights into data are used in the evaluation and comparison of Visual Analytics tools. However, such insight studies are based on varying definitions of insights, measure different qualitative and quantitative dimensions, and are seldom used during the participatory design phase of Visual Analytics tools. We introduce three levels of insight methodology to be used during the participatory design process and illustrate these using the DisC$\bar{o}$ project. We started by using conventional ``insight counters" which did not provide us with useful results for iterative design, so we went one step further and coded insights in line with the specific purpose of the tools, and successfully gathered information useful for design improvements. Finally, in order to gain an even deeper understanding, we further analyzed relations between insights and prior knowledge by means of a Relational Insight Organizer (RIO). The RIO helped characterize how users make sense of a tool, as well as where and whether they gain insights. We discuss the potential and prerequisites of these three levels of insight analysis for iterative design.

insight, usability engineering, formative evaluation, participatory design

http://dx.doi.org/10.1109/MCG.2009.53

http://publik.tuwien.ac.at/files/PubDat_218037.pdf