Article

Mixing evaluation methods for assessing the utility of an interactive InfoVis technique

Authors:

Sylvia Wiltner,

Christian Popow,

Susanne OhmannAuthors Info & Claims

HCI'07: Proceedings of the 12th international conference on Human-computer interaction: interaction design and usability

Pages 604 - 613

Published: 22 July 2007 Publication History

Abstract

We describe the results of an empirical study comparing an interactive Information Visualization (InfoVis) technique called Gravi++ (GRAVI), Exploratory Data Analysis (EDA) and Machine Learning (ML). The application domain is the psychotherapeutic treatment of anorectic young women. The three techniques are supposed to support the therapists in finding the variables which influence success or failure in therapy.

To evaluate the utility of the three techniques we developed on the one hand a report system which helped subjects to formulate and document in a self-directed manner the insights they gained when using the three techniques. On the other hand, focus groups were held with the subjects. The combination of these very different evaluation methods prevents jumping to false conclusions and enables for an comprehensive assessment of the tested techniques.

The combined results indicate that the three techniques (EDA, ML, and GRAVI) are complementary and therefore should be used in conjunction.

References

[1]

Chen, C.: Empirical evaluation of information visualizations: an introduction. Int. J. Human-Computer Studies 53(5), 631-635 (2000)

Digital Library

[2]

Plaisant, C.: The challenge of information visualization evaluation. In: Costabile, M.F. (ed.) Proceedings of the working conference on Advanced visual interfaces, pp. 109-116. ACM Press, New York (2004)

Digital Library

[3]

Tory, M., Möller, T.: Human factors in visualization research. Visualization and Computer Graphics, IEEE Transactions on 10(1), 72-84 (2004)

Digital Library

[4]

Spence, R.: Information Visualization. ACM Press, New York (2001)

[5]

Stasko, J.: Evaluating information visualizations: Issues and opportunities (position statement). In: Bertini, E., Plaisant, C., Santucci, G. (eds.): Beyond time and errors: novel evaLuation methods for Information Visualization - Proceedings of BELIV'06, Venice, Italy, pp. 5-7 (2006)

[6]

Saraiya, P., North, C., Duca, K.: An insight-based methodology for evaluating bioinformatics visualizations. Visualization and Computer Graphics, IEEE Transactions on 11(4), 443-456 (2005)

Digital Library

[7]

Eysenck, M.W., Keane, M.T.: Cognitive Psychology. A Student's Handbook. Psychology Press, Taylor and Francis Group, London, New York (2005)

[8]

North, C.: Toward measuring visualization insight. Computer Graphics and Applications, IEEE 26(3), 6-9 (2006)

Digital Library

[9]

Lanzenberger, M.: The Interactive Stardinates - An Information Visualization Technique Applied in a Multiple View System. PhD thesis, Vienna University of Technology, Vienna, Austria ((September 2003)

[10]

Hinum, K., Miksch, S., Aigner, W., Ohmann, S., Popow, C., Pohl, M., Rester, M.: Gravi++: Interactive information visualization to explore highly structured temporal data. Journal of Universal Comp. Science 11(11), 1792-1805 (2005)

[11]

Tukey, J.W.: Exploratory Data Analysis. Addison-Wesley, Reading, Mass (1998)

[12]

Witten, I.H., Frank, E.: Data Mining: Practical machine learning tools and techniques, 2nd edn. Morgan Kaufmann, San Francisco, CA (2005)

Digital Library

[13]

Platt, J.: Fast training of support vector machines using sequential minimal optimization. In: Schoelkopf, B., Burges, C., Smola, A. (eds.) Advances in Kernel Methods - Support Vector Learning, pp. 185-210. MIT Press, Cambridge (1998)

Digital Library

[14]

Keerthi, S.S., Shevade, S.K., Bhattacharyya, C., Murthy, K.R.K.: Improvements to Platt's SMO Algorithm for SVM Classifier Design. Neural Computing 13(3), 637-649 (2001)

Digital Library

[15]

Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann, San Francisco, CA (1993)

Digital Library

[16]

Rester, M., Pohl, M., Hinum, K., Miksch, S., Popow, C., Ohmann, S., Banovic, S.: Methods for the evaluation of an interactive infovis tool supporting exploratory reasoning processes. In: BELIV '06: Proceedings of the 2006 AVI workshop on Beyond time and errors, New York, NY, pp. 32-37. ACM Press, New York (2006)

Digital Library

[17]

Rester, M., Pohl, M., Hinum, K., Miksch, S., Ohmann, S., Popow, C., Banovic, S.: Assessing the usability of an interactive information visualization method as the first step of a sustainable evaluation. In: Proc. Empowering Software Quality: How can Usability Engineering reach these goals?, Austrian Computer Society, pp. 31-44 (2005)

[18]

Kuniavsky, M.: User Experience: A Practitioner's Guide for User Research. Morgan Kaufmann, San Francisco (2003)

[19]

Mazza, R.: Evaluating information visualization applications with focus groups: the course-vis experience. In: BELIV '06: Proceedings of the 2006 AVI workshop on BEyond time and errors, New York, NY, USA, pp. 1-6. ACM Press, New York (2006)

Digital Library

Cited By

Tory MStaub-French SBertini EPerer APlaisant CSantucci G(2008)Qualitative analysis of visualizationProceedings of the 2008 Workshop on BEyond time and errors: novel evaLuation methods for Information Visualization10.1145/1377966.1377975(1-8)Online publication date: 5-Apr-2008
https://dl.acm.org/doi/10.1145/1377966.1377975
Pohl MRester MWiltner S(2007)Usability and transferability of a visualization methodology for medical dataProceedings of the 3rd Human-computer interaction and usability engineering of the Austrian computer society conference on HCI and usability for medicine and health care10.5555/1783414.1783433(171-184)Online publication date: 22-Nov-2007
https://dl.acm.org/doi/10.5555/1783414.1783433

Recommendations

Coordinating views in the InfoVis toolkit
AVI '06: Proceedings of the working conference on Advanced visual interfaces

Multidimensional data sets can be visualized in a variety of forms provided by many techniques described in the literature. Depending on specific tasks, users might need to analyze the same data set using different representations. Moreover, they might ...
Usability and transferability of a visualization methodology for medical data
USAB'07: Proceedings of the 3rd Human-computer interaction and usability engineering of the Austrian computer society conference on HCI and usability for medicine and health care

Information Visualization (InfoVis) techniques can offer a valuable contribution for the examination of medical data. We successfully developed an InfoVis application - Gravi - for the analysis of questionnaire data stemming from the therapy of anorectic ...
Constructing Interactive Visualizations with iVoLVER
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

iVoLVER, the Interactive Visual Language for Visualization Extraction and Reconstruction, is a web-based pen and touch system that graphically supports the construction of interactive visualizations and allows the extraction of data from different types ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

HCI'07: Proceedings of the 12th international conference on Human-computer interaction: interaction design and usability

July 2007

1239 pages

ISBN:9783540731047

Editor:
Julie A. Jacko
Georgia Institute of Technology and Emory University School of Medicine, Atlanta, GA

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 22 July 2007

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
7
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 26 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tory MStaub-French SBertini EPerer APlaisant CSantucci G(2008)Qualitative analysis of visualizationProceedings of the 2008 Workshop on BEyond time and errors: novel evaLuation methods for Information Visualization10.1145/1377966.1377975(1-8)Online publication date: 5-Apr-2008
https://dl.acm.org/doi/10.1145/1377966.1377975
Pohl MRester MWiltner S(2007)Usability and transferability of a visualization methodology for medical dataProceedings of the 3rd Human-computer interaction and usability engineering of the Austrian computer society conference on HCI and usability for medicine and health care10.5555/1783414.1783433(171-184)Online publication date: 22-Nov-2007
https://dl.acm.org/doi/10.5555/1783414.1783433

View Options

View options

Figures

Tables

Media

View Table of Conten