research-article

A usability evaluation of AlgoSketch: a pen-based application for mathematics

Authors:

Theresa O'Connell,

Timothy S. Miller,

Robert C. Zeleznik,

Joseph J. LaViola, Jr.Authors Info & Claims

SBIM '09: Proceedings of the 6th Eurographics Symposium on Sketch-Based Interfaces and Modeling

Pages 149 - 157

https://doi.org/10.1145/1572741.1572767

Published: 01 August 2009 Publication History

Abstract

AlgoSketch is a pen-based system for entering and editing mathematics. It supports interactive computation and early-stage mathematical algorithm design. In its paper-like environment, mathematical expressions can be entered anywhere on the page. Recognition and computational feedback are given in real time. We present results of a formative user evaluation of AlgoSketch, examining its applicability as a new interaction paradigm and users' overall experience with its mathematical entry, feedback, and computational support. Using a goal, question metric (GQM) framework, we evaluated AlgoSketch using efficiency, effectiveness, and satisfaction metrics. Logging data was supported by a post-questionnaire and anecdotal data. Results indicate acceptance of the AlgoSketch paradigm; strong potential for workplace utility, and a need for better mathematical expression recognition.

References

[1]

{BCR94} Basili V. R., Caldiera G., Rombach H. D.: The goal question metric approach. In Encyclopedia of Software Engineering. Wiley, 1994.

[2]

{BJ06} Berander P., J&#246;nsson P.: A goal question metric based approach for efficient measurement framework definition. In ISESE'06: Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering (New York, NY, USA, 2006), ACM, pp. 316--325.

Digital Library

[3]

{BZW*09} Bragdon A., Zeleznik R., Williamson B., Miller T., LaViola Jr. J. J.: Gesturebar: improving the approachability of gesture-based interfaces. In CHI'09: Proceedings of the 27th international conference on Human factors in computing systems (New York, NY, USA, 2009), ACM, pp. 2269--2278.

Digital Library

[4]

{CY01} Chan K.-F., Yeung D.-Y.: Pencalc: A novel application of on-line mathematical expression recognition technology. In Proceedings of the Sixth International Conference on Document Analysis and Recognition (September 2001), pp. 774--778.

Digital Library

[5]

{IOS} International organization for standardization, ergonomic requirements for office work with visual display terminals (vdts) -- part 11: Guidance on usability. 1998.

[6]

{LaV07a} LaViola J.: Advances in mathematical sketching: Moving toward the paradigm's full potential. IEEE Computer Graphics and Applications 27, 1 (January/Febuary 2007), 38--48.

Digital Library

[7]

{LaV07b} LaViola J.: An initial evaluation of mathpad²: A tool for creating dynamic mathematical illustrations. Comput. Graph. 31, 4 (2007), 540--553.

Digital Library

[8]

{LLM*08} Labahn G., Lank E., Marzouk M., Bunt A., MacLean S., Tausky D.: Mathbrush: A case study for interactive pen-based mathematics. In Proceedings of the 5th EUROGRAPHICS Workshop on Sketch-Based Interfaces and Modeling (SBIM 2008) (June 2008), pp. 143--150.

Digital Library

[9]

{LMM*06} Labahn G., MacLean S., Mirette M., Rutherford I., Tausky D.: Mathbrush: An experimental pen-based math system. In Challenges in Symbolic Computation Software (2006), Decker W., Dewar M., Kaltofen E., Watt S., (Eds.), no. 06271 in Dagstuhl Seminar Proceedings, Internationales Begegnungs- und Forschungszentrum fuer Informatik (IBFI), Schloss Dagstuhl, Germany.

[10]

{LMZL08} Li C., Miller T., Zeleznik R., LaViola J.: Algosketch: Algorithm sketching and interactive computation. In Proc. of the 5th EUROGRAPHICS Workshop on Sketch-Based Interfaces and Modeling (SBIM 2008), pp. 175--182 (2008).

Digital Library

[11]

{LZ04} LaViola J., Zeleznik R.: Mathpad: A system for the creation and exploration of mathematical sketches. ACM Transactions on Graphics 23, 3 (Aug. 2004), 432--440. (Proceedings of SIGGRAPH 2004).

Digital Library

[12]

{OC08} O'Connell T., Choong Y.: Metrics for measuring human interaction with interactive visualizations for information analysis. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2008), pp. 1493--1496.

Digital Library

[13]

{TT05} Thimbleby W., Thimbleby H.: A novel gesture-based calculator and its design principles. In Proceedings 19th BCS HCI Conference (2005), MacKinnon L., Bertelsen O., Bryan-Kinns N., (Eds.), vol. 2, British Computer Society, pp. 27--32.

[14]

{ZML07} Zeleznik R., Miller T., Li C.: Designing UI techniques for handwritten mathematics. In Proceedings of the 4th EUROGRAPHICS Workshop on Sketch-Based Interfaces and Modeling (SBIM 2007) (Aug. 2007).

Digital Library

[15]

{ZMLL08} Zeleznik R., Miller T., Li C., LaViola J.: Mathematical sketching with fluid support for online computation. In Smart Graphics 9th International Symposium, SG 2008 (Rennes, France, August 2008), pp. 20--32.

Digital Library

Cited By

Arawjo IDeArmas ARoberts MBasu SParikh T(2022)Notational Programming for Notebook Environments: A Case Study with Quantum CircuitsProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545619(1-20)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545619
Ung HNguyen CNguyen HNakagawa M(2021)GSSF: A Generative Sequence Similarity Function Based on a Seq2Seq Model for Clustering Online Handwritten Mathematical AnswersDocument Analysis and Recognition – ICDAR 202110.1007/978-3-030-86331-9_10(145-159)Online publication date: 2-Sep-2021
https://doi.org/10.1007/978-3-030-86331-9_10
Ung HPhan MNguyen HNakagawa M(2019)Strategy and Tools for Collecting and Annotating Handwritten Descriptive Answers for Developing Automatic and Semi-Automatic Marking - An Initial Effort to Math2019 International Conference on Document Analysis and Recognition Workshops (ICDARW)10.1109/ICDARW.2019.10031(13-18)Online publication date: Sep-2019
https://doi.org/10.1109/ICDARW.2019.10031
Show More Cited By

Index Terms

A usability evaluation of AlgoSketch: a pen-based application for mathematics
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

AlgoSketch: algorithm sketching and interactive computation
SBM'08: Proceedings of the Fifth Eurographics conference on Sketch-Based Interfaces and Modeling

We present AlgoSketch, a pen-based algorithm sketching prototype with supporting interactive computation. AlgoSketch lets users fluidly enter and edit 2D handwritten mathematical expressions in the form of pseudocode-like descriptions to support the ...
Improving Usability Evaluation by Automating a Standardized Usability Questionnaire
Design, User Experience, and Usability: Theory and Practice
Abstract
Usability is one of the factors that determines the success of a software system. Aiming to improve it’s usability, it is necessary to evaluate the interfaces using scientific evaluation methods, like questionnaires. Often the results of these ...
Evaluating usability evaluation methods: criteria, method and a case study
HCI'07: Proceedings of the 12th international conference on Human-computer interaction: interaction design and usability

The paper proposes an approach to comparative usability evaluation that incorporates important relevant criteria identified in previous work. It applies the proposed approach to a case study of a comparative evaluation of an academic website employing ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SBIM '09: Proceedings of the 6th Eurographics Symposium on Sketch-Based Interfaces and Modeling

August 2009

168 pages

ISBN:9781605586021

DOI:10.1145/1572741

Editors:
Dieter Fellner
TU Darmstadt & Fraunhofer IGD, Germany
,
Stephen Spencer
The University of Washington
,
General Chairs:
Nathan Carr
Adobe Systems
,
Faramarz Samavati
University of Calgary, Canada
,
Program Chairs:
Cindy Grimm
Washington University in St. Louis
,
Joseph J. LaViola
University of Central Florida

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
EUROGRAPHICS: The European Association for Computer Graphics

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

SBIM '09

Sponsor:

SIGGRAPH
EUROGRAPHICS

SBIM '09: SBIM '09 - Sixth Eurographics Symposium on Sketch-Based Modeling and Interaction

August 1 - 2, 2009

Louisiana, New Orleans

Acceptance Rates

Overall Acceptance Rate 20 of 36 submissions, 56%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
258
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Arawjo IDeArmas ARoberts MBasu SParikh T(2022)Notational Programming for Notebook Environments: A Case Study with Quantum CircuitsProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545619(1-20)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545619
Ung HNguyen CNguyen HNakagawa M(2021)GSSF: A Generative Sequence Similarity Function Based on a Seq2Seq Model for Clustering Online Handwritten Mathematical AnswersDocument Analysis and Recognition – ICDAR 202110.1007/978-3-030-86331-9_10(145-159)Online publication date: 2-Sep-2021
https://doi.org/10.1007/978-3-030-86331-9_10
Ung HPhan MNguyen HNakagawa M(2019)Strategy and Tools for Collecting and Annotating Handwritten Descriptive Answers for Developing Automatic and Semi-Automatic Marking - An Initial Effort to Math2019 International Conference on Document Analysis and Recognition Workshops (ICDARW)10.1109/ICDARW.2019.10031(13-18)Online publication date: Sep-2019
https://doi.org/10.1109/ICDARW.2019.10031
Hijikata YHorie KNishida S(2013)Predictive Input Interface of Mathematical FormulasHuman-Computer Interaction – INTERACT 201310.1007/978-3-642-40483-2_27(383-400)Online publication date: 2013
https://doi.org/10.1007/978-3-642-40483-2_27
Anthony LYang JKoedinger K(2012)A paradigm for handwriting-based intelligent tutorsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2012.04.00370:11(866-887)Online publication date: 1-Nov-2012
https://dl.acm.org/doi/10.1016/j.ijhcs.2012.04.003
Wolin AField MHammond TDo ELeon JHammond TNealen A(2011)Combining corners from multiple segmentersProceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling10.1145/2021164.2021185(117-124)Online publication date: 5-Aug-2011
https://dl.acm.org/doi/10.1145/2021164.2021185

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents