research-article

Microanalysis of active reading behavior to inform design of interactive desktop workspaces

Authors:

Anne Marie Piper,

Simon Olberding,

James HollanAuthors Info & Claims

ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces

Pages 215 - 224

https://doi.org/10.1145/2396636.2396670

Published: 11 November 2012 Publication History

Abstract

Hybrid paper-digital desktop workspaces have long been of interest in HCI, yet their design remains challenging. One continuing challenge is to support fluid interaction with both paper and digital media, while taking advantage of established practices with each. Today researchers are exploiting depth cameras and computer vision to capture activity on and above the desktop and enable direct interaction with digitally projected and physical media. One important prerequisite to augmenting desktop activity is understanding human behavior in particular contexts and tasks. Here we study active reading on the desktop. To better understand active reading practices and identify patterns that might serve as signatures for different types of related activity, we conducted a microanalysis of single users reading on and above the desktop workspace. We describe the relationship between multimodal body-based contextual cues and the interactions they signify in a physical desktop workspace. Detailed analysis of coordinated interactions with paper documents provides an empirical basis for designing digitally augmented desktop workspaces. We conclude with prototype design interactions for hybrid paper-digital desktop workspaces.

Supplementary Material

suppl.mov (its0141-file3.mp4)

Supplemental video

Download
16.82 MB

References

[1]

A. Adler, A. Gujar, B. L. Harrison, K. O'Hara, and A. Sellen. A diary study of work-related reading: design implications for digital reading devices. In Proc. CHI '98, pages 241--248, 1998.

Digital Library

[2]

B. B. Bederson. Interfaces for staying in the flow. Ubiquity, pages 1--1, Sept. 2004.

Digital Library

[3]

E. A. Bier, M. C. Stone, K. Pier, W. Buxton, and T. D. DeRose. Toolglass and magic lenses: the see-through interface. In Proc. SIGGRAPH '93, pages 73--80, 1993.

Digital Library

[4]

P. Brandl, C. Forlines, D. Wigdor, M. Haller, and C. Shen. Combining and measuring the benefits of bimanual pen and direct-touch interaction on horizontal interfaces. In Proc. AVI '08, pages 154--161, 2008.

Digital Library

[5]

V. Bush. As we may think. The Atlantic Monthly, 176(1):101--108, 1945.

[6]

B. Butterworth and G. Beattie. Gesture and silence as indicators of planning in speech. Recent advances in the psychology of language: Formal and experimental approaches, 4:247--360, 1978.

[7]

W. Buxton and B. Myers. A study in two-handed input. SIGCHI Bull., 17(4):321--326, Apr. 1986.

Digital Library

[8]

M. Csikszentmihalyi. Flow: The Psychology of Optimal Experience, volume 8:1. Harper Perennial, 1991.

[9]

D. Engelbart and W. English. A research center for augmenting human intellect. In Proc. AFIPS '68, pages 395--410, 1968.

Digital Library

[10]

A. Fouse, N. Weibel, E. Hutchins, and J. D. Hollan. Chronoviz: a system for supporting navigation of time-coded data. In Extended Abstracts of CHI 2011, pages 299--304, 2011.

Digital Library

[11]

Y. Guiard. Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model, 1987.

[12]

F. Guimbreti'ere. Paper Augmented Digital Documents. In Proc. UIST '03, 2003.

Digital Library

[13]

K. Hinckley, X. Bi, M. Pahud, and B. Buxton. Informal information gathering techniques for active reading. In Proc. CHI '12, pages 1893--1896, 2012.

Digital Library

[14]

K. Hinckley, R. Pausch, and D. Proffitt. Attention and visual feedback: the bimanual frame of reference. In Proc. I3D '97, pages 121--ff., 1997.

Digital Library

[15]

K. Hinckley, K. Yatani, M. Pahud, N. Coddington, J. Rodenhouse, A. Wilson, H. Benko, and B. Buxton. Pen + touch = new tools. In Proc. UIST '10, pages 27--36, 2010.

Digital Library

[16]

P. Kabbash, W. Buxton, and A. Sellen. Two-handed input in a compound task. In Proc. CHI '94, pages 417--423, 1994.

Digital Library

[17]

A. Kendon. Gesture. Annual Review of Anthropology, 26:pp. 109--128, 1997.

[18]

Y. Li, K. Hinckley, Z. Guan, and J. A. Landay. Experimental analysis of mode switching techniques in pen-based user interfaces. In Proc. CHI '05, pages 461--470, 2005.

Digital Library

[19]

C. Liao, F. Guimbreti'ere, K. Hinckley, and J. Hollan. PapierCraft: A Gesture-Based Command System for Interactive Paper. ACM TOCHI, pages 1--27, 2008.

Digital Library

[20]

W. MacKay, G. Velay, K. Carter, C. Ma, and D. Pagani. Augmenting reality: Adding computational dimensions to paper. Communications of the ACM, 36(7):96--97, 1993.

Digital Library

[21]

T. W. Malone. How do people organize their desks?: Implications for the design of office information systems. ACM Trans. Inf. Syst., 1(1):99--112, Jan. 1983.

Digital Library

[22]

C. C. Marshall. Annotation: from paper books to the digital library. In Proc. DL '97, pages 131--140, 1997.

Digital Library

[23]

D. McNeill. So you think gestures are nonverbal? Psychological Review, 92(3):350--371, 1985.

[24]

T. Moran and S. Zhai. Beyond the desktop metaphor in seven dimensions. Designing integrated digital work environments, pages 335--354, 2007.

[25]

M. Morris, A. Brush, and B. Meyers. Reading revisited: Evaluating the usability of digital display surfaces for active reading tasks. In Proc. TABLETOP '07, pages 79--86, 2007.

[26]

J. Napier and R. Tuttle. Hands. Princeton Science Library. Princeton University Press, 1993.

[27]

K. O'Hara and A. Sellen. A comparison of reading paper and on-line documents. In Proc. CHI '97, pages 335--342, 1997.

Digital Library

[28]

K. O'Hara, A. S. Taylor, W. M. Newman, and A. Sellen. Understanding the materiality of writing from multiple sources. Int. J. Hum.-Comput. Stud., 56(3):269--305, 2002.

[29]

B. N. Schilit, G. Golovchinsky, and M. N. Price. Beyond paper: supporting active reading with free form digital ink annotations. In Proc. CHI '98, 1998.

Digital Library

[30]

A. J. Sellen and R. H. Harper. The Myth of the Paperless Office. MIT Press, Cambridge, MA, USA, 2003.

Digital Library

[31]

H. Song, H. Benko, F. Guimbreti'ere, S. Izadi, X. Cao, and K. Hinckley. Grips and gestures on a multi-touch pen. In Proc. CHI '11, pages 1323--1332, 2011.

Digital Library

[32]

H. Song, F. Guimbreti'ere, T. Grossman, and G. Fitzmaurice. Mouselight: bimanual interactions on digital paper using a pen and a spatially-aware mobile projector. In Proc. CHI '10, pages 2451--2460, 2010.

Digital Library

[33]

J. Steimle, O. Brdiczka, and M. Mühlhäuser. CoScribe: Integrating Paper and Digital Documents for Collaborative Knowledge Work. IEEE Trans. on Learning Technologies, 2009.

Digital Library

[34]

L. Straker, C. Pollock, R. Burgess-Limerick, R. Skoss, and J. Coleman. The impact of computer display height and desk design on muscle activity during information technology work by young adults. Journal of Electromyography and Kinesiology, 18(4):606 -- 617, 2008.

[35]

A. Tabard, W. Mackay, and E. Eastmond. From individual to collaborative: the evolution of prism, a hybrid laboratory notebook. In Proc. CSCW '08, 2008.

Digital Library

[36]

C. S. Tashman and W. K. Edwards. Liquidtext: a flexible, multitouch environment to support active reading. In Proc. CHI '11, pages 3285--3294, 2011.

Digital Library

[37]

D. Vogel and G. Casiez. Conté: multimodal input inspired by an artist's crayon. In Proc. UIST '11, pages 357--366, 2011.

Digital Library

[38]

N. Weibel, A. Ispas, B. Signer, and M. C. Norrie. PaperProof: A Paper-Digital Proof-Editing System. In Proc. CHI '08, 2008.

Digital Library

[39]

P. Wellner. Interacting with paper on the digitaldesk. Communications of the ACM, 36(7):87 -- 96, 1993.

Digital Library

[40]

F. Wilson. The Hand: How Its Use Shapes the Brain, Language, and Human Culture. Vintage Series. Vintage Books, 1999.

[41]

R. Yeh, J. Brandt, J. Boli, and S. Klemmer. Interactive Gigapixel Prints: Large, Paper-based Interfaces for Visual Context and Collaboration. In Proc. Ubicomp 06, 2006.

Cited By

Shi LCampbell RChi PCirimele MCleron MClimer KFleming CGanti AGervais PGonnet PKarim TMaksai AMelancon CMickle RMusat CNandy PQu XRobishaw DSingh AVenkatesan M(2024)Inkeraction: An Interaction Modality Powered by Ink Recognition and SynthesisProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642498(1-26)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642498
Shibata HTakano KTano S(2022)Text Touching Effects in Active Reading: The Impact of the Use of a Touch-Based Tablet DeviceHuman-Computer Interaction – INTERACT 201510.1007/978-3-319-22701-6_41(559-576)Online publication date: 10-Mar-2022
https://dl.acm.org/doi/10.1007/978-3-319-22701-6_41
Sutherland CLuxton-Reilly APlimmer B(2022)An Observational Study of How Experienced Programmers Annotate Program CodeHuman-Computer Interaction – INTERACT 201510.1007/978-3-319-22668-2_15(177-194)Online publication date: 10-Mar-2022
https://dl.acm.org/doi/10.1007/978-3-319-22668-2_15
Show More Cited By

Index Terms

Microanalysis of active reading behavior to inform design of interactive desktop workspaces
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Informal information gathering techniques for active reading
CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

GatherReader is a prototype e-reader with both pen and multi-touch input that illustrates several interesting design trade-offs to fluidly interleave content consumption behaviors (reading and flipping through pages) with information gathering and ...
Supporting active reading on pen and touch-operated tabletops
AVI '12: Proceedings of the International Working Conference on Advanced Visual Interfaces

With the proliferation and sophistication of digital reading devices, new means to support the task of active reading (AR) have emerged. In this paper, we investigate the use of pen-and-touch-operated tabletops for performing essential processes of AR ...
Designing a Physical Aid to Support Active Reading on Tablets
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Tablet computers and portable eReaders are gradually becoming the preferred platform for the consumption of textual materials. However, although these technologies are powerful, it is widely acknowledged that print documents better support the advanced ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces

November 2012

430 pages

ISBN:9781450312097

DOI:10.1145/2396636

General Chairs:
Orit Shaer
Wellesley College, USA
,
Chia Shen
Harvard University, USA
,
Program Chairs:
Meredith Ringel Morris
Microsoft Research, USA
,
Michael Horn
Northwestern University, USA

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 November 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ITS'12

Sponsor:

SIGCHI

ITS'12: Interactive Tabletops and Surfaces

November 11 - 14, 2012

Massachusetts, Cambridge, USA

Acceptance Rates

ITS '12 Paper Acceptance Rate 24 of 63 submissions, 38%;

Overall Acceptance Rate 119 of 418 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
429
Total Downloads

Downloads (Last 12 months)30
Downloads (Last 6 weeks)3

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Shi LCampbell RChi PCirimele MCleron MClimer KFleming CGanti AGervais PGonnet PKarim TMaksai AMelancon CMickle RMusat CNandy PQu XRobishaw DSingh AVenkatesan M(2024)Inkeraction: An Interaction Modality Powered by Ink Recognition and SynthesisProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642498(1-26)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642498
Shibata HTakano KTano S(2022)Text Touching Effects in Active Reading: The Impact of the Use of a Touch-Based Tablet DeviceHuman-Computer Interaction – INTERACT 201510.1007/978-3-319-22701-6_41(559-576)Online publication date: 10-Mar-2022
https://dl.acm.org/doi/10.1007/978-3-319-22701-6_41
Sutherland CLuxton-Reilly APlimmer B(2022)An Observational Study of How Experienced Programmers Annotate Program CodeHuman-Computer Interaction – INTERACT 201510.1007/978-3-319-22668-2_15(177-194)Online publication date: 10-Mar-2022
https://dl.acm.org/doi/10.1007/978-3-319-22668-2_15
Moreno Rocha MNacenta MYe J(2021)An Exploratory Study on Academic Reading Contexts, Technology, and StrategiesProceedings of the 8th Mexican Conference on Human-Computer Interaction10.1145/3492724.3492727(1-10)Online publication date: 1-Dec-2021
https://dl.acm.org/doi/10.1145/3492724.3492727
Morabito JChan JSas CMaiden N(2021)Managing Context during Scholarly Knowledge Synthesis: Process Patterns and System MechanicsProceedings of the 13th Conference on Creativity and Cognition10.1145/3450741.3465244(1-5)Online publication date: 22-Jun-2021
https://dl.acm.org/doi/10.1145/3450741.3465244
ANDOH YSHIBATA H(2020)Design Suggestions for Reading Support Method Based on Action Analysis読書中の行為にもとづく読みの支援方式の検討Journal of Japan Society for Fuzzy Theory and Intelligent Informatics10.3156/jsoft.32.5_83132:5(831-840)Online publication date: 15-Oct-2020
https://doi.org/10.3156/jsoft.32.5_831
Subramonyam HSeifert CShah PAdar EBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)texSketch: Active Diagramming through Pen-and-Ink AnnotationsProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376155(1-13)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376155
Annett MGrossman TWigdor DFitzmaurice G(2019)Exploring and Understanding the Role of Workshop Environments in Personal Fabrication ProcessesACM Transactions on Computer-Human Interaction10.1145/330142026:2(1-43)Online publication date: 27-Mar-2019
https://dl.acm.org/doi/10.1145/3301420
Li ZAnnett MHinckley KWigdor D(2019)SMACProceedings of the ACM on Human-Computer Interaction10.1145/33009613:EICS(1-47)Online publication date: 13-Jun-2019
https://dl.acm.org/doi/10.1145/3300961
Li ZAnnett MHinckley KSingh KWigdor DBrewster SFitzpatrick GCox AKostakos V(2019)HoloDocProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300917(1-14)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300917
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten