research-article

Issues in evaluating ambient displays in the wild: two case studies

Authors:

William R. Hazlewood,

Erik Stolterman,

Kay ConnellyAuthors Info & Claims

CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 877 - 886

https://doi.org/10.1145/1978942.1979071

Published: 07 May 2011 Publication History

Abstract

In this paper we discus the complex task of evaluating ambient displays, concentrating on issues within in-situ deployments. We start by describing how these technologies have been evaluated in lab settings, where the focus has been primarily on issues of usability, and argue strongly for the necessity of in-situ evaluation. We then present two case studies involving in-situ evaluations, and from these derive issues that hindered the researchers from being able to delve more deeply into the overall impact of their implementations. We conclude with our own suggestions on possible alternatives to explore for evaluating ambient displays, which are based on the issues derived from our case studies.

References

[1]

Ambient Devices, "The Ambient Stock Orb." http://www.ambientdevices.com/cat/orb/orborder.html (accessed September 20, 2010) .

[2]

Arroyo, E., Bonanni, L., and Selker, T. 2005. Waterbot: exploring feedback and persuasive techniques at the sink. In Proceedings of CHI '05. ACM, New York, NY, 631--639.

Digital Library

[3]

Bardzell, J. and Bardzell, S. 2008. Interaction criticism: a proposal and framework for a new discipline of hci. In Proceedings of CHI'08. ACM, New York, NY, 2463- 2472.

Digital Library

[4]

Brewer, J., Williams, A., and Dourish, P. 2005. Nimio: An Ambient Awareness Device, Demonstration at the European Conference on Computer-Supported Cooperative Work (ECSCW). 18-22 September 2005, Paris, France.

[5]

Carter, S., Mankoff, J. 2004. Challenges for UbiComp evaluation, technical report UCB/CSD-04-1331, computer science division. University of California, Berkeley.

[6]

Chang, A., Resner, B., Koerner, B., Wang, X., and Ishii, H. 2001. LumiTouch: an emotional communication device. In Proceedings of CHI '01. ACM, New York, NY, 313--314.

Digital Library

[7]

Costanza, E., Inverso, S. A., Pavlov, E., Allen, R., and Maes, P. 2006. eye-q: eyeglass peripheral display for subtle intimate notifications. In Proceedings of MobileHCI '06, vol. 159. ACM, New York, NY, 211- 218.

Digital Library

[8]

Dahley, A., Wisneski, C., and Ishii, H. 1998. Water lamp and pinwheels: ambient projection of digital information into architectural space. In Proceedings of CHI 98. ACM, New York, NY, 269--270.

Digital Library

[9]

Greyworld, "The Source (2004)." June 20, 2004. http://greyworld.org/archives/31 (accessed September 20, 2010).

[10]

Hallnäs, L. and Redström, J. 2001. Slow Technology - Designing for Reflection. Personal Ubiquitous Comput. 5, 3, 201--212.

Digital Library

[11]

Hazlewood, W. R., Dalton, N., Marshall, P., Rogers, Y., and Hertrich, S. 2010. Bricolage and consultation: addressing new design challenges when building large-scale installations. In Proceedings of DIS '10. ACM, New York, NY, 380--389.

Digital Library

[12]

Heiner, J. M., Hudson, S. E., and Tanaka, K. 1999. The information percolator: ambient information display in a decorative object. In Proceedings of UIST '99. ACM, New York, NY, 141--148.

Digital Library

[13]

Holmquist, L. E. 2004. Evaluating the comprehension of ambient displays. In CHI '04 extended abstracts on Human factors in computing systems (CHI '04). ACM, New York, NY, USA, 1545--1545.

Digital Library

[14]

Ishii, H., Wisneski, C., Brave, S., Dahley, A., Gorbet, M., Ullmer, B., and Yarin, P. 1998. ambientROOM: integrating ambient media with architectural space. In Proceedings of CHI 98. ACM, New York, NY, 173--174.

Digital Library

[15]

Ishii, H., Ren, S., and Frei. P. 2001. "Pinwheels: visualizing information flow in an architectural space," In Proceedings of CHI '01 extended abstracts on Human factors in computing systems, pp. 111--112, 2001.

Digital Library

[16]

Mankoff, J., Dey, A. K., Hsieh, G., Kientz, J., Lederer, S., and Ames, M. 2003. Heuristic evaluation of ambient displays. In Proceedings of CHI '03. ACM, New York, NY, 169--176.

Digital Library

[17]

Mensvoort, K. "DATAFOUNTAIN - Money currency rates displayed with an internet enabled water fountain." http://www.koert.com/work/datafountain/ (accessed Sep 20, 2010).

[18]

Mynatt, E. D., Back, M., Want, R., Baer, M., and Ellis, J. B. 1998. Designing audio aura. InProceedings CHI'98. ACM Press/Addison-Wesley Publishing Co., New York, NY, 566--573.

Digital Library

[19]

Olivier, P., Cao, H., Gilroy, S. W. and Jackson, D. G. 2006. Crossmodal Ambient Displays. In Proceedings of British HCI 2006, Springer, London, 3--16.

[20]

Redström, J., Skog, T., and Hallnäs, L. 2000. Informative art: using amplified artworks as information displays. In Proceedings of DARE'00. ACM, New York, NY, 103--114.

Digital Library

[21]

Rogers, Y., Hazlewood, W. R., Dalton, N., Marshall, P., Pantidi, N. and Hertrich, S. 2010. Ambient Influence: Can Twinkly Lights Lure and Abstract Representations Trigger Behavioral Change? In Proceedings of Ubicomp '10, 2010 (in press).

Digital Library

[22]

Shen, X., Eades, P., Seok-Hee, H., Vand Moere, A. 2007. Intrusive and Non-intrusive Evaluation of Ambient Displays. In Proc. of 1st Workshop on Ambient Information Systems. Colocated with Pervasive 2007, Toronto, Canada. vol. 254, May 2007.

[23]

Smith, G. What is interaction design? In Moggridge, B. Designing Interactions. The MIT Press, 2007.

[24]

Weiser M, Seely Brown J. Designing calm technology. PowerGrid Journal 1.1.1996. Available at: http://www.powergrid.com/1.01/calmtech.html.

[25]

White, T. and Small, D. 1998. An interactive poetic garden. In Proceedings of CHI'98. ACM, New York, NY, 335--336.

Digital Library

[26]

Wurman, R. S. 2001. Information Anxiety. Doubleday, New York.

Cited By

Jones LGrip GKourtoukov BGuljajeva VCanet Sola MNabil SCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Knitting Interactive Spaces: Fabricating Data Physicalizations of Local Community Visitors with Circular Knitting MachinesProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633359(1-14)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633359
Song SBaba JOkafuji YNakanishi JYoshikawa YIshiguro H(2024)New Comer in the Bakery Store: A Long-Term Exploratory Study Toward Design of Useful Service Robot ApplicationsInternational Journal of Social Robotics10.1007/s12369-024-01119-z16:9-10(1901-1918)Online publication date: 8-Oct-2024
https://doi.org/10.1007/s12369-024-01119-z
Shakeri HGeiskkovitch DGarg RNeustaedter C(2023)Sensing Their Presence: How Emerging Adults And Their Parents Connect After Moving ApartProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581102(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581102
Show More Cited By

Index Terms

Issues in evaluating ambient displays in the wild: two case studies
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Index terms have been assigned to the content through auto-classification.

Recommendations

Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users
UIST '04: Proceedings of the 17th annual ACM symposium on User interface software and technology

We develop design principles and an interaction framework for sharable, interactive public ambient displays that support the transition from implicit to explicit interaction with both public and personal information. A prototype system implementation ...
Heuristic evaluation of ambient displays
CHI '03: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We present a technique for evaluating the usability and effectiveness of ambient displays. Ambient displays are abstract and aesthetic peripheral displays portraying non-critical information on the periphery of a user's attention. Although many ...
Evaluating ambient displays in the wild: highlighting social aspects of use in public settings
DIS '12: Proceedings of the Designing Interactive Systems Conference

A prominent issue for evaluating ambient displays has been the conflict between the relative intrusiveness of evaluation methods and the intention to keep the display at the periphery of the user's attention. There is a general lack of research ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

May 2011

3530 pages

ISBN:9781450302289

DOI:10.1145/1978942

General Chair:
Desney Tan
Microsoft Research
,
Program Chairs:
Geraldine Fitzpatrick
Vienna University of Technology
,
Carl Gutwin
University of Saskatchewan
,
Bo Begole
PARC
,
Wendy A. Kellogg
IBM Research

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '11

Sponsor:

SIGCHI

CHI '11: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2011

BC, Vancouver, Canada

Acceptance Rates

CHI '11 Paper Acceptance Rate 410 of 1,532 submissions, 27%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

53
Total Citations
View Citations
1,008
Total Downloads

Downloads (Last 12 months)35
Downloads (Last 6 weeks)1

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Jones LGrip GKourtoukov BGuljajeva VCanet Sola MNabil SCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Knitting Interactive Spaces: Fabricating Data Physicalizations of Local Community Visitors with Circular Knitting MachinesProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633359(1-14)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633359
Song SBaba JOkafuji YNakanishi JYoshikawa YIshiguro H(2024)New Comer in the Bakery Store: A Long-Term Exploratory Study Toward Design of Useful Service Robot ApplicationsInternational Journal of Social Robotics10.1007/s12369-024-01119-z16:9-10(1901-1918)Online publication date: 8-Oct-2024
https://doi.org/10.1007/s12369-024-01119-z
Shakeri HGeiskkovitch DGarg RNeustaedter C(2023)Sensing Their Presence: How Emerging Adults And Their Parents Connect After Moving ApartProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581102(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581102
Johansen SNielsen PStec KKjeldskov J(2023)Using Colour and Brightness for Sound Zone FeedbackHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42280-5_15(247-272)Online publication date: 28-Aug-2023
https://dl.acm.org/doi/10.1007/978-3-031-42280-5_15
Shelton BNesbitt KThorpe AEidels A(2022)Assessing the cognitive load associated with ambient displaysPersonal and Ubiquitous Computing10.1007/s00779-021-01662-w26:1(185-204)Online publication date: 7-Jan-2022
https://dl.acm.org/doi/10.1007/s00779-021-01662-w
Sheikh Khan DKolarik JWeitzmann P(2021)Occupants’ Interaction With an Occupant Voting System for Thermal and Indoor Air Quality Feedback – Case Studies in Office SpacesFrontiers in Built Environment10.3389/fbuil.2021.6436307Online publication date: 18-Mar-2021
https://doi.org/10.3389/fbuil.2021.643630
Kang BKang SHwang IKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)MomentMeld: AI-augmented Mobile Photographic Memento towards Mutually Stimulatory Inter-generational InteractionProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445688(1-16)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445688
Rutten IBogaert LGeerts D(2021)From Initial Encounter With Mid-Air Haptic Feedback to Repeated Use: The Role of the Novelty Effect in User ExperienceIEEE Transactions on Haptics10.1109/TOH.2020.304365814:3(591-602)Online publication date: 1-Jul-2021
https://doi.org/10.1109/TOH.2020.3043658
Schwarzer JDraheim Svon Luck KWang QGrecos C(2021)Spontaneous Utilization: A Classic Grounded Theory of Utilizing Ambient Displays in Professional, Large-Scale Agile Software Development EnvironmentsInternational Journal of Human–Computer Interaction10.1080/10447318.2021.200205138:15(1440-1463)Online publication date: 20-Dec-2021
https://doi.org/10.1080/10447318.2021.2002051
Groß-Vogt KWeger MFrank MHöldrich R(2020)Peripheral Sonification by Means of Virtual Room AcousticsComputer Music Journal10.1162/comj_a_0055344:1(71-88)Online publication date: 5-Apr-2020
https://doi.org/10.1162/comj_a_00553
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents