Article

ButterflyNet: a mobile capture and access system for field biology research

Authors:

François Guimbretière,

Boyko Kakaradov,

Jeannie Stamberger,

Andreas PaepckeAuthors Info & Claims

CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 571 - 580

https://doi.org/10.1145/1124772.1124859

Published: 22 April 2006 Publication History

Abstract

Through a study of field biology practices, we observed that biology fieldwork generates a wealth of heterogeneous information, requiring substantial labor to coordinate and distill. To manage this data, biologists leverage a diverse set of tools, organizing their effort in paper notebooks. These observations motivated ButterflyNet, a mobile capture and access system that integrates paper notes with digital photographs captured during field research. Through ButterflyNet, the activity of leafing through a notebook expands to browsing all associated digital photos. ButterflyNet also facilitates the transfer of captured content to spreadsheets, enabling biologists to share their work. A first-use study with 14 biologists found this system to offer rich data capture and transformation, in a manner felicitous with current practice.

References

[1]

Abowd, G. D. and E. D. Mynatt. Charting Past, Present, and Future Research in Ubiquitous Computing. Transactions on Computer-Human Interaction 7(1): ACM Press. pp. 29--58, 2000.

Digital Library

[2]

Anoto AB, Anoto Technology. http://www.anoto.com

[3]

Arnstein, L., C.-Y. Hung, R. Franza, Q. H. Zhou, G. Borriello, S. Consolvo, and J. Su. Labscape: A Smart Environment for the Cell Biology Laboratory. IEEE Pervasive Computing 1(3): IEEE Educational Activities Department. pp. 13--21, 2002.

Digital Library

[4]

Avrahami, D., S. E. Hudson, T. P. Moran, and B. D. Williams. Guided gesture support in the paper PDA. UIST: ACM Symposium on User Interface Software and Technology. pp. 167--68, 2001.

Digital Library

[5]

Back, M., J. Cohen, R. Gold, S. Harrison, and S. Minneman. Listen Reader: an Electronically Augmented Paper-based Book. CHI: ACM Conference on Human Factors in Computing Systems. pp. 23--29, 2001.

Digital Library

[6]

Bederson, B. B., J. Grosjean, and J. Meyer. Toolkit Design for Interactive Structured Graphics. IEEE Transactions on Software Engineering 30(8). pp. 1--12, 2004.

Digital Library

[7]

Butler, D. A new leaf. Nature 436: Nature Publishing Group. pp. 20--21, 2005.

[8]

Cohen, P. R. and D. R. McGee. Tangible Multimodal Interfaces for Safety Critical Applications, Communications of the ACM, vol. 47(1): pp. 41--46, 2004.

Digital Library

[9]

Culler, D. E. and H. Mulder. Smart Sensors to Network the World. Scientific American 290(6). pp. 84--91, 2004.

[10]

CyberTracker, CyberTracker. http://www.cybertracker.co.za

[11]

Dymetman, M. and M. Copperman. Intelligent Paper. EP'98: International Conference on Electronic Publishing: Springer-Verlag GmbH. pp. 392--406, 1998.

Digital Library

[12]

Embedded Data Systems, LLC., iButton. http://embeddeddatasystems.com

[13]

Guimbretière, F. Paper augmented digital documents. UIST: ACM Symposium on User Interface Software and Technology. pp. 51--60, 2003.

Digital Library

[14]

Heiner, J. M., S. E. Hudson, and K. Tanaka. Linking and Messaging from Real Paper in the Paper PDA. UIST: ACM Symposium on User Interface Software and Technology. pp. 179--86, 1999.

Digital Library

[15]

HSQLDB, HSQL Database Engine, 2005. http://www.hsqldb.org

[16]

Inlite Research, Inc., ClearImage SDK, 2005. http://www.inliteresearch.com

[17]

Johnson, W., H. Jellinek, L. K. Jr., R. Rao, and S. Card. Bridging the Paper and Electronic Worlds: The Paper User Interface. CHI: ACM Conference on Human Factors in Computing Systems. pp. 507--12, 1993.

Digital Library

[18]

Kam, M., J. Wang, A. Iles, E. Tse, J. Chiu, D. Glaser, O. Tarshish, and J. Canny. Livenotes: A System for Cooperative and Augmented Note-Taking in Lectures. CHI: ACM Conference on Human Factors in Computing Systems. pp. 531--40, 2005.

Digital Library

[19]

Klemmer, S. R., J. Graham, G. J. Wolff, and J. A. Landay. Books with Voices: Paper Transcripts as a Tangible Interface to Oral Histories. CHI: ACM Conference on Human Factors in Computing Systems. pp. 89--96, 2003.

Digital Library

[20]

Klemmer, S. R., J. Li, J. Lin, and J. A. Landay. Papier-Mâché: Toolkit Support for Tangible Input. CHI: ACM Conference on Human Factors in Computing Systems. pp. 399--406, 2004.

Digital Library

[21]

Lamming, M. and M. Flynn. Forget-me-not: Intimate Computing in Support of Human Memory. FRIEND21: International Symposium on Next Generation Human Interface, 1994.

[22]

Liao, C., F. Guimbretière, and K. Hinckley. PapierCraft: A Command System for Interactive Paper. UIST: ACM Symposium on User Interface Software and Technology, 2005.

Digital Library

[23]

Luff, P., C. Heath, M. Norrie, B. Signer, and P. Herdman. Only Touching the Surface: Creating Affinities Between Digital Content and Paper. CSCW: ACM Conference on Computer-Supported Cooperative Work, 2004.

Digital Library

[24]

Mackay, W. E., A.-L. Fayard, L. Frobert, and L. Médini. Reinventing the Familiar: Exploring an Augmented Reality Design Space for Air Traffic Control. CHI: ACM Conference on Human Factors in Computing Systems. pp. 558--65, 1998.

Digital Library

[25]

Mackay, W. E., G. Pothier, C. Letondal, K. Bøegh, and H. E. Sørensen. The Missing Link: Augmenting Biology Laboratory Notebooks. UIST: ACM Symposium on User Interface Software and Technology. pp. 41--50, 2002.

Digital Library

[26]

Moran, T. P., L. Palen, S. Harrison, P. Chiu, D. Kimber, S. Minneman, et al. "I'll get that off the audio": a Case Study of Salvaging Multimedia Records. CHI: ACM Conference on Human Factors in Computing Systems. pp. 202--09, 1997.

Digital Library

[27]

MVZ, The Grinnell Method. University of California: Berkeley. http://mvz.berkeley.edu/Grinnell_Method.html

[28]

Myers, B., S. E. Hudson, and R. Pausch. Past, Present, and Future of User Interface Software Tools. ACM Transactions on Computer-Human Interaction 7(1). pp. 3--28, 2000.

Digital Library

[29]

Nelson, L., S. Ichimura, E. R. Pedersen, and L. Adams. Palette: A Paper Interface for Giving Presentations. CHI: ACM Conference on Human Factors in Computing Systems. pp. 354--61, 1999.

Digital Library

[30]

Nokia, Nokia SU-1B Digital Pen. http://www.nokia.com

[31]

OQO, model 01, 2005. http://www.oqo.com

[32]

Parikh, T. S. Using Mobile Phones for Secure, Distributed Document Processing in the Developing World, IEEE Pervasive Computing Magazine, vol. 4(2): pp. 74--81, April, 2005.

Digital Library

[33]

Sellen, A. J. and R. H. R. Harper, The Myth of the Paperless Office. 1st ed: MIT Press. 242 pp. 2003.

Digital Library

[34]

Stifelman, L., B. Arons, and C. Schmandt. The Audio Notebook: Paper and Pen Interaction with Structured Speech. CHI: ACM Conference on Human Factors in Computing Systems. pp. 182--89, 2001.

Digital Library

[35]

Truong, K. N. and G. D. Abowd. INCA: A Software Infrastructure to Facilitate the Construction and Evolution of Ubiquitous Capture & Access Applications. Pervasive: The International Conference on Pervasive Computing: Springer-Verlag. pp. 140--57, 2004.

[36]

Truong, K. N., G. D. Abowd, and J. A. Brotherton. Personalizing the Capture of Public Experiences. UIST: ACM Symposium on User Interface Software and Technology. pp. 121--30, 1999.

Digital Library

[37]

Whittaker, S., P. Hyland, and M. Wiley. FILOCHAT: Handwritten Notes Provide Access to Recorded Conversations. CHI: ACM Conference on Human Factors in Computing Systems. pp. 271--77, 1994.

Digital Library

Cited By

Palacios Abad BKoohang MVigil-Hayes MZegura E(2023)Alone and Together: Resilience in a Fluid Socio-Technical-Natural SystemProceedings of the ACM on Human-Computer Interaction10.1145/35794577:CSCW1(1-26)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579457
Han FCheng YStrachan MMa X(2021)Hybrid Paper-Digital Interfaces: A Systematic Literature ReviewProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462059(1087-1100)Online publication date: 28-Jun-2021
https://dl.acm.org/doi/10.1145/3461778.3462059
Swearngin AIqbal SPoznanski VEncarnación MBennett PTeevan JKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Scraps: Enabling Mobile Capture, Contextualization, and Use of Document ResourcesProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445185(1-14)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445185
Show More Cited By

Index Terms

ButterflyNet: a mobile capture and access system for field biology research
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2006

1353 pages

ISBN:1595933727

DOI:10.1145/1124772

Editors:
Rebecca Grinter
Georgia Institute of Technology, USA
,
Thomas Rodden
University of Nottingham, UK
,
Paul Aoki
Intel, USA
,
Ed Cutrell
Microsoft, USA
,
Robin Jeffries
Google, USA
,
Gary Olson
University of Michigan, USA

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 April 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CHI06

Sponsor:

CHI06: CHI 2006 Conference on Human Factors in Computing Systems

April 22 - 27, 2006

Québec, Montréal, Canada

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

156
Total Citations
View Citations
1,823
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)1

Reflects downloads up to 12 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Palacios Abad BKoohang MVigil-Hayes MZegura E(2023)Alone and Together: Resilience in a Fluid Socio-Technical-Natural SystemProceedings of the ACM on Human-Computer Interaction10.1145/35794577:CSCW1(1-26)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579457
Han FCheng YStrachan MMa X(2021)Hybrid Paper-Digital Interfaces: A Systematic Literature ReviewProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462059(1087-1100)Online publication date: 28-Jun-2021
https://dl.acm.org/doi/10.1145/3461778.3462059
Swearngin AIqbal SPoznanski VEncarnación MBennett PTeevan JKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Scraps: Enabling Mobile Capture, Contextualization, and Use of Document ResourcesProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445185(1-14)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445185
Srinivasa RDodson SSeo KYoon DFels S(2021)NoteLink: A Point-and-Shoot Linking Interface between Students' Handwritten Notebooks and Instructional Videos2021 ACM/IEEE Joint Conference on Digital Libraries (JCDL)10.1109/JCDL52503.2021.00026(140-149)Online publication date: Sep-2021
https://doi.org/10.1109/JCDL52503.2021.00026
Bairaktaris GFrohlich DSporea R(2021)Flexible optical bookmark for open-page recognition in augmented paper2021 IEEE International Conference on Flexible and Printable Sensors and Systems (FLEPS)10.1109/FLEPS51544.2021.9469853(1-4)Online publication date: 20-Jun-2021
https://doi.org/10.1109/FLEPS51544.2021.9469853
Vaithilingam PMarkel JGuo PIqbal SMacLean KChevalier FMueller S(2020)PapercodeAdjunct Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology10.1145/3379350.3416191(77-79)Online publication date: 20-Oct-2020
https://dl.acm.org/doi/10.1145/3379350.3416191
Masson DMalacria SLank ECasiez GBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Chameleon: Bringing Interactivity to Static Digital DocumentsProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376559(1-13)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376559
Nouwens MBorowski MFog BKlokmose CBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Between Scripts and Applications: Computational Media for the Frontier of NanoscienceProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376287(1-13)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376287
Konkel MUllmer BShaer OMazalek ABranton C(2020)Toward tangibles and display-rich interfaces for co-located and distributed genomics collaborationsPersonal and Ubiquitous Computing10.1007/s00779-020-01376-526:3(767-779)Online publication date: 5-Mar-2020
https://dl.acm.org/doi/10.1007/s00779-020-01376-5
Hornbæk KMottelson AKnibbe JVogel D(2019)What Do We Mean by “Interaction”? An Analysis of 35 Years of CHIACM Transactions on Computer-Human Interaction10.1145/332528526:4(1-30)Online publication date: 1-Jul-2019
https://dl.acm.org/doi/10.1145/3325285
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents