research-article

Mobile Living Labs 09: Methods and Tools for Evaluation in the Wild: http://mll09.novay.nl

Authors:

Henri ter Hofte,

Kasper Løvborg Jensen,

Petteri Nurmi,

Jon FroehlichAuthors Info & Claims

MobileHCI '09: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services

Article No.: 107, Pages 1 - 2

https://doi.org/10.1145/1613858.1613981

Published: 15 September 2009 Publication History

Get Access

Abstract

In a Mobile Living Lab, mobile devices are used to evaluate concepts and prototypes in real-life settings. In other words, the lab is brought to the people. This workshop provides a forum for researchers and practitioners to share experiences and issues with methods and tools for Mobile Living Labs. In particular, we seek to bring together people who have applied methods for Mobile Living Labs and people who build tools for those methods.

The aim of the workshop is twofold. First, to make an up-to-date overview of current methods and tools for conducting user studies in Mobile Living Labs -- highlighting their individual strengths and weaknesses. Second, to uncover challenges that are not adequately addressed by current methods and tools and to come up with ideas and requirements that could fill this gap thus serving as beacons for further research and development in this area.

References

[1]

Connelly, K.; Siek, K. A.; Mulder, I.; Neely, S.; Stevenson, G.; Kray, C. (2008). Evaluating Pervasive and Ubiquitous Systems, IEEE Pervasive Computing, 7(3), 85--88.

Digital Library

Google Scholar

[2]

Froehlich, J., Chen, M., Consolvo, S., Harrison, B.,&Landay, J. (2007). MyExperience: A System for In Situ Tracing and Capturing of User Feedback on Mobile Phones. In Proceedings of MobiSys 2007, San Juan, Puerto Rico.

Digital Library

Google Scholar

[3]

Hofte, G. H. ter (2007). What's that Hot Thing in my Pocket? SocioXensor, a smartphone data collector. In: Proceedings of e-Social Science 2007, the Third International Conference on e-Social Science, October 7--9, 2007, Ann Arbor, MI, USA.

Google Scholar

[4]

Jensen, K. L. (2009). RECON: Capturing Mobile and Ubiquitous Interaction in Real Contexts. In: Proceedings of MobileHCI 2009, Bonn, Germany.

Digital Library

Google Scholar

[5]

Kukkonen, J., Lagerspetz, E., Nurmi, P., Andersson, M. (2009). BeTelGeuse: A Platform for Gathering and Processing Situational Data. IEEE Pervasive Computing, 8(2), 49--56, 2009.

Digital Library

Google Scholar

[6]

Raento, M., Oulasvirta, A., Petit, R., Toivonen, H. (2005). ContextPhone: A Prototyping Platform for Context-Aware Mobile Applications. IEEE Pervasive Computing, 4, 51--59.

Digital Library

Google Scholar

[7]

Schumacher, J,&Niitamo, V. P. (Eds). (2008). European Living Labs: A new approach for human-centric regional innovation. Wissenschaftliger Verlag, Berlin, Germany.

Google Scholar

Cited By

View all

Bronson KDevkota RNguyen V(2021)Moving toward Generalizability? A Scoping Review on Measuring the Impact of Living LabsSustainability10.3390/su1302050213:2(502)Online publication date: 7-Jan-2021
https://doi.org/10.3390/su13020502
Sheikh SPasha M(2020)Energy-efficient Real-time Scheduling on MulticoresACM Transactions on Embedded Computing Systems10.1145/339941319:4(1-25)Online publication date: 4-Jul-2020
https://dl.acm.org/doi/10.1145/3399413
Xiao ZZhou MLiao QMark GChi CChen WYang H(2020)Tell Me About YourselfACM Transactions on Computer-Human Interaction10.1145/338180427:3(1-37)Online publication date: 13-Jun-2020
https://dl.acm.org/doi/10.1145/3381804
Show More Cited By

Index Terms

Mobile Living Labs 09: Methods and Tools for Evaluation in the Wild: http://mll09.novay.nl
1. Human-centered computing
  1. Human computer interaction (HCI)
  2. Interaction design
    1. Interaction design process and methods
      1. Interface design prototyping
    2. Interaction design theory, concepts and paradigms

Recommendations

Report on the CIKM workshop on living labs for information retrieval evaluation

Evaluation is a central aspect of information retrieval (IR) research. In the past few years, a new evaluation methodology known as living labs has been proposed as a way for researchers to be able to perform in-situ evaluation. The first CIKM workshop ...
UMAP 2018 HAAPIE (Human Aspects in Adaptive and Personalized Interactive Environments) Workshop Chairs' Welcome & Organization
UMAP '18: Adjunct Publication of the 26th Conference on User Modeling, Adaptation and Personalization

It is our great pleasure to welcome you to the 3rd International Workshop on Human Aspects in Adaptive and Personalized Interactive Environments (HAAPIE 2018). HAAPIE 2018 (http://haapie.cs.ucy.ac.cy) is a full-day workshop held on 08 July 2018 in ...
LivingLab '13: Proceedings of the 2013 workshop on Living labs for information retrieval evaluation

Comments

Information & Contributors

Information

Published In

MobileHCI '09: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services

September 2009

473 pages

ISBN:9781605582818

DOI:10.1145/1613858

Conference Chair:
Reinhard Oppermann
Fraunhofer FIT
,
Program Chairs:
Markus Eisenhauer
Fraunhofer FIT
,
Matthias Jarke
RWTH Aachen + Fraunhofer FIT
,
Volker Wulf
University of Siegen + Fraunhofer FIT

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 September 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MobileHCI '09

MobileHCI '09: 11th International Conference on Human Computer Interaction with Mobile Devices and Services

September 15 - 18, 2009

Bonn, Germany

Acceptance Rates

MobileHCI '09 Paper Acceptance Rate 23 of 95 submissions, 24%;

Overall Acceptance Rate 202 of 906 submissions, 22%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

23
Total Citations
View Citations
304
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 06 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Bronson KDevkota RNguyen V(2021)Moving toward Generalizability? A Scoping Review on Measuring the Impact of Living LabsSustainability10.3390/su1302050213:2(502)Online publication date: 7-Jan-2021
https://doi.org/10.3390/su13020502
Sheikh SPasha M(2020)Energy-efficient Real-time Scheduling on MulticoresACM Transactions on Embedded Computing Systems10.1145/339941319:4(1-25)Online publication date: 4-Jul-2020
https://dl.acm.org/doi/10.1145/3399413
Xiao ZZhou MLiao QMark GChi CChen WYang H(2020)Tell Me About YourselfACM Transactions on Computer-Human Interaction10.1145/338180427:3(1-37)Online publication date: 13-Jun-2020
https://dl.acm.org/doi/10.1145/3381804
Ghafurian MReitter DRitter F(2020)Countdown Timer SpeedACM Transactions on Computer-Human Interaction10.1145/338096127:2(1-25)Online publication date: 11-Mar-2020
https://dl.acm.org/doi/10.1145/3380961
Alavi HLalanne DRogers Y(2020)The Five Strands of Living LabACM Transactions on Computer-Human Interaction10.1145/338095827:2(1-26)Online publication date: 11-Mar-2020
https://dl.acm.org/doi/10.1145/3380958
Tausczik YHuang X(2019)The Impact of Group Size on the Discovery of Hidden Profiles in Online Discussion GroupsACM Transactions on Social Computing10.1145/33597582:3(1-25)Online publication date: 14-Nov-2019
https://dl.acm.org/doi/10.1145/3359758
Cagliero LCerquitelli TChiusano SGarza PRicupero GBaralis E(2018)Characterizing Situations of Dock Overload in Bicycle Sharing StationsApplied Sciences10.3390/app81225218:12(2521)Online publication date: 6-Dec-2018
https://doi.org/10.3390/app8122521
Bala PDionísio MTrindade ROlim SNisi VNunes NHenze NWoźniak PVäänänen KWilliamson JSchneegass S(2017)Evaluating the influence of location and medium applied to mobile VR storytellingProceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia10.1145/3152832.3156617(371-378)Online publication date: 26-Nov-2017
https://dl.acm.org/doi/10.1145/3152832.3156617
Dionisio MBarreto MNisi VNunes NHanna JHerlo BSchubert J(2015)Evaluation of Yasmine’s Adventures: Exploring the Socio-Cultural Potential of Location Aware Multimedia StoriesInteractive Storytelling10.1007/978-3-319-27036-4_24(251-258)Online publication date: 11-Dec-2015
https://doi.org/10.1007/978-3-319-27036-4_24
Church KCherubini MNeumann JOliver NCramer HRost MBentley FShamma D(2011)Understanding mobile information needs on a large-scaleProceedings of the 2nd international workshop on Research in the large10.1145/2025528.2025530(1-4)Online publication date: 18-Sep-2011
https://dl.acm.org/doi/10.1145/2025528.2025530
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Report on the CIKM workshop on living labs for information retrieval evaluation

UMAP 2018 HAAPIE (Human Aspects in Adaptive and Personalized Interactive Environments) Workshop Chairs' Welcome & Organization

LivingLab '13: Proceedings of the 2013 workshop on Living labs for information retrieval evaluation

Comments

Information

Published In

In-Cooperation

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations