article

Towards interactive smart spaces

Authors:

Ekaterina Gilman,

Jukka RiekkiAuthors Info & Claims

Journal of Ambient Intelligence and Smart Environments, Volume 5, Issue 1

Pages 5 - 22

Published: 01 January 2013 Publication History

Abstract

Recently, we have been witnessing how various social applications and networking services are being integrated more deeply into our daily lives. Until now, social interaction has been attributed exclusively to humans, while resources and the smart space have supported interaction as passive mediators only. However, the involvement of smart spaces as an active actor in the interaction process facilitates more flexible and user-centered applications for users. This article explores how knowledge-based technologies enable smart spaces to actively take part in the interaction. We argue that smart spaces should be able not only to adapt their behaviour according to the actions of humans and other participants, but also initiate interaction when it is necessary. In order to support this statement, we categorise the types of interaction from the participants' perspective, and review and evaluate the technologies enabling interaction in smart spaces. Furthermore, we present our constructive research on interaction in smart spaces: proof-of-concept prototype applications realizing different architectures and supporting various types of interaction in smart spaces.

References

[1]

A. Aamodt and E. Plaza, Case-based reasoning: Foundational issues, methodological variations, and system approaches, AI Communications 7(1) (1994), 39-59.

Digital Library

[2]

Z. Antoniou and S. Varadan, Intuitive mobile user interaction in smart spaces via NFC-enhanced devices, in: Proc. of 3rd Int. Conf. on Wireless and Mobile Communications, March 2007, pp. 86.

Digital Library

[3]

P. Barron and V. Cahill, Using stigmergy to co-ordinate pervasive computing environments, in: Proc. of 6th IEEE Workshop on Mobile Computing Systems and Applications, Dec. 2004, pp. 62-71.

Digital Library

[4]

A. Beach, M. Gartrell, S. Akkala, J. Elston, J. Kelley, K. Nishimoto, B. Ray, S. Razgulin, K. Sundaresan, B. Surendar, M. Terada, and R. Han, WhozThat? Evolving an ecosystem for context-aware mobile social networks, IEEE Network 22(4), 50-55.

Digital Library

[5]

M. Benerecetti, P. Bouquet, and M. Bonifacio, Distributed context-aware systems, Human-Computer Interaction, 16(2-4) (2001), 213-228.

Digital Library

[6]

A. Bikakis and G. Antoniou, Distributed defeasible contextual reasoning in ambient computing, in: Proc. of the European Conference on Ambient Intelligence, E. Aarts et al., eds, LNCS, Vol. 5355, Springer-Verlag, Berlin, Heidelberg, 2008, pp. 308-325.

Digital Library

[7]

M. Blumendorf, D. Roscher, and S. Albayrak, Dynamic user interface distribution for flexible multimodal interaction, in: Proc. of the Int. Conf. on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ACM, NY, USA, 2010, Article 20, 8 pp.

Digital Library

[8]

G. Broll, E. Rukzio, M. Paolucci, M. Wagner, A. Schmidt, and H. Hussmann, PERCI: Pervasive service interaction with the internet of things, in: IEEE Internet Computing, Nov./Dec. 2009, pp. 74-81.

[9]

C.-W. Chen, R.C. Ugarte, C. Wu, and H. Aghajan, Discovering social interactions in real work environments, in: Proc. of the IEEE Int. Conf. on Automatic Face & Gesture Recognition and Workshops, March 2011, pp. 933-938.

[10]

S. Cohen, Social relationships and health, American Psychologist 59(8), (2004), 676-684.

[11]

D. Cook, A. Crandall, G. Singla, and B. Thomas, Detection of social interaction in smart spaces, Journal of Cybernetics and Systems, special issue on social awareness in smart spaces 41(2) (2010), 90-104.

[12]

D.D. Corkill, Collaborating software: Blackboard and multiagent systems & the future, in: Proc. of the International Lisp Conference, 2003, Invited paper.

[13]

O. Davidyuk, E. Gilman, I. Sánchez, J. Mäkipelto, M. Pyykkönen, and J. Riekki, iCompose: Context-aware physical user interface for application composition, Central European Journal of Computer Science 1(4) (2012), 442-465.

[14]

A.K. Dey, Providing architectural support for building context-aware applications, PhD Dissertation, Georgia Institute of Technology, 2000.

[15]

A.K. Dey, Understanding and using context, Personal and Ubiquitous Computing 5(1) (2001), 4-7.

Digital Library

[16]

N. Eagle and A. Pentland, Social serendipity: Mobilizing social software, Pervasive Computing, IEEE 4(2) (2005), 28-34.

Digital Library

[17]

N. Eagle, A. Pentland, and D. Lazer, Inferring social network structure using mobile phone data, Proc. of the National Academy of Sciences 106(36) (2009), 15274-15278.

[18]

E.A. Emerson, Temporal and modal logic, in: Handbook of Theoretical Computer Science, J. van Leeuwen (ed.), Elsevier, 1990, pp. 996-1072.

Digital Library

[19]

A. Hang, G. Broll, and A. Wiethoff, Visual design of physical user interfaces for NFC-based mobile interaction, in: Proc. of the 8th ACM Conf. on Designing Interactive Systems, ACM, NY, USA, 2010, pp. 292-301.

Digital Library

[20]

S. Helal, W. Mann, H. El-Zabadani, J. King, Y. Kad-doura, and E. Jansen, The Gator Tech Smart House: A programmable pervasive space, Computer 38(3) (2005), 50-60.

Digital Library

[21]

A.A. Hopgood, The state of artificial intelligence, in: Advances in Computers, Vol. 65, Elsevier, 2005, pp. 1-75.

[22]

M. Jurmu, H. Kukka, S. Hosio, J. Riekki, and S. Tarkoma, Leasing service for networks of interactive public displays in urban spaces, in: Proc. of the 6th Int. Conf. on Advances in Grid and Pervasive Computing, May 11-13, LNCS, Vol. 6646, Springer, Berlin/Heidelberg, 2011, pp. 198-208.

[23]

M.A. Kabir, J. Han, and A. Colman, Modeling and coordinating social interactions in pervasive environments, in: Proc. of the 16th IEEE Int. Conf. on Engineering of Complex Computer Systems, April 2011, pp. 243-252.

Digital Library

[24]

S.L. Kiani, B. Moltchanov, M. Knappmeyer, and N. Baker, Large-scale context-aware system in smart spaces: Issues and challenges, in: Internet Communications (BCFIC Riga), 2011 Baltic Congress on Future, Feb. 2011, pp. 173-180.

[25]

M. Kranz, P. Holleis, and A. Schmidt, Embedded interaction - interacting with the internet of things, in: IEEE Computing, Special Track on Internet of Things, April-June 2010.

[26]

J. Lifton, M. Laibowitz, D. Harry, N.-W. Gong, M. Mittal, and J.A. Paradiso, Metaphor and manifestation cross-reality with ubiquitous sensor/actuator networks, Pervasive Computing, IEEE 8(3) (2009), 24-33.

Digital Library

[27]

G. Lugano, Mobile social software: Definition, scope and applications, in: eChallenges conference, Holland, October 2007.

[28]

K. Lukka, The constructive research approach, in: Case Study Research in Logistics, L. Ojala and O.-P. Hilmola, eds, 2003, pp. 83-102.

[29]

M.C. Mozer, Lessons from an adaptive house, in: Smart environments: Technologies, protocols, and applications, Hoboken, NJ, D. Cook and R. Das, eds, J. Wiley & Sons, 2005, pp. 273-294.

[30]

N.J. Nilsson, Artificial Intelligence: A New Synthesis, Morgan Kaufmann Publishers, Inc., San Francisco, CA, 1998.

[31]

N.M. Oliver, B. Rosario, and A.P. Pentland, A Bayesian computer vision system for modeling human interactions, IEEE Transactions on Pattern Analysis and Machine Intelligence 22(8) (2000), 831-843.

Digital Library

[32]

M. Perttunen, J. Riekki, and O. Lassila, Context representation and reasoning in pervasive computing: A review, International Journal of Multimedia and Ubiquitous Engineering 4(4) (2009), 1-28.

[33]

M. Philipose, K. Fishkin, M. Perkowitz, D. Patterson, D. Fox, H. Kautz, and D. Hahnel, Inferring activities from interactions with objects, IEEE Pervasive Computing 3(4) (2004), 50-57.

Digital Library

[34]

S. Pirttikangas, I. Sánchez, M. Kauppila, and J. Riekki, Comparison of touch, mobile phone, and gesture based controlling of browser applications on a large screen, in: Adjunct Proceedings Pervasive Sydney, Australia, 2008, pp. 5-8.

[35]

N.M.V. Prasad, V. Lesser, and S. Lander, Retrieval and reasoning in distributed case bases, Journal of Visual Communication and Image Representation, Special Issue on Digital Libraries, 7(1) (1996), 74-87.

[36]

A.S. Rao and M. Georgeff, BDI agents: From theory to practice, in: Proc. of the 1st Int. Conf. on Multi-Agent Systems, 1995, pp. 312-319.

[37]

M. Raento, A. Oulasvirta, R. Petit, and H. Toivonen, Context-Phone - A prototyping platform for context-aware mobile applications, IEEE Pervasive Computing 4(2) (2005), 51-59.

Digital Library

[38]

A. Ricci, A. Omicini, M. Viroli, L. Gardelli, and E. Oliva, Cognitive stigmergy: A framework based on agents and artifacts, in: Environments for Multi-Agent Systems III, D. Weyns et al., eds, LNCS, Vol. 4389, 2007, pp. 124-140.

[39]

E. Rich and K. Knight, Artificial Intelligence, McGraw-Hill, Inc., 1991.

[40]

J. Riekki, T. Salminen, and I. Alakarppa, Requesting pervasive services by touching rfid tags, IEEE Pervasive Computing 5 (2006), 40-46.

Digital Library

[41]

J. Riekki, I. Sanchez, and M. Pyykkönen, Remote control for pervasive services, International Journal of Autonomous and Adaptive Communications Systems 3(1) (2010), 39-58.

Digital Library

[42]

M. Román, C. Hess, R. Cerqueira, A. Ranganathan, R.H. Campbell, and K. Nahrstedt, A middleware infrastructure for active spaces, IEEE Pervasive Computing 1(4) (2002), 74-83.

Digital Library

[43]

D. Roscher, M. Blumendorf, and S. Albayrak, A meta user interface to control multimodal interaction in smart environments, in: Proc. of the 14th Int. Conf. on Intelligent User Interfaces, ACM, NY, USA, 2009, pp. 481-482.

Digital Library

[44]

E. Rukzio, K. Leichtenstern, V. Callaghan, P. Holleis, A. Schmidt, and J.S.-Y. Chin, An experimental comparison of physical mobile interaction techniques: Touching, pointing and scanning, in: Proc. on the 8th Int. Conf. on Ubiquitous Computing, 2006, pp. 87-104.

[45]

S. Russel and P. Norvig, Artificial Intelligence: A Modern Approach 2/E, Prentice Hall, 2002.

[46]

A. Sayouti, F. Qrichi Aniba, and H. Madromi, Interactions between agents as shared resources in multi-agents systems, in: New Technologies, Mobility and Security, Nov. 2008, pp. 1-4.

[47]

A. Schmidt, M. Kranz, and P. Holleis, Interacting with the ubiquitous computer: towards embedding interaction, in: Proc. of the Joint Conf. on Smart Objects and Ambient Intelligence: Innovative Context-Aware Services: Usages and Technologies, ACM, NY, USA, 2005, pp. 147-152.

Digital Library

[48]

R. Schmidt, and K. Abere, Efficient Peer-to-Peer belief propagation, in: Proc. of OTM Confederated Int. Conf., CoopIS, DOA, GADA, and ODBASE 2006, R. Meersman and Z. Tari, eds, LNCS, Vol. 4275, Springer-Verlag, Berlin, Heidelberg, pp. 516-532.

Digital Library

[49]

L. Serafini and A. Tamilin, DRAGO: Distributed reasoning architecture for the semantic web, in: Proc. of 2nd European SemanticWeb conf. on The Semantic Web: Research and Applications, A. Gómez Pérez, and J. Euzenat, eds, LNCS, Vol. 3532, Springer-Verlag, Berlin, Heidelberg, 2005, pp. 361-376.

Digital Library

[50]

R. Sharma, V.I. Pavlovic, and T.S. Huang, Toward multimodal human-computer interface, Proc. of the IEEE 86(5) (1998), 853-869.

[51]

Z. Shelby, K. Hartke, C. Bormann, and B. Frank, Constrained Application Protocol (CoAP), Internet-Draft (work in progress) ¿draft-ietf-core-coap-08¿, Sensinode, Universitaet Bremen TZI, SkyFoundry (accessed January 2012).

[52]

A. Sinner and T. Kleemann, KRHyper - In your pocket, in: Automated Deduction - CADE-20, R. Nieuwenhuis, ed., LNCS, Vol. 3632, Springer, Berlin/Heidelberg, 2005, pp. 737.

[53]

J. Stan, V.-H. Do, and P. Maret, Semantic user interaction profiles for better people recommendation, in: Proc. of the Int. Conf. on Advances in Social Networks Analysis and Mining, July 2011, pp. 434-437.

Digital Library

[54]

T. Strang and C. Linnhoff-Popien, A context modeling survey, in: Proc. of the Workshop on Advanced Context Modelling, Reasoning and Management within 6th Int. Conf. on Ubiquitous Computing, Nottingham, England, 2004.

[55]

X. Su, E. Gilman, P. Kwiatkowski, T. Latkowski, A. Pröbstl, B. Wójtowicz, and J. Riekki, Knowledge-based systems for ambient social interactions, in: Ambient Intelligence, D. Keyson et al., eds, LNCS, Vol. 7040, Springer, Berlin/Heidelberg, 2011, pp. 61-71.

[56]

X. Su, J. Riekki, and J. Haverinen, Entity notation: Enabling knowledge representations for resource constrained sensors, in: Personal and Ubiquitous Computing, 2011, pp. 1-16.

[57]

A. Toninelli, A. Pathak, and V. Issarny, Yarta: A middleware for managing mobile social ecosystems, in: Advances in Grid and Pervasive Computing, Riekki et al., eds, LNCS, Vol. 6646, Springer, Berlin/Heidelberg, 2011, pp. 209-220.

[58]

M.H. Tran, J. Han, and A. Colman, Social context: Supporting interaction awareness in ubiquitous environments, in: Proc. of the Int. Conf. on Mobile and Ubiquitous Systems: Networking & Services, July 2009, pp. 1-10.

[59]

H.-L. Truong, S. Dustdar, D. Baggio, S. Corlosquet, C. Dorn, G. Giuliani, R. Gombotz, Y. Hong, P. Kendal, C. Melchiorre, S. Moretzky, S. Peray, A. Polleres, S. Reiff-Marganiec, D. Schall, S. Stringa, M. Tilly, and H.Q. Yu, in Context: A pervasive and collaborative working environment for emerging team forms, in: Proc. of the Int. Symp. on Applications and the Internet, July 2008, pp. 118-125.

[60]

M. Turunen, A. Kallinen, I. Sanchez, J. Riekki, J. Hella, T. Olsson, A. Melto, J.P. Rajaniemi, J. Hakulinen, and E. Makinen, Multimodal interaction with speech and physical touch interface in a media center application, in: Proc. of the Int. Conf. on Advances in Computer Enterntainment Technology, ACM, 2009, pp. 19-26.

Digital Library

[61]

C.N. Ververidis and G.C. Polyzos, Service discovery for mobile Ad Hoc networks: a survey of issues and techniques, Communications Surveys & Tutorials, IEEE 10(3), 30-45.

Digital Library

[62]

J. Viterbo, Decentralized reasoning in Ambient Intelligence, PhD dissertation, Pontifícia Universidade Católica do Rio de Janeiro (PUC-Rio), 2009.

[63]

L. Wang, T. Gu, X. Tao, J. Lu, and M. Tscheligi, Sensor-based human activity recognition in a multi-user scenario, in: Ambient Intelligence, B. de Ruyter et al., eds, LNCS, Vol. 5859, Springer, Berlin/Heidelberg, 2009, pp. 78-87.

[64]

R. Want, K.P. Fishkin, A. Gujar, and B.L. Harrison, Bridging physical and virtual worlds with electronic tags, in: Proc. of the SIGCHI Conf. on Human Factors in Computing Systems: The CHI is the Limit, ACM, 1999, pp. 370-377.

Digital Library

[65]

T. Winograd, Architectures for context, Human-Computer Interaction 16(2) (2001), 401-419.

Digital Library

[66]

Y. Xu, J. Gu, J. Yang, and Z. Zhang, An ontology-based approach for mobile personalized recommendation, in: Proc. of the Int. Conf. on Services Science, Management and Engineering, July 2009, pp. 336-339.

[67]

J. Ye, J. Li, H. Shi, X. Gu, and Z. Zhu, DFre: A distributed fuzzy reasoning engine for personalization recommendation, in: Proc. of 3rd Int. Conf. on Pervasive Computing and Applications, Vol. 2, 2008, pp. 576-581.

[68]

A. Zimmermann, Context management and personalisation: A tool suite for context- and user-aware computing, PhD dissertation, Fraunhofer FIT, 2007.

Cited By

Ardito CDesolda GLanzilotti RMalizia AMatera MBuono PPiccinno A(2020)User-defined semantics for the design of IoT systems enabling smart interactive experiencesPersonal and Ubiquitous Computing10.1007/s00779-020-01457-524:6(781-796)Online publication date: 1-Dec-2020
https://dl.acm.org/doi/10.1007/s00779-020-01457-5
(2017)A context change detection approach for ubiquitous environmentsInternational Journal of Autonomous and Adaptive Communications Systems10.1504/IJAACS.2017.08665310:3(320-340)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1504/IJAACS.2017.086653
Nazari Shirehjini ASemsar A(2017)Human interaction with IoT-based smart environmentsMultimedia Tools and Applications10.1007/s11042-016-3697-376:11(13343-13365)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.1007/s11042-016-3697-3
Show More Cited By

Towards interactive smart spaces
1. Human-centered computing

Recommendations

Cerberus: A Context-Aware Security Scheme for Smart Spaces
PERCOM '03: Proceedings of the First IEEE International Conference on Pervasive Computing and Communications

Ubiquitous computing has fueled the idea of constructing sentient, information-rich "smart spaces" that extend the boundaries of traditional computing to encompass physical spaces, embedded devices, sensors, and other machinery. To achieve this, smart ...
Towards a smart retail environment
UbiComp/ISWC'15 Adjunct: Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers

Over the last decades, the advancements in digital technologies pervasiveness increasingly transformed regular physical spaces in smart ambients, where humans and objects are seamlessly hyper-connected. Large screens are commonly part of these smart ...
The M3 architecture for smart spaces: Overview of semantic information broker implementations
FRUCT'19: Proceedings of the 19th Conference of Open Innovations Association FRUCT

A smart space enhances a networked computing environment by enabling information sharing for a multitude of local digital devices and global resources from the Internet. We consider the M3 architecture (multi-device, multi-vendor, multi-domain) for ...

Comments

Information & Contributors

Information

Published In

cover image Journal of Ambient Intelligence and Smart Environments

Journal of Ambient Intelligence and Smart Environments Volume 5, Issue 1

Context Awareness

January 2013

139 pages

ISSN:1876-1364

Issue’s Table of Contents

Publisher

IOS Press

Netherlands

Publication History

Published: 01 January 2013

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ardito CDesolda GLanzilotti RMalizia AMatera MBuono PPiccinno A(2020)User-defined semantics for the design of IoT systems enabling smart interactive experiencesPersonal and Ubiquitous Computing10.1007/s00779-020-01457-524:6(781-796)Online publication date: 1-Dec-2020
https://dl.acm.org/doi/10.1007/s00779-020-01457-5
(2017)A context change detection approach for ubiquitous environmentsInternational Journal of Autonomous and Adaptive Communications Systems10.1504/IJAACS.2017.08665310:3(320-340)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1504/IJAACS.2017.086653
Nazari Shirehjini ASemsar A(2017)Human interaction with IoT-based smart environmentsMultimedia Tools and Applications10.1007/s11042-016-3697-376:11(13343-13365)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.1007/s11042-016-3697-3
Viola FD'Elia AKorzun DGalov IKashevnik ABalandin S(2016)The M3 architecture for smart spaces: Overview of semantic information broker implementationsProceedings of the 19th Conference of Open Innovations Association FRUCT10.23919/FRUCT.2016.7892210(264-272)Online publication date: 14-Nov-2016
https://dl.acm.org/doi/10.23919/FRUCT.2016.7892210
Leppänen TMilara IJilin Yang Kataja JRiekki J(2016)Enabling user-centered interactions in the Internet of Things2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC.2016.7844457(001537-001543)Online publication date: 9-Oct-2016
https://dl.acm.org/doi/10.1109/SMC.2016.7844457
Khabou NRodriguez IJmaiel M(2014)Threshold-based context change detection for ubiquitous environmentsProceedings of the 3rd International Conference on Context-Aware Systems and Applications10.5555/2762722.2762733(57-63)Online publication date: 7-Oct-2014
https://dl.acm.org/doi/10.5555/2762722.2762733

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents