Abstract
The idea of interacting with technologies through touch-less and body-based interfaces has caused great excitement amongst users, but for the designers it has created various new challenges. Usability encompasses part of these challenges, and there have been attempts at creating heuristics for NUIs design. However, most of these heuristics consider using a device such as Kinect for the recognition of gestures, not people or objects. Therefore, in this paper we investigate the subject by presenting a systematic literature review aimed at finding heuristics for the design and evaluation of NUIs. Our analysis focuses on the scenario of helping people with visual disabilities in their daily activities. By looking at the state of the art, we intend to verify how many and which heuristics fit in this context.
Chapter PDF
Similar content being viewed by others
References
Bailly, G., Müller, J., Lecolinet, E.: Design and evaluation of finger-count interaction: Combining multitouch gestures and menus. Int. J. Hum. Comput. Stud. 70, 673–689 (2012)
Block, F., Wigdor, D., Phillips, B.C., Horn, M.S., Shen, C.: FlowBlocks: A Multi-Touch UI for Crowd Interaction. In: Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, UIST 2012, pp. 497–508. ACM, Cambridge (2012)
Cox, D., Wolford, J., Jensen, C., Beardsley, D.: An evaluation of game controllers and tablets as controllers for interactive tv applications. In: Proceedings of the 14th ACM International Conference on Multimodal Interaction, ICMI 2012, p. 181. ACM Press, New York (2012)
Cuccurullo, S., Francese, R., Murad, S., Passero, I., Tucci, M.: A gestural approach to presentation exploiting motion capture metaphors. In: Proceedings of the International Working Conference on Advanced Visual Interfaces, AVI 2012, pp. 148–155. ACM Press, New York (2012)
Ertin, E., Stohs, N., Kumar, S., Raij, A., Al’Absi, M., Shah, S.: AutoSense: Unobtrusively Wearable Sensor Suite for Inferring the Onset, Causality, and Consequences of Stress in the Field. In: Proceedings of the 9th ACM Conference on Embedded Networked Sensor Systems, SenSys 2011, pp. 274–287. ACM, Seattle (2011)
Frisch, M., Heydekorn, J., Dachselt, R.: Diagram Editing on Interactive Displays Using Multi-touch and Pen Gestures. In: Goel, A.K., Jamnik, M., Narayanan, N.H. (eds.) Diagrams 2010. LNCS, vol. 6170, pp. 182–196. Springer, Heidelberg (2010)
Garzotto, F., Valoriani, M., Milano, P.: Touchless Gestural Interaction with Small Displays: A Case Study. In: Proceedings of the Biannual Conference of the Italian Chapter of SIGCHI - CHItaly 2013, pp. 1–10. ACM, Trento (2013)
Gomes, A., Oh, H., Chisik, Y., Chen, M.: Ilha Musical: a CAVE for nurturing cultural appreciation. In: Proceedings of the 11th International Conference on Interaction Design and Children, IDC 2012, Bremen, Germany, pp. 232–235 (2012)
Jankowski, J., Decker, S.: A Dual-Mode User Interface for Accessing 3D Content on the World Wide Web Categories and Subject Descriptors. In: Proceedings of the 21st International Conference on World Wide Web, pp. 1047–1056. ACM, Lyon (2012)
Klompmaker, F., Paelke, V.: A Taxonomy-Based Approach Towards NUI Interaction Design. In: TEI 2013, pp. 32–41. ACM, Barcelona (2013)
Liberati, A., Altman, D.G., Tetzlaff, J., Mulrow, C., Gotzsche, P.C., Ioannidis, J.P., Clarke, M., Devereaux, P.J., Kleijnen, J., Moher, D.: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ 6, 27 (2009)
Lin, S., Shie, C., Chen, S., Hung, Y.: AirTouch Panel: A Re-Anchorable Virtual Touch Panel. In: Proceedings of the 21st ACM International Conference on Multimedia, MM 2013, pp. 625–628. ACM, Barcelona (2013)
Nebe, K., Klompmaker, F., Jung, H., Fischer, H.: Exploiting New Interaction Techniques for Disaster Control Management Using Multitouch-, Tangible- and Pen-Based-Interaction. In: Jacko, J.A. (ed.) Human-Computer Interaction, Part II, HCII 2011. LNCS, vol. 6762, pp. 100–109. Springer, Heidelberg (2011)
Nielsen, J.: Usability Engineering (1994)
O’Hara, K., Harper, R., Mentis, H., Sellen, A., Taylor, A.: On the Naturalness of Touchless: Putting the “Interaction” Back into NUI. ACM Trans. Comput. Interact. 20, 1–25 (2013)
Oh, J., Jung, Y., Cho, Y., Hahm, C., Education, S.S., Sin, H., Science, C., Lee, J.: Hands-Up: Motion Recognition using Kinect and a Ceiling to Improve the Convenience of Human Life. In: CHI 2012 Extended Abstracts on Human Factors in Computing Systems, pp. 1655–1660. ACM (2012)
Sae-bae, N., Ahmed, K., Isbister, K., Memon, N.: Biometric-Rich Gestures: A Novel Approach to Authentication on Multi-touch Devices. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2012, pp. 977–986 (2012)
Sanna, A., Lamberti, F., Paravati, G., Rocha, F.D.: A kinect-based interface to animate virtual characters. J. Multimodal User Interfaces 7, 269–279 (2012)
Shiratuddin, M.F., Wong, K.W.: Game Design Considerations When Using Non-touch Based Natural User Interface. In: Pan, Z., Cheok, A.D., Müller, W., Chang, M., Zhang, M. (eds.) Transactions on Edutainment VIII. LNCS, vol. 7220, pp. 35–45. Springer, Heidelberg (2012)
Wigdor, D., Wixon, D.: Brave NUI World (2011)
Yang, J., Dekker, A., Muhlberger, R., Viller, S.: Exploring Virtual Representations of Physical Artefacts in a Multi-touch Clothing Design Collaboration System. In: Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group, OZCHI 2009, pp. 353–356. ACM, Melbourne (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Maike, V.R.M.L., de Sousa Britto Neto, L., Baranauskas, M.C.C., Goldenstein, S.K. (2014). Seeing through the Kinect: A Survey on Heuristics for Building Natural User Interfaces Environments. In: Stephanidis, C., Antona, M. (eds) Universal Access in Human-Computer Interaction. Design and Development Methods for Universal Access. UAHCI 2014. Lecture Notes in Computer Science, vol 8513. Springer, Cham. https://doi.org/10.1007/978-3-319-07437-5_39
Download citation
DOI: https://doi.org/10.1007/978-3-319-07437-5_39
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07436-8
Online ISBN: 978-3-319-07437-5
eBook Packages: Computer ScienceComputer Science (R0)