Article

Designing in virtual reality (DesIRe): a gesture-based interface

Authors:

Manolya Kavakli,

Meredith Taylor,

Anatoly TrapeznikovAuthors Info & Claims

DIMEA '07: Proceedings of the 2nd international conference on Digital interactive media in entertainment and arts

Pages 131 - 136

https://doi.org/10.1145/1306813.1306842

Published: 19 September 2007 Publication History

Abstract

In this paper, our purpose is to focus on detection of dynamic gestures and find the thresholds to detect gestures for a gesture-based system, DesIRe (DESigning In virtual REality). DesIRe treats virtual reality as a platform of virtual clay and allows realtime dynamic interaction with an object to perform a number of design operations. We developed an interface using a stereoscopic display environment and combining elements of gesture recognition and motion capture. The system architecture of DesIRe include following components: Vizard Virtual Reality Toolkit, an immersive projection system (VISOR), an optical tracking system (specifically the PPT system and the in-house gesture recognition software), and Data Input System (a data glove). In DesIRe, the user has control of a hand-shaped cursor which is guided by a single infrared LED and linked to the data glove finger states and orientation in order to provide an immediate, visual feedback. In this paper, we present an approach to represent the finger states using binary digits in gesture detection and demonstrate the thresholds. We found that thresholds are glove specific.

References

[1]

Fish, J.&Scrivener, S. A. R., 1990: Amplifying the Mind's Eye: Sketching and Visual Cogn., Leonardo, 23(1), 117--126.

[2]

Gao, Y. F., Kavakli, M., 2006: VS: Facial Sculpting in the Virtual World, IEEE International Conference on Computational Intelligence for Modelling, Control and Automation CIMCA'2006, 28 November -- 1 December 2006, Sydney, Australia, 1--4

Digital Library

[3]

Guzman, A., 1971: Analysis of curved line drawings context and global information, Machine Intelligence, 6, Edinburgh University Press, Edinburgh, 325--375

[4]

Jung, T., Gross, M. D., Yi-Luen Do, E., 2002: Annotating and Sketching on 3D Web Models, IUI'02 Intelligent User Interfaces Conference, San Francisco, California, January 13--16, ACM, 95--102.

Digital Library

[5]

Kavakli, M., 1997: An AI Application for the Transformation of a 2D Sketch to a 3D Geometric Model, NATO Project Report, NATO area code: 4301, NATO list code: 51/B96/TU, TUBITAK, Turkey: Ankara.

[6]

Kavakli, M., Scrivener, S. A. R, Ball, L. J., 1998: The Structure of Sketching Behaviour, Design Studies, 19, 485--517.

[7]

Kavakli, M., Suwa, M, Gero, J. S., Purcell, T., 1999: Sketching interpretation in novice and expert designers, in Gero, J. S., and Tversky, B. (eds), Visual and Spatial Reasoning in Design, Key Centre of Design Computing and Cognition, University of Sydney, Sydney, 209--219.

[8]

Kavakli, M., Gero, J. S., 2001: Sketching as mental imagery processing, Design Studies, Vol 22/4, 347--364

[9]

Kavakli, M., Gero, J. S., 2002: Structure of Concurrent Cognitive actions: A Case Study on Novice&Expert Designers, Design Studies, Vol 23/1, 25--40

[10]

Kavakli, M, Gero, J. S., 2003: Difference between expert and novice designers: an experimental study, in U Lindemann et al (eds), Human Behaviour in Design, Springer, pp 42--51

[11]

Kavakli, M., Kavakli, K., Gao, Y. F., 2004: Crime Prevention Through Environmental Design in Virtual Reality, Proceedings of the 9^th Crime Prevention Through Environmental Design (CPTED) Conference, organised by the International Security Management&Crime Prevention Institute, Brisbane, September 13--16

[12]

Kavakli, M., Jayarathna, D., 2006: Virtual Hand: An Interface for Interactive Sketching in Virtual Reality, CIMCA'2005: the International Conference on Computational Intelligence for Modelling, Control and Automation, sponsored by IEEE, 28--30 November, Vienna, Austria, Vol1, 613--619, ISBN-13: 9780769525044

Digital Library

[13]

Kavakli, M., 2005: Speaking Hands of an Artist&Requirements for an Interface Design, INISTA 2005, Innovations in Intelligent Systems and Applications, IEEE, YILDIZ Technical University, Istanbul, Turkey, 15--18 June, 195--198, http://www.inista.org/, ISBN 9754614008

[14]

Kavakli, M., Gao, Y. F., 2006: Patterns of Design Cognition in Back Propagation Neural Networks, CIMCA'2005: the Int. Conf. on Computational Intelligence for Modelling, Control and Automation, IEEE, 28--30 November, Vienna, Austria, Vol2, 600--605, ISBN-13: 9780769525044

Digital Library

[15]

Kjeldsen, F. C. M., 1997: Visual Interpretation of Hand Gestures as a Practical Interface Modality, PhD Thesis, Graduate School of Arts and Sciences, Columbia University

Digital Library

[16]

Li, F., Lau, R., Ng, F., 2003: "VSculpt: A Distributed Virtual Sculpting Environment for Collaborative Design," IEEE Transactions on Multimedia, 5(4):570--580

Digital Library

[17]

Liu, X., Hinds, B, McCartney, J., Dodds, G., 2003: Design and Visualisation of Footwear in a VE, The Virtual Engineering Center, Queens University, Belfast,

[18]

Marr, D., 1982: Vision, New York: Freeman.

[19]

Minsky, M., 1975: A Framework for Representing Knowledge, in: Winston, P. H. (ed.), The Psychol. of Computer Vision, McGraw Hill.

[20]

Mulder, A., 1996: Hand Gestures for HCI, Hand Centered Studies of Human Movement Project, Technical Report 96-1, School of Kinesiology, Simon Fraser University, February

[21]

Negroponte, N., 1973: Recent Advances in Sketch Recognition, Proc. of Nation. Comp. Conf., New York, 663--675.

Digital Library

[22]

Pederson, T., 2000, Human Hands as a link between physical and virtual, Conference on Designing Augmented Reality Systems (DARE2000), Helsinore, Denmark, 12-14/4/2000

Digital Library

[23]

Sacco M., Vigano, G., Paris, I., 2002: Virtual reality and CAD/CAM systems applied to custom shoe manufacture on a mass market basis, International Conference on Mass Customisation, De Montfort University, Leicester

[24]

Schaaf, J. W., 1994: Gestalts in CAD-plans, In: Gero, J. S., Sudweeks, F., (Eds.), Artificial Intelligence in Design'94, The Netherlands: Kluwer Academic Pub., 437--446.

[25]

Winston, P. H.: 1975, Learning structural descriptions from Examples, in: Winston, P.H.(Ed.),The Psych of Comp Vision, McGraw Hill.

[26]

Witkin A. P., Tenenbaum, J. M. (1983), On the Role of Structure in Vision, In: Beck, J., Hope, B, Rosenfeld, A., (Eds.), Human and Machine Vision, Academic Press, New York, pp. 481--541

[27]

Wong, J., Lau, R., and Ma, L., 2000: Virtual 3D Sculpting, Journal of Visualization and Computer Animation, 11(3), pp. 155--166, July

Cited By

Jennings NNandy AZhu XWang YSui FSmith JHartmann B(2022)GeneratiVR: Spatial Interactions in Virtual Reality to Explore Generative Design SpacesCHI Conference on Human Factors in Computing Systems Extended Abstracts10.1145/3491101.3519616(1-6)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519616
Streeter LGauch J(2020)Detecting Gestures Through a Gesture-Based Interface to Teach Introductory Programming ConceptsHuman-Computer Interaction. Multimodal and Natural Interaction10.1007/978-3-030-49062-1_9(137-153)Online publication date: 10-Jul-2020
https://doi.org/10.1007/978-3-030-49062-1_9
Jahani HKavakli M(2018)Exploring a user-defined gesture vocabulary for descriptive mid-air interactionsCognition, Technology and Work10.1007/s10111-017-0444-020:1(11-22)Online publication date: 20-Dec-2018
https://dl.acm.org/doi/10.1007/s10111-017-0444-0
Show More Cited By

Recommendations

Virtual reality in construction: a review
Engineering computational technology

Virtual Reality (VR) and the development of Virtual Environments (VEs) can make a significant impact on how construction project stakeholders can perceive and successfully complete their projects. VR techniques have the potential to enhance the ...
Virtual Fieldwork: Designing Augmented Reality Applications Using Virtual Reality Worlds
Virtual, Augmented and Mixed Reality
Abstract
AR technology continues to develop and is expected to be used in a much wider range of fields. However, existing head-mounted displays for AR are still inadequate for use in daily life. Therefore, we focused on using VR to develop AR services and ...
The presence of an avatar can reduce cybersickness in Virtual Reality
Abstract
Virtual Reality (VR) applications are increasingly being utilized for research, healthcare, and education. Despite their benefits, many VR users report motion sickness-like sensations (cybersickness), such as headache, disorientation, or nausea. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

DIMEA '07: Proceedings of the 2nd international conference on Digital interactive media in entertainment and arts

September 2007

212 pages

ISBN:9781595937087

DOI:10.1145/1306813

Conference Chairs:
Kevin Kok Wai Wong
Murdoch University, Australia
,
Lance Fung
Murdoch University, Australia
,
Peter Cole
Murdoch University, Australia

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

IFIP Specialist Group on Entertainment Computing
IEEE Western Australia Section
Murdoch University
Department of Industry and Resources
Nokia
ACM: Association for Computing Machinery
SIGCHI Singapore

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 September 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

DIMEA07

Sponsor:

ACM

DIMEA07: Second International Conference on Digital Interactive Media in Entertainment and Arts

September 19 - 21, 2007

Perth, Australia

Acceptance Rates

Overall Acceptance Rate 59 of 77 submissions, 77%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
836
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Jennings NNandy AZhu XWang YSui FSmith JHartmann B(2022)GeneratiVR: Spatial Interactions in Virtual Reality to Explore Generative Design SpacesCHI Conference on Human Factors in Computing Systems Extended Abstracts10.1145/3491101.3519616(1-6)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519616
Streeter LGauch J(2020)Detecting Gestures Through a Gesture-Based Interface to Teach Introductory Programming ConceptsHuman-Computer Interaction. Multimodal and Natural Interaction10.1007/978-3-030-49062-1_9(137-153)Online publication date: 10-Jul-2020
https://doi.org/10.1007/978-3-030-49062-1_9
Jahani HKavakli M(2018)Exploring a user-defined gesture vocabulary for descriptive mid-air interactionsCognition, Technology and Work10.1007/s10111-017-0444-020:1(11-22)Online publication date: 20-Dec-2018
https://dl.acm.org/doi/10.1007/s10111-017-0444-0
Streeter LGauch J(2018)Teaching Introductory Programming Concepts Through a Gesture-Based InterfaceHCI International 2018 – Posters' Extended Abstracts10.1007/978-3-319-92285-0_17(116-123)Online publication date: 7-Jun-2018
https://doi.org/10.1007/978-3-319-92285-0_17
Korkmaz S(2018)Integrated Deep Learning Structures for Hand Gesture Recognition13th International Conference on Theory and Application of Fuzzy Systems and Soft Computing — ICAFS-201810.1007/978-3-030-04164-9_19(129-136)Online publication date: 29-Dec-2018
https://doi.org/10.1007/978-3-030-04164-9_19
Luzhnica GSimon JLex EPammer V(2016)A sliding window approach to natural hand gesture recognition using a custom data glove2016 IEEE Symposium on 3D User Interfaces (3DUI)10.1109/3DUI.2016.7460035(81-90)Online publication date: Mar-2016
https://doi.org/10.1109/3DUI.2016.7460035
Messaci AZenati NBellarbi ABelhocine M(2015)3D interaction techniques using gestures recognition in virtual environment2015 4th International Conference on Electrical Engineering (ICEE)10.1109/INTEE.2015.7416813(1-5)Online publication date: Dec-2015
https://doi.org/10.1109/INTEE.2015.7416813
Teleb HChang G(2012)Data glove integration with 3D virtual environments2012 International Conference on Systems and Informatics (ICSAI2012)10.1109/ICSAI.2012.6223225(107-112)Online publication date: May-2012
https://doi.org/10.1109/ICSAI.2012.6223225
Kavakli MBoyali A(2012)De-SIGN: Robust Gesture Recognition in Conceptual Design, Sensor Analysis and SynthesisAdvances in Robotics and Virtual Reality10.1007/978-3-642-23363-0_9(201-225)Online publication date: 2012
https://doi.org/10.1007/978-3-642-23363-0_9
Sugi MNakanishi HNishino MTamura YArai TOta J(2010)Development of Deskwork Support System Using Pointing Gesture InterfaceJournal of Robotics and Mechatronics10.20965/jrm.2010.p043022:4(430-438)Online publication date: 20-Aug-2010
https://doi.org/10.20965/jrm.2010.p0430
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten