research-article

A taxonomy of (real and virtual world) display and control interactions

Author:

Paul MilgramAuthors Info & Claims

VRST '09: Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology

Page 10

https://doi.org/10.1145/1643928.1643932

Published: 18 November 2009 Publication History

Abstract

Interactions between a human operator and objects in his/her world afford a wide range of possible viewing and control options, which can vary with respect to time, space, proximity, and frame of reference. Whereas it is conventionally recognised that essentially any kind of interaction metaphor can in principle be simulated in a virtual environment, modern image processing technology now permits greatly increased flexibility also for real world interactions with indirect viewing, Äî as the common video camera has gone beyond being a simple eye on the (remote) real world to being an instrument that is able to integrate and interpolate real world images spatially and temporally, in real time.

In the talk, I shall propose a framework for classifying viewing and manipulation interactions for any task where visual feed back is provided.

The framework involves identifying key components of the environment that are central to the interaction, in terms of the multidimensional couplings among the components, where the configuration and characteristics of the couplings determine the nature of the visual and manual control interactions experienced by the operator. The framework is domain independent, and is intended to be used both to classify current display-control interactions and to identify future areas of research.

Cited By

View all

Alfaro LRivera CLuna-Urquizo JCastaneda EZuniga-Cueva JRivera-Chavez M(2021)Work in Progress: Adaptive e-Learning software architecture based on immersive technologies2021 IEEE World Conference on Engineering Education (EDUNINE)10.1109/EDUNINE51952.2021.9429149(1-4)Online publication date: 14-Mar-2021
https://doi.org/10.1109/EDUNINE51952.2021.9429149
Reinhardt JHillen LWolf Kvan den Hoven ELoke LShaer Ovan Dijk JKun A(2020)Embedding Conversational Agents into ARProceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3374920.3374956(299-310)Online publication date: 9-Feb-2020
https://dl.acm.org/doi/10.1145/3374920.3374956
Perez PGonzalez-Sosa EKachach RRuiz JBenito IPereira FVillegas A(2019)Immersive Gastronomic Experience with Distributed Reality2019 IEEE 5th Workshop on Everyday Virtual Reality (WEVR)10.1109/WEVR.2019.8809591(1-6)Online publication date: Mar-2019
https://doi.org/10.1109/WEVR.2019.8809591
Show More Cited By

Index Terms

A taxonomy of (real and virtual world) display and control interactions
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

A Reconfigurable Mobile Head-Mounted Display Supporting Real World Interactions
CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

We propose a new mobile head-mounted display, ModularHMD, that uses a modular mechanism with a manually reconfigurable structure to enable ad-hoc peripheral interaction with real-world objects and people while maintaining an immersive VR experience. We ...
ModularHMD: A Reconfigurable Mobile Head-Mounted Display Enabling Ad-hoc Peripheral Interactions with the Real World
UIST '21: The 34th Annual ACM Symposium on User Interface Software and Technology

We propose ModularHMD, a new mobile head-mounted display concept, which adopts a modular mechanism and allows a user to perform ad-hoc peripheral interaction with real-world devices or people during VR experiences. ModularHMD is comprised of a central ...
Beyond Being Real: A Sensorimotor Control Perspective on Interactions in Virtual Reality
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

We can create Virtual Reality (VR) interactions that have no equivalent in the real world by remapping spacetime or altering users’ body representation, such as stretching the user’s virtual arm for manipulation of distant objects or scaling up the user’...

Comments

Information & Contributors

Information

Published In

VRST '09: Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology

November 2009

277 pages

ISBN:9781605588698

DOI:10.1145/1643928

Editor:
Steven N. Spencer
University of Washington
,
General Chairs:
Yoshifumi Kitamura
Osaka University, Japan
,
Haruo Takemura
Osaka University, Japan
,
Program Chairs:
Kiyoshi Kiyokawa
Osaka University, Japan
,
Benjamin Lok
University of Florida
,
Daniel Thalmann
EPFL, Switzerland

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 November 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

VRST '09

Sponsor:

VRST '09: The 16th ACM Symposium on Virtual Reality Software and Technology

November 18 - 20, 2009

Kyoto, Japan

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 11 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Alfaro LRivera CLuna-Urquizo JCastaneda EZuniga-Cueva JRivera-Chavez M(2021)Work in Progress: Adaptive e-Learning software architecture based on immersive technologies2021 IEEE World Conference on Engineering Education (EDUNINE)10.1109/EDUNINE51952.2021.9429149(1-4)Online publication date: 14-Mar-2021
https://doi.org/10.1109/EDUNINE51952.2021.9429149
Reinhardt JHillen LWolf Kvan den Hoven ELoke LShaer Ovan Dijk JKun A(2020)Embedding Conversational Agents into ARProceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3374920.3374956(299-310)Online publication date: 9-Feb-2020
https://dl.acm.org/doi/10.1145/3374920.3374956
Perez PGonzalez-Sosa EKachach RRuiz JBenito IPereira FVillegas A(2019)Immersive Gastronomic Experience with Distributed Reality2019 IEEE 5th Workshop on Everyday Virtual Reality (WEVR)10.1109/WEVR.2019.8809591(1-6)Online publication date: Mar-2019
https://doi.org/10.1109/WEVR.2019.8809591
Perez PGonzalez-Sosa EKachach RRuiz JVillegas AJain EKosinka J(2018)A drink in marsProceedings of the 39th Annual European Association for Computer Graphics Conference: Posters10.5555/3307631.3307639(15-16)Online publication date: 16-Apr-2018
https://dl.acm.org/doi/10.5555/3307631.3307639

Abstract

Cited By

Index Terms

Recommendations

A Reconfigurable Mobile Head-Mounted Display Supporting Real World Interactions

ModularHMD: A Reconfigurable Mobile Head-Mounted Display Enabling Ad-hoc Peripheral Interactions with the Real World

Beyond Being Real: A Sensorimotor Control Perspective on Interactions in Virtual Reality

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Share

Share this Publication link

Share on social media

Affiliations