research-article

Inducement of visual attention using augmented reality for multi-display systems in advanced tele-operation

Authors:

Shigeki SuganoAuthors Info & Claims

2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

Pages 5364 - 5369

https://doi.org/10.1109/IROS.2015.7354135

Published: 28 September 2015 Publication History

Abstract

Unmanned construction machines are used after disasters. Compared with manned construction, time efficiency is lower because of incomplete visual information, communication delay, and lack of tactile experience. We have developed an autonomous camera control system to supply appropriate visual information. In order to inform operators the potential data in the views, we introduced several augmented reality (AR) elements to induce visual attention to suitable images in a scenario. The purpose of this study is to develop an attention inducement system using AR technique and evaluate it under different conditions. We first improve our autonomous camera control system and then implement several kinds of AR items suitable for each work situation. The experimental results conducted using our virtual reality simulator confirm that AR items can supply a better positional relationship between machine and objects in the environment which makes operator handle the conditions as experienced. The results from eye-tracker data also indicate that AR items can induce visual attention to images suitable for situations.

References

[1]

S. Nishigaki, K. Saibara, S. Kitahara, H. Iwasaki, K. Yamada, and H. Satoh, “ICT-based work management to support unmanned construction for post-disaster restoration,” in Proc. Int. Symp. Automation and Robotics in Construction, pp. 508–513, 2011.

Google Scholar

[2]

K. Yokoi, K. Nakashima, M. Kobayashi, H. Mihune, H. Hasunuma, Y. Yanagihara, T. Ueno, T. Gokyuu, and K. Endou, “A tele-operated humanoid robot drives a backhoe in the open air,” in Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems, pp. 1117–1122, 2003.

Google Scholar

[3]

Y. Ban, “Unmanned construction system: present status and challenges,” in Proc. Int. Symp. Automation and Robotics in Const. pp. 241–246, 2002.

Google Scholar

[4]

M. Honma, N. Ikura, and K. Takai, “A study on video technologies for unmanned construction: back-hoe operations,” in Proc. Symp. Japan Const. Machinery and Const. Association, pp. 61–64, 2007 (in Japanese).

Google Scholar

[5]

J. Yang, M. Kamezaki, H. Iwata and S. Sugano, “Analysis of effective environmental-camera images using virtual environment for advanced unmanned construction,” in Proc. IEEE/ASME Int. Conf. Advanced Intelligent Mechatronics, pp. 664–669, 2014.

Google Scholar

[6]

M. Kamezaki, J. Yang, H. Iwata and S. Sugano, “An autonomous multi-camera control system using situation-based role assignment for tele-operated work machines,” in Proc. IEEE Int. Conf. Robotics and Automation, pp. 5971–5976, 2014.

Google Scholar

[7]

S. Nakayama and R. Sakai “The Estimation on the Work Achievement of Workers” Journal of Japan Industrial Management Association, vol. 32, no. 5, pp. 372–377, 1981.

Google Scholar

[8]

S. Haga and N. Mlizukami, “Japanese version of NASA Task Load Index Sensitivity of its workload score to difficulty of three different laboratory tasks”, The Japanese J. Ergonomics, vol. 32, no. 2, pp. 71–79, 1996.

Google Scholar

[9]

M. R. Marner, R. T. Smith, J. A. Walsh, and B. H. Thomas “Spatial user interfaces for large-scale projector-based augmented reality,” IEEE Computer Graphics and Applications, vol. 34, no. 6, pp. 74–82, 2014.

Crossref

Google Scholar

[10]

S. Zollmann, C. Hoppe, S. Kluckner, C. Poglitsch, and H. Bischof, “Aug-mented reality for construction site monitoring and documentation,” Proceedings of the IEEE, vol. 102, no. 2, pp. 137–154, 2014

Google Scholar

[11]

W. Broll, I. Lindt, J. Ohlenburg, I. Herbst, and M. Wittkamper, “An infrastructure for realizing custom-tailored augmented reality user interfaces,” IEEE Trans. Visualization and Computer Graphics, vol. 11, no. 6, pp. 722–733, 2005

Digital Library

Google Scholar

[12]

K. F. Hussain, E. Radwan, and G. S. Moussa, “Augmented reality experiment: drivers' behavior at an unsignalized intersection,” IEEE Trans. Intelligent Transportation Systems, vol. 14, no. 2, pp. 608–617, 2012.

Google Scholar

[13]

D. Kalkofen, E. Mendez, and D. Schmalstieg, “Comprehensible visualization for augmented reality,” IEEE Trans. Visualization and Computer Graphics, vol. 15, no. 2, pp. 193–204, 2008.

Google Scholar

[14]

S. Henderson and S. Feiner, “Exploring the benefits of augmented reality documentation for maintenance and repair,” IEEE Trans. Visualization and Computer Graphics, vol. 17, no. 10, pp. 1355–1368, 2010.

Google Scholar

Cited By

View all

Sitompul TWallmyr MJorge JKim JVan Eyken HGlencross MMitchell KNarumi T(2019)Using Augmented Reality to Improve Productivity and Safety for Heavy Machinery Operators: State of the ArtProceedings of the 17th International Conference on Virtual-Reality Continuum and its Applications in Industry10.1145/3359997.3365689(1-9)Online publication date: 14-Nov-2019
https://dl.acm.org/doi/10.1145/3359997.3365689

Index Terms

Inducement of visual attention using augmented reality for multi-display systems in advanced tele-operation
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Index terms have been assigned to the content through auto-classification.

Recommendations

Extending Virtual Reality Display Wall Environments Using Augmented Reality
SUI '19: Symposium on Spatial User Interaction

Two major form factors for virtual reality are head-mounted displays and large display environments such as CAVE®and the LCD-based successor CAVE2®. Each of these has distinct advantages and limitations based on how they’re used. This work explores ...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2

An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...
Augmented reality as perceptual reality
VSMM'06: Proceedings of the 12th international conference on Interactive Technologies and Sociotechnical Systems

As shown in Paul Milgram et al’s Reality-Virtuality Continuum (1994), Augmented Reality occupies a very unique status in the spectrum of Mixed Reality. Unlike Virtual Reality, which is completely made up of the virtual and has been the most important ...

Comments

Information & Contributors

Information

Published In

2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

Sep 2015

6501 pages

Publisher

IEEE Press

Publication History

Published: 28 September 2015

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Sitompul TWallmyr MJorge JKim JVan Eyken HGlencross MMitchell KNarumi T(2019)Using Augmented Reality to Improve Productivity and Safety for Heavy Machinery Operators: State of the ArtProceedings of the 17th International Conference on Virtual-Reality Continuum and its Applications in Industry10.1145/3359997.3365689(1-9)Online publication date: 14-Nov-2019
https://dl.acm.org/doi/10.1145/3359997.3365689

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Index Terms

Recommendations

Extending Virtual Reality Display Wall Environments Using Augmented Reality

Haptics in Augmented Reality

Augmented reality as perceptual reality

Comments

Information

Published In

Publisher

Publication History

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Get Access

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations