research-article

Using augmented reality to assist forklift operation

Authors:

Bhuvaneswari Sarupuri,

Mark BillinghurstAuthors Info & Claims

OzCHI '16: Proceedings of the 28th Australian Conference on Computer-Human Interaction

Pages 16 - 24

https://doi.org/10.1145/3010915.3010952

Published: 29 November 2016 Publication History

Abstract

Operating forklifts in warehouses is becoming an increasingly difficult task due to higher shelves and narrower aisles. In this paper we explore how Augmented Reality (AR) can aid forklift operators in performing their pallet racking and pick up tasks by superimposing virtual depth cues over the real world camera view. We developed a prototype interface, and evaluated it using a remote controlled toy forklift and a motion tracking. We measured the participant's performance on representative pallet handling tasks, finding a significant difference in the performance of participants using AR depth cues. The results show that AR could offer a novel, simple and efficient solution for the problems faced by forklift operators while performing pallet handling.

References

[1]

Akaho, K., Nakagawa, T., Yamaguchi, Y., Kawai, K., Kato, H., & Nishida, S. (2011). A Study and Evaluation on Route Guidance of a Car Navigation System Based on Augmented Reality. In J. Jacko (Ed.), Human- Computer Interaction. Towards Mobile and Intelligent Interaction Environments (Vol. 6763, pp. 357--366). Springer Berlin Heidelberg. Retrieved from http://dx.doi.org/10.1007/978-3-642-21616-9_40

[2]

Azuma, R. (1997). A Survey of Augmented Reality. A Survey of Augmented Reality.

Digital Library

[3]

Baglivo, L., Biasi, N., Biral, F., Bellomo, N., Bertolazzi, E., Lio, M. D., & Cecco, M. D. (2011). Autonomous pallet localization and picking for industrial forklifts: a robust range and look method. Measurement Science and Technology, 22(8), 085502. Retrieved from http://stacks.iop.org/0957-0233/22/i=8/a=085502

[4]

Bartholdi, J., & Hackmann, S. (2009). Warehouse and distribution science release 0.89. Georgia Institute of Technology.

[5]

Brooke, J. (1996). SUS: A quick and dirty usability scale.

[6]

Coyle, J., Bardi, E., & Langley, C. (2002). The management of Buisiness Logistics: A Supply Chain Perspective. Cincinnati, OH: South Western College.

[7]

Fitch, R., T., Oberpriller, & Lee, M. (2014). Fort Mill, SC, US Patent No. 2014/0114530.

[8]

Guo, A., Raghu, S., Xie, X., Ismail, S., Luo, X., Simoneau, J., . . . Starner, T. (2014). A Comparison of Order Picking Assisted by Head-up Display (HUD), Cart-mounted Display (CMD), Light, and Paper Pick List. Proceedings of the 2014 ACM International Symposium on Wearable Computers (pp. 71--78). New York, NY, USA: ACM. Retrieved from http://doi.acm.org/10.1145/2634317.2634321

Digital Library

[9]

Harders, M., Bianchi, G., & Knoerlein, B. (2007). Multimodal Augmented Reality in Medicine. In C. Stephanidis (Ed.), Universal Access in Human-Computer Interaction. Ambient Interaction (Vol. 4555, pp. 652--658). Springer Berlin Heidelberg. Retrieved from http://dx.doi.org/10.1007/978-3-540-73281-5_70

[10]

Hartley, R., & Zisserman, A. (2004). Multiple View Geometry. Cambridge Univ. Press.

[11]

Krolewski, J., & Gawrysiak, P. (2011). Public Transport Navigation System with Augmented Reality Interface. In G. Lee, D. Howard, & D. Ślęzak (Eds.), Convergence and Hybrid Information Technology (Vol. 206, pp. 545--551). Springer Berlin Heidelberg. Retrieved from http://dx.doi.org/10.1007/978-3-642-24106-2_69

[12]

Lebernedd, G., Schoster, H., & Lischka, J. (2014). Patent No. EP20120185761.

[13]

Ma Luna, J., Hervas, R., Fontecha, J., & Bravo, J. (2012). A Friendly Navigation-System Based on Points of Interest, Augmented Reality and Context-Awareness. In J. Bravo, D. López-de-Ipina, & F.

[14]

Moya (Eds.), Ubiquitous Computing and Ambient Intelligence (Vol. 7656, pp. 137--144). Springer Berlin Heidelberg. Retrieved from http://dx.doi.org/10.1007/978-3-642-35377-2_19

Digital Library

[15]

Radu, I. (2014). Augmented reality in education: a meta- review and cross-media analysis. Personal and Ubiquitous Computing, 18(6), 1533--1543. Retrieved from http://dx.doi.org/10.1007/s00779-013-0747-y

Digital Library

[16]

Schwerdtfeger, B., & Klinker, G. (2008). Supporting order picking with Augmented Reality. Mixed and Augmented Reality, 2008. ISMAR 2008. 7th IEEE/ACM International Symposium on, (pp. 91--94).

Digital Library

[17]

Schwerdtfeger, B., Reif, R., Gunthner, W. A., & Klinker, G. (2009). Pick-by-Vision Comes on Age: Evaluation of an Augmented Reality Supported Picking System in a Real Storage Environment. Proceedings of the 6th International Conference on Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa (pp. 23--31). New York, NY, USA: ACM. Retrieved from http://doi.acm.org/10.1145/1503454.1503459

[18]

Schwerdtfeger, B., Reif, R., Gunthner, W., & Klinker, G. (2011). Pick-by-vision: there is something to pick at the end of the augmented tunnel. Virtual Reality, 15(2--3), 213--223. Retrieve from http://dx.doi.org/10.1007/s10055-011-0187-9

Digital Library

[19]

Schwerdtfeger, B., Reif, R., Gunthner, W., Klinker, G., Hamacher, D., Schega, L., . . . Tumler, J. (2009, Oct). Pick-by-Vision: A first stress test. Mixed and Augmented Reality, 2009. ISMAR 2009. 8th IEEE International Symposium on, (pp. 115--124).

Digital Library

[20]

Seelinger, M., & Yoder, J.-D. (2005, April). Automatic Pallet Engagment by a Vision Guided Forklift. Robotics and Automation, 2005. ICRA 2005. Proceedings of the 2005 IEEE International Conference on, (pp. 4068--4073).

[21]

Straube, F., & Pfohl, H.-C. (2008). Trends und Strategien in der Logistik. Bremen: Globale Netzwerke im Wandel, DVV.

[22]

Yamada, H., & Muto, T. (2007). Construction Tele-Robotic System with Virtual Reality (CG Presentation of Virtual Robot and Task Object Using Stereo Vision System). Control Intell. Syst., 35(3), 195--201. Retrieved from http://dl.acm.org/citation.cfm?id=1735647.1735648

Digital Library

Cited By

Tschulik MKernbauer TFleck PArth C(2025)Spatial Augmented Reality for Heavy Machinery Using Laser ProjectionsComputers & Graphics10.1016/j.cag.2024.104161126(104161)Online publication date: Feb-2025
https://doi.org/10.1016/j.cag.2024.104161
Starostka-Patyk MKościelniak HGrunt P(2024)From Industry 4.0 to Supply Chain 4.0 – The Digital Transformation Influencing SCM Processes of Manufacturing Enterprises with ICT SolutionsProceedings of the 32nd International Conference on Information Systems Development10.62036/ISD.2024.55Online publication date: 2024
https://doi.org/10.62036/ISD.2024.55
Islam MHsing HKim SLau NNussbaum MLim S(2024)Multimodal Feedback to Improve Performance of Order Picker Truck Drivers Using a Virtual Reality SimulatorProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/1071181324127212868:1(1039-1041)Online publication date: 21-Oct-2024
https://doi.org/10.1177/10711813241272128
Show More Cited By

Index Terms

Using augmented reality to assist forklift operation
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Recommendations

Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2

An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...
Extending Virtual Reality Display Wall Environments Using Augmented Reality
SUI '19: Symposium on Spatial User Interaction

Two major form factors for virtual reality are head-mounted displays and large display environments such as CAVE®and the LCD-based successor CAVE2®. Each of these has distinct advantages and limitations based on how they’re used. This work explores ...
Multimodal augmented reality: the norm rather than the exception
MVAR '16: Proceedings of the 2016 workshop on Multimodal Virtual and Augmented Reality

Augmented reality (AR) is commonly seen as a technology that overlays virtual imagery onto a participant's view of the world. In line with this, most AR research is focused on what we see. In this paper, we challenge this focus on vision and make a case ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

OzCHI '16: Proceedings of the 28th Australian Conference on Computer-Human Interaction

November 2016

706 pages

ISBN:9781450346184

DOI:10.1145/3010915

Conference Chairs:
Henry Duh
University of Tasmania Christopher Lueg, University of Tasmania
,
Christopher Lueg
University of Tasmania
,
Program Chairs:
Mark Billinghust
University of South Australia
,
Weidong Huang
University of Tasmania

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

IEEE-SMCS: Systems, Man & Cybernetics Society
Australian Comp Soc: Australian Computer Society
Data61: Data61, CSIRO
ICACHI: International Chinese Association of Computer Human Interaction
Infoxchange: Infoxchange
HITLab AU: Human Interface Technology Laboratory Australia
James Boag: James Boag
Tourism Tasmania: Tourism Tasmania
HFESA: Human Factors and Ergonomics Society of Australia Inc.
IEEEVIC: IEEE Victorian Section
UTAS: University of Tasmania, Australia

In-Cooperation

ACM: Association for Computing Machinery

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 November 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

OzCHI '16

Sponsor:

IEEE-SMCS
Australian Comp Soc
Data61
ICACHI
Infoxchange
HITLab AU
James Boag
Tourism Tasmania
HFESA
IEEEVIC
UTAS

OzCHI '16: The 28th Australian Conference on Human-Computer Interaction

November 29 - December 2, 2016

Tasmania, Launceston, Australia

Acceptance Rates

Overall Acceptance Rate 362 of 729 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
435
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)2

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tschulik MKernbauer TFleck PArth C(2025)Spatial Augmented Reality for Heavy Machinery Using Laser ProjectionsComputers & Graphics10.1016/j.cag.2024.104161126(104161)Online publication date: Feb-2025
https://doi.org/10.1016/j.cag.2024.104161
Starostka-Patyk MKościelniak HGrunt P(2024)From Industry 4.0 to Supply Chain 4.0 – The Digital Transformation Influencing SCM Processes of Manufacturing Enterprises with ICT SolutionsProceedings of the 32nd International Conference on Information Systems Development10.62036/ISD.2024.55Online publication date: 2024
https://doi.org/10.62036/ISD.2024.55
Islam MHsing HKim SLau NNussbaum MLim S(2024)Multimodal Feedback to Improve Performance of Order Picker Truck Drivers Using a Virtual Reality SimulatorProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/1071181324127212868:1(1039-1041)Online publication date: 21-Oct-2024
https://doi.org/10.1177/10711813241272128
Islam MLim S(2024)Sex and Age Differences in Virtual Reality (VR) Sickness Susceptibility in Forklift Driving SimulationProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/1071181324126885568:1(1206-1208)Online publication date: 18-Oct-2024
https://doi.org/10.1177/10711813241268855
Kernbauer TTschulik MFleck PArth C(2024)Spatial Augmented Reality for Heavy Machinery Using Laser Projections2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00047(235-243)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VRW62533.2024.00047
Islam MJamshid Nezhad Zahabi SKim SLau NNussbaum MLim S(2023)Forklift Driving Performance of Novices with Repeated VR-based TrainingProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/2169506723119366467:1(1480-1481)Online publication date: 19-Oct-2023
https://doi.org/10.1177/21695067231193664
Tainaka KFujimoto YSawabe TKanbara MKato H(2023)Selection framework of visualization methods in designing AR industrial task-support systemsComputers in Industry10.1016/j.compind.2022.103828145(103828)Online publication date: Feb-2023
https://doi.org/10.1016/j.compind.2022.103828
Zafarzadeh MWiktorsson MBaalsrud Hauge J(2021)A Systematic Review on Technologies for Data-Driven Production Logistics: Their Role from a Holistic and Value Creation PerspectiveLogistics10.3390/logistics50200245:2(24)Online publication date: 23-Apr-2021
https://doi.org/10.3390/logistics5020024
Fagerlönn JSirkka AOrrell LZhang YLarsson STybring ERönntoft H(2021)Designing Collaboration between Human Beings and Self-driving Heavy Vehicles with Emerging Interaction Technologies13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3473682.3480278(123-127)Online publication date: 9-Sep-2021
https://dl.acm.org/doi/10.1145/3473682.3480278
Sitompul TWallmyr MJorge JKim JVan Eyken HGlencross MMitchell KNarumi T(2019)Using Augmented Reality to Improve Productivity and Safety for Heavy Machinery Operators: State of the ArtProceedings of the 17th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry10.1145/3359997.3365689(1-9)Online publication date: 14-Nov-2019
https://dl.acm.org/doi/10.1145/3359997.3365689
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten