research-article

Applying spatial augmented reality to facilitate in-situ support for automotive spot welding inspection

Authors:

Roland Menassa,

Anthony Farrant,

Andrew SansomeAuthors Info & Claims

VRCAI '11: Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry

Pages 195 - 200

https://doi.org/10.1145/2087756.2087784

Published: 11 December 2011 Publication History

Abstract

In automotive manufacturing, the quality of spot welding on car bodies needs to be inspected frequently. Operators often only check different subsets of spots on different car bodies with a predetermined sequence. Currently, spot welding inspections rely on a printed drawing of the testing body, with the inspection points marked on this drawing. Operators have to locate the matching spot on the drawing and the body manually to perform the inspection. The manual inspection process suffers from inefficiencies and potential mistakes. This paper describes a system that projects visual data onto arbitrary surfaces for providing just-in-time information to a user in-situ within a physical work-cell. Spatial Augmented Reality (SAR) is the key technology utilized in our system. SAR facilitates presentation of projected digital Augmented Reality (AR) information on surfaces of car bodies. Four types of digital AR information are projected onto the surfaces of car body parts in structured work environments: 1) Location of spot welds; 2) Inspection methods; 3) Operation Description Sheet (ODS) information; 4) Visualization of weld locating methods. Various visualization methods are used to indicate the position of spot welds and the method used for spot welding inspection. Dynamical visualizations are used to assist operators to locate spot welds more easily. The SAR approach does not require additional special models in finding spot welds, but only needs knowledge of location of spot welds on the part. Our system allows operators becoming more effective and efficient to in performing proper inspections, by providing them the required information at the required time without the need to refer to paper-based manuals or computer terminals.

References

[1]

Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., and MacIntyre, B. 2001. Recent advances in augmented reality. Computer Graphics and Applications, IEEE 21, 6, 34--47.

Digital Library

[2]

Bimber, O., and Raskar, R. 2005. Modern approaches to augmented reality. In SIGGRAPH'05: ACM SIGGRAPH 2005 Courses, ACM, 1.

Digital Library

[3]

Bimber, O., and Raskar, R. 2005. Spatial Augmented Reality Merging Real and Virtual Worlds. A K Peters LTD.

Digital Library

[4]

Bimber, O., Coriand, F., Kleppe, A., Bruns, E., Zollmann, S., and Langlotz, T. 2005. Superimposing pictorial artwork with projected imagery. IEEE Multimedia 12, 1, 16--26.

Digital Library

[5]

Kojima, M., Sugimoto, M., Nakamura, A., Tomita, M., Nii, H., and Inami, M. 2006. Augmented coliseum: an augmented game environment with small vehicles. In TableTop 2006. First IEEE International Workshop on Horizontal Interactive Human-Computer Systems, IEEE, 6--pp.

Digital Library

[6]

Krempien, R., Hoppe, H., Kahrs, L., Daeuber, S., Schorr, O., Eggers, G., Bischof, M., Munter, M. W., Debus, J., and Harms, W. 2008. Projector-based augmented reality for intuitive intraoperative guidance in image-guided 3d interstitial brachytherapy. International Journal of Radiation Oncology Biology Physics 70, 3, 944--952.

[7]

Marner, M. R., and Thomas, B. H. 2010. Augmented foam sculpting for capturing 3d models. In Proceedings of IEEE Symposium on 3D User Interfaces (3DUI) 2010, 63--70.

Digital Library

[8]

Nicolau, S., Pennec, X., Soler, L., Buy, X., Gangi, A., Ayache, N., and Marescaux, J. 2009. An augmented reality system for liver thermal ablation: Design and evaluation on clinical cases. Medical Image Analysis 13, 3 (June), 494--506.

[9]

Olwal, A., Gustafsson, J., and Lindfors, C. 2008. Spatial augmented reality on industrial cnc-machines. In Proceedings of SPIE 2008 Electronic Imaging, vol. 6804 (The Engineering Reality of Virtual Reality 2008).

[10]

Porter, S., Marner, M., Smith, R., Zucco, J., and Thomas, B. 2010. Validating spatial augmented reality for interactive rapid prototyping. In 9th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), IEEE.

[11]

Raskar, R., Welch, G., and Fuchs, H. 1998. Spatially augmented reality. In Proceedings of IEEE and ACM IWAR'98 (1st International Workshop on Augmented Reality), 11--20.

Digital Library

[12]

Regenbrecht, H., Baratoff, G., and Wilke, W. 2005. Augmented reality projects in the automotive and aerospace industries. IEEE Computer Graphics and Applications 25 (November), 48--56.

Digital Library

[13]

Reiners, D., Stricker, D., Klinker, G., and Mueller, S. 1998. Augmented reality for construction tasks: Doorlock assembly. In Proceedings of IEEE and ACM IWAR'98 (1st International Workshop on Augmented Reality), 31--46.

Digital Library

[14]

Schwerdtfeger, B., and Klinker, G. 2007. Hybrid information presentation: Combining a portable augmented reality laser projector and a conventional computer display. In Proceedings of 13th Eurographics Symposium on Virtual Environments, 10th Immersive Projection Technology Workshop(IPT-EGVE 2007).

[15]

Schwerdtfeger, B., Hofhauser, A., and Klinker, G. 2008. An augmented reality laser projector using marker-less tracking. In Demonstration at 15th ACM Symposium on Virtual Reality Software and Technology (VRST'08).

[16]

Schwerdtfeger, B., Pustka, D., Hofhauser, A., and Klinker, G. 2008. Using laser projectors for augmented reality. In Proceedings of the 2008 ACM symposium on Virtual reality software and technology (VRST'08), 134--137.

Digital Library

[17]

Schwerdtfeger, B. 2009. Pick-by-Vision: Bringing HMD-based Augmented Reality into the Warehouse. PhD thesis, Institut für Informatik der Technischen Universität München.

[18]

Thomas, B., Demczuk, V., Piekarski, W., Hepworth, D., and Gunther, B. 1998. A wearable computer system with augmented reality to support terrestrial navigation. In Second International Symposium on Wearable Computers, IEEE Computer Society.

Digital Library

Cited By

Chojecki PStrazdas DPrzewozny DGard NRunde DHoerner NAl-Hamadi AEisert PBosse S(2023)Assessing the Value of Multimodal Interfaces: A Study on Human–Machine Interaction in Weld Inspection WorkstationsSensors10.3390/s2311504323:11(5043)Online publication date: 24-May-2023
https://doi.org/10.3390/s23115043
Frandsen JTenny JFrandsen WHovanski Y(2023)An augmented reality maintenance assistant with real-time quality inspection on handheld mobile devicesThe International Journal of Advanced Manufacturing Technology10.1007/s00170-023-10978-1125:9-10(4253-4270)Online publication date: 6-Feb-2023
https://doi.org/10.1007/s00170-023-10978-1
Wedral AVrecar REbenhofer GPönitz TWührer PWeiss AStübl G(2023)Spatial Augmented Reality in the Factory: Can In-Situ Projections Be Used to Communicate Dangers and Health Risks?Human-Computer Interaction – INTERACT 202310.1007/978-3-031-42283-6_31(574-594)Online publication date: 25-Aug-2023
https://doi.org/10.1007/978-3-031-42283-6_31
Show More Cited By

Index Terms

Applying spatial augmented reality to facilitate in-situ support for automotive spot welding inspection
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Recommendations

<italic>SoftAR</italic>: Visually Manipulating Haptic Softness Perception in Spatial Augmented Reality
We present SoftAR, a novel spatial augmented reality (AR) technique based on a pseudo-haptics mechanism that visually manipulates the sense of softness perceived by a user pushing a soft physical object. Considering the limitations of projection-based ...
A context-aware adaptation system for spatial augmented reality
ICDHM'11: Proceedings of the Third international conference on Digital human modeling

From an HCI point of view Augmented Reality (AR) displays have a very specific characteristic. The shown information consists of a virtual and a nearly uncontrollable and cluttering real part. Thus, AR visualizations can be ambiguous, imprecise, or ...
Influence of Variation of Welding Parameters on Spot Welding Quality
ISIC '11: Proceedings of the 2011 International Conference on Information Security and Intelligence Control

U-I images of mild steel welding spot have ellipse, double-ended and multi-ended models. When no splash happens, the U-I images shapes ellipse. If one splash happens in the welding, U-I curves shapes double-ended. If many, multi-ended shapes were found. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

VRCAI '11: Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry

December 2011

617 pages

ISBN:9781450310604

DOI:10.1145/2087756

General Chairs:
Zhi-Qiang Liu
City University of Hong Kong, China
,
Joaquim Jorge
Technical University of Lisbon, Portugal
,
Zhigeng Pan
China Society of Image and Graphics and Hangzhou Normal University, China
,
Program Chairs:
Xiaopeng Zhang
Institute of Automation, CAS, China
,
Oscar Kin-Chung Au
City University of Hong Kong
,
Weiming Dong
Institute of Automation, CAS, China

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
VT Committee of the China Society of Image and Graphics

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 December 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

VRCAI '11

Sponsor:

SIGGRAPH

VRCAI '11: The 10th International Conference on Virtual Reality Continuum and Its Applications in Industry

December 11 - 12, 2011

Hong Kong, China

Acceptance Rates

Overall Acceptance Rate 51 of 107 submissions, 48%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

37
Total Citations
View Citations
781
Total Downloads

Downloads (Last 12 months)36
Downloads (Last 6 weeks)2

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chojecki PStrazdas DPrzewozny DGard NRunde DHoerner NAl-Hamadi AEisert PBosse S(2023)Assessing the Value of Multimodal Interfaces: A Study on Human–Machine Interaction in Weld Inspection WorkstationsSensors10.3390/s2311504323:11(5043)Online publication date: 24-May-2023
https://doi.org/10.3390/s23115043
Frandsen JTenny JFrandsen WHovanski Y(2023)An augmented reality maintenance assistant with real-time quality inspection on handheld mobile devicesThe International Journal of Advanced Manufacturing Technology10.1007/s00170-023-10978-1125:9-10(4253-4270)Online publication date: 6-Feb-2023
https://doi.org/10.1007/s00170-023-10978-1
Wedral AVrecar REbenhofer GPönitz TWührer PWeiss AStübl G(2023)Spatial Augmented Reality in the Factory: Can In-Situ Projections Be Used to Communicate Dangers and Health Risks?Human-Computer Interaction – INTERACT 202310.1007/978-3-031-42283-6_31(574-594)Online publication date: 25-Aug-2023
https://doi.org/10.1007/978-3-031-42283-6_31
Havlíková KHořejší PKopeček P(2023)An Interactive Augmented Reality Tool to Enhance the Quality Inspection Process in Manufacturing—Pilot StudyResearch and Innovation Forum 202210.1007/978-3-031-19560-0_12(155-164)Online publication date: 15-Mar-2023
https://doi.org/10.1007/978-3-031-19560-0_12
Camba JHartman NBertoline G(2023)Computer-Aided Design, Computer-Aided Engineering, and VisualizationSpringer Handbook of Automation10.1007/978-3-030-96729-1_28(641-659)Online publication date: 17-Jun-2023
https://doi.org/10.1007/978-3-030-96729-1_28
Chouchene AVentura Carvalho ACharrua-Santos FBarhoumi W(2022)Augmented Reality-Based Framework Supporting Visual Inspection for Automotive IndustryApplied System Innovation10.3390/asi50300485:3(48)Online publication date: 6-May-2022
https://doi.org/10.3390/asi5030048
Ho PAlbajez JSantolaria JYagüe-Fabra J(2022)Study of Augmented Reality Based Manufacturing for Further Integration of Quality Control 4.0: A Systematic Literature ReviewApplied Sciences10.3390/app1204196112:4(1961)Online publication date: 13-Feb-2022
https://doi.org/10.3390/app12041961
Wagner PLengenfelder CHolzbach GBecker MBirnstill PVoit MBejhad ASamorei TBeyerer J(2021)Secure and Privacy-Respecting Documentation for Interactive Manufacturing and Quality AssuranceApplied Sciences10.3390/app1116733911:16(7339)Online publication date: 10-Aug-2021
https://doi.org/10.3390/app11167339
Gong LFast-Berglund AJohansson B(2021)A Framework for Extended Reality System Development in ManufacturingIEEE Access10.1109/ACCESS.2021.30567529(24796-24813)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3056752
Marino EBarbieri LColacino BFleri ABruno F(2021)An Augmented Reality inspection tool to support workers in Industry 4.0 environmentsComputers in Industry10.1016/j.compind.2021.103412127(103412)Online publication date: May-2021
https://doi.org/10.1016/j.compind.2021.103412
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents