Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

One-shot, integrated positioning for welding initial points via co-mapping of cross and parallel stripes

Published: 01 December 2023 Publication History

Highlights

The main contributions of this paper are as follows:.
Improved efficiency: This study achieves a one-shot welding initial point positioning in a defined area with structured light mapping, which eliminates time consuming robot movement searches.
Strong integration: Four typical straight-edge seams are integrated into a self-developed integrated vision sensor for achieving welding initial point positioning with a high-competitive accuracy.
Enhanced robustness: Based on co-mapping cross and parallel stripes, this study can detect workpiece misalignment and perform welding initial point positioning even if the workpiece is tilted.
Besides, with the advantages of integration and controllability, the integrated vision sensor allows for a smooth transition to subsequent welding processes, such as seam identification or seam tracking.

Abstract

Robotic welding is gradually advancing towards intelligent integrated welding with integration of different seam types. In this process, the initial point positioning of weld seams is a foremost technique for ensuring a smooth subsequent welding process. However, existing studies on welding initial point positioning are not well integrated in terms of different groove shapes and generally require robot movement to search multiple times. This problem entails a high development cost in varying welding scenarios and with efficiency to be improved. Meanwhile, robustness of positioning is an ongoing challenge, represented by workpiece tilt and misalignment. To cope with these issues, we developed an integrated vision sensor based on co-mapping of cross and parallel stripes to achieve one-shot initial point positioning within a defined area for four typical seam types. Among them, the cross stripes are used to extract workpiece edge parameters and the parallel stripes to extract seam parameters, both are sequential. At the core, we proposed an interval-restricted search algorithms to extract the seam points, and combine it with the edge parameters to obtain the initial points. In addition, a series of parametric analyses are performed for detecting workpiece misalignment and determining the initial points. Experimental results show that the co-mapping of cross and parallel stripes achieves one-shot high-competitive accuracy for the initial point positioning of the four seam types even if the workpiece is tilted or misaligned.

References

[1]
N. Wang, K. Zhong, X. Shi, X. Zhang, A robust weld seam recognition method under heavy noise based on structured-light vision, Robot. Comput. -Integr. Manuf. 61 (2020).
[2]
Y. Tian, et al., Robust identification of weld seam based on region of interest operation, Adv. Manuf. 8 (4) (2020) 473–485.
[3]
X. Li, X. Li, S.S. G.e, M.O. K.hyam, C. Luo, Automatic Welding Seam Tracking and Identification, IEEE Trans. Ind. Electron. 64 (9) (2017) 7261–7271.
[4]
S. Chen, J. Liu, B. Chen, et al., Universal fillet weld joint recognition and positioning for robot welding using structured light, Robot. Comput. -Integr. Manuf. 74 (2022).
[5]
Y. Xu, G. Fang, S. Chen, J.J. Z.ou, Z. Ye, Real-time image processing for vision-based weld seam tracking in robotic GMAW, Int. J. Adv. Manuf. Technol. 73 (9–12) (2014) 1413–1425.
[6]
Feng J, L. Li, Y. Chen, et al., Inhomogeneous microstructure and fatigue crack propagation of thick-section high strength steel joint welded using double-sided hybrid fiber laser-arc welding, Opt. Laser Technol. 134 (2021).
[7]
Y. Zhang, H.G. S.oon, D. Ye, J.Y.H. Fuh, K. Zhu, Powder-bed fusion process monitoring by machine vision with hybrid convolutional neural networks, IEEE Trans. Ind. Inform. 16 (9) (2020) 5769–5779.
[8]
S. Wei, H. Ma, T. Lin, S. Chen, Autonomous guidance of initial welding position with single camera and double positions method, Sens. Rev. 20 (1) (2010) 62–68.
[9]
D. Chang, et al., A new seam-tracking algorithm through characteristic point detection for a portable welding robot, Robot. Comput. -Integr. Manuf. 28 (1) (2012) 1–13.
[10]
J. Le, H. Zhang, Y. Xiao, Circular fillet weld tracking in GMAW by robots based on rotating arc sensors, Int. J. Adv. Manuf. Technol. 88 (9/12) (2017) 2705–2715.
[11]
X. Gao, L. Mo, D. You, et al., Tight butt joint weld detection based on optical flow and particle filtering of magneto-optical imaging, Mech. Syst. Signal Proc. 96 (2017) 16–30.
[12]
M. Dinham, G. Fang, Detection of fillet weld joints using an adaptive line growing algorithm for robotic arc welding, Robot. Comput. -Integr. Manuf. 30 (3) (2014) 229–243.
[13]
K. Prasarn, Z. Fang, M. Tan, Visual recognition of the initial and end points of lap joint for welding robots, in: 2014 IEEE International Conference on Information and Automation (ICIA), IEEE, 2014.
[14]
X.Z. C.hen, S.B. C.hen, The autonomous detection and guiding of start welding position for arc welding robot, Indus. Robot: Int. J. 37 (1) (2010) 70–78.
[15]
Z. Fang, D. Xu, M. Tan, Vision-based initial weld point positioning using the geometric relationship between two seams, Int. J. Adv. Manuf. Technol. 66 (9–12) (2012) 1535–1543.
[16]
Y. Lu, X. Xu, L. Wang, Smart manufacturing process and system automation – a critical review of the standards and envisioned scenarios, J. Manuf. Syst. 56 (2020) 312–325.
[17]
H. Zheng, Y. Sun, D. Kong, et al., Deep learning-based high-accuracy quantitation for lumbar intervertebral disc degeneration from MRI, Nat. Commun. 13 (1) (2022) 1–12.
[18]
H.N.M. Shah, M. Sulaiman, A.Z. S.hukor, Z. Kamis, A.A. R.ahman, Butt welding joints recognition and location identification by using local thresholding, Robot. Comput. -Integr. Manuf. 51 (2018) 181–188.
[19]
Y. Ding, W. Huang, R. Kovacevic, An on-line shape-matching weld seam tracking system, Robot. Comput. -Integr. Manuf. 42 (2016) 103–112.
[20]
L. Yang, E. Li, T. Long, J. Fan, Z. Liang, A High-Speed Seam Extraction Method Based on the Novel Structured-Light Sensor for Arc Welding Robot: a Review, IEEE Sens. J. 18 (21) (2018) 8631–8641.
[21]
K. Zhang, Y. Chen, H. Gui, D. Li, Z. Li, Identification of the deviation of seam tracking and weld cross type for the derusting of ship hulls using a wall-climbing robot based on three-line laser structural light, J. Manuf. Process. 35 (2018) 295–306.
[22]
J. Fan, et al., An initial point alignment and seam-tracking system for narrow weld, IEEE Trans. Ind. Inform. 16 (2) (2020) 877–886.
[23]
W.J. S.hao, Y. Huang, Y. Zhang, A novel weld seam detection method for space weld seam of narrow butt joint in laser welding, Opt. Laser Technol. 99 (2018) 39–51.
[24]
T. Lei, W. Wang, Y. Rong, P. Xiong, Y. Huang, Cross-lines laser aided machine vision in tube-to-tubesheet welding for welding height control, Opt. Laser Technol. 121 (2020).
[25]
L. Zhang, Q. Ye, W. Yang, J. Jiao, Weld line detection and tracking via spatial-temporal cascaded hidden markov models and cross structured light, IEEE Trans. Instrum. Meas. 63 (4) (2014) 742–753.
[26]
P. Xu, G. Xu, X. Tang, S. Yao, A visual seam tracking system for robotic arc welding, Int. J. Adv. Manuf. Technol. 37 (1–2) (2017) 70–75.
[27]
D. Iakovou, R. Aarts, J. Meijer, Sensor integration for robotic laser welding processes, International Congress on Applications of Lasers & Electro-Optics, 2005, Laser Institute of America, 2005, Vol.1.
[28]
J. Fan, F. Jing, L. Yang, T. Long, M. Tan, An initial point alignment method of narrow weld using laser vision sensor, Int. J. Adv. Manuf. Technol. 102 (1–4) (2019) 201–212.
[29]
F. Liu, Z. Wang, Y. Ji, Precise initial weld position identification of a fillet weld seam using laser vision technology, Int. J. Adv. Manuf. Technol. 99 (5–8) (2018) 2059–2068.
[30]
R. Du, Y. Xu, Z. Hou, J. Shu, S. Chen, Strong noise image processing for vision-based seam tracking in robotic gas metal arc welding, Int. J. Adv. Manuf. Technol. 101 (5–8) (2018) 2135–2149.
[31]
J. Fan, F. Jing, Z. Fang, M. Tan, Automatic recognition system of welding seam type based on SVM method, Int. J. Adv. Manuf. Technol. 92 (1–4) (2017) 989–999.
[32]
Y. Tian, et al., Automatic Identification of Multi-Type Weld Seam Based on Vision Sensor with Silhouette-Mapping, IEEE Sens. J. 21 (4) (2021) 5402–5412.
[33]
W. Huang, R. Kovacevic, Development of a real-time laser-based machine vision system to monitor and control welding processes, Int. J. Adv. Manuf. Technol. 63 (1–4) (2012) 235–248.
[34]
W. Li, et al., Multiple weld seam laser vision recognition method based on the IPCE algorithm, Opt. Laser Technol. 155 (2022).
[35]
R. Miao, Z. Shan, Q. Zhou, et al., Real-time defect identification of narrow overlap welds and application based on convolutional neural networks, J. Manuf. Syst. 62 (2022) 800–810.
[36]
F. Bologna, M. Tannous, D. Romano, et al., Automatic welding imperfections detection in a smart factory via 2-D laser scanner, J. Manuf. Process. 73 (2022) 948–960.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Robotics and Computer-Integrated Manufacturing
Robotics and Computer-Integrated Manufacturing  Volume 84, Issue C
Dec 2023
313 pages

Publisher

Pergamon Press, Inc.

United States

Publication History

Published: 01 December 2023

Author Tags

  1. Welding initial point positioning
  2. Seam type integration
  3. Workpiece misalignment
  4. Structured-light mapping
  5. Intelligent integrated welding

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 15 Oct 2024

Other Metrics

Citations

View Options

View options

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media