Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Open access

Learning Based Toolpath Planner on Diverse Graphs for 3D Printing

Published: 19 November 2024 Publication History

Abstract

This paper presents a learning based planner for computing optimized 3D printing toolpaths on prescribed graphs, the challenges of which include the varying graph structures on different models and the large scale of nodes & edges on a graph. We adopt an on-the-fly strategy to tackle these challenges, formulating the planner as a Deep Q-Network (DQN) based optimizer to decide the next 'best' node to visit. We construct the state spaces by the Local Search Graph (LSG) centered at different nodes on a graph, which is encoded by a carefully designed algorithm so that LSGs in similar configurations can be identified to re-use the earlier learned DQN priors for accelerating the computation of toolpath planning. Our method can cover different 3D printing applications by defining their corresponding reward functions. Toolpath planning problems in wire-frame printing, continuous fiber printing, and metallic printing are selected to demonstrate its generality. The performance of our planner has been verified by testing the resultant toolpaths in physical experiments. By using our planner, wire-frame models with up to 4.2k struts can be successfully printed, up to 93.3% of sharp turns on continuous fiber toolpaths can be avoided, and the thermal distortion in metallic printing can be reduced by 24.9%.

References

[1]
Minghao Bi, Lingwei Xia, Phuong Tran, Zhi Li, Qian Wan, Li Wang, Wei Shen, Guowei Ma, and Yi Min Xie. 2022. Continuous contour-zigzag hybrid toolpath for large format additive manufacturing. Additive Manufacturing 55 (2022), 102822.
[2]
Mathilde Boissier, Grégoire Allaire, and Christophe Tournier. 2022. Time dependent scanning path optimization for the powder bed fusion additive manufacturing process. Computer-Aided Design 142 (2022), 103122.
[3]
Lu Chang, Liang Shan, Chao Jiang, and Yuewei Dai. 2021. Reinforcement based mobile robot path planning with improved dynamic window approach in unknown environment. Autonomous Robots 45 (2021), 51--76.
[4]
Xiangjia Chen, Guoxin Fang, Wei-Hsin Liao, and Charlie CL Wang. 2022. Field-based toolpath generation for 3D printing continuous fibre reinforced thermoplastic composites. Additive Manufacturing 49 (2022), 102470.
[5]
Hao-Tien Lewis Chiang, Jasmine Hsu, Marek Fiser, Lydia Tapia, and Aleksandra Faust. 2019. RL-RRT: Kinodynamic motion planning via learning reachability estimators from RL policies. IEEE Robotics and Automation Letters 4, 4 (2019), 4298--4305.
[6]
Guoxin Fang, Tianyu Zhang, Sikai Zhong, Xiangjia Chen, Zichun Zhong, and Charlie CL Wang. 2020. Reinforced FDM: Multi-axis filament alignment with controlled anisotropic strength. ACM Transactions on Graphics (TOG) 39, 6 (2020), 1--15.
[7]
Matthias Fey and Jan E. Lenssen. 2019. Fast Graph Representation Learning with PyTorch Geometric. In ICLR Workshop on Representation Learning on Graphs and Manifolds.
[8]
Yisong Gao, Lifang Wu, Dong-Ming Yan, and Liangliang Nan. 2019. Near support-free multi-directional 3D printing via global-optimal decomposition. Graphical Models 104 (2019), 101034.
[9]
Prashant Gupta, Yiran Guo, Narasimha Boddeti, and Bala Krishnamoorthy. 2021. SFCDe-comp: Multicriteria optimized tool path planning in 3D printing using space-filling curve based domain decomposition. International Journal of Computational Geometry & Applications 31, 04 (2021), 193--220.
[10]
Dorit S Hochba. 1997. Approximation algorithms for NP-hard problems. ACM Sigact News 28, 2 (1997), 40--52.
[11]
Yuming Huang, Guoxin Fang, Tianyu Zhang, and Charlie CL Wang. 2023. Turning-angle optimized printing path of continuous carbon fiber for cellular structures. Additive Manufacturing 68 (2023), 103501.
[12]
Yijiang Huang, Juyong Zhang, Xin Hu, Guoxian Song, Zhongyuan Liu, Lei Yu, and Ligang Liu. 2016. Framefab: Robotic fabrication of frame shapes. ACM Transactions on Graphics (TOG) 35, 6 (2016), 1--11.
[13]
Michael Janner, Qiyang Li, and Sergey Levine. 2021. Offline reinforcement learning as one big sequence modeling problem. Advances in neural information processing systems 34 (2021), 1273--1286.
[14]
Caigui Jiang, Jun Wang, Johannes Wallner, and Helmut Pottmann. 2014. Freeform honeycomb structures. Computer Graphics Forum 33, 5 (2014), 185--194.
[15]
Chaitanya K Joshi, Quentin Cappart, Louis-Martin Rousseau, and Thomas Laurent. 2022. Learning the travelling salesperson problem requires rethinking generalization. Constraints 27, 1--2 (2022), 70--98.
[16]
Jeremy Kawahara, Colin J. Brown, Steven P. Miller, Brian G. Booth, Vann Chau, Ruth E. Grunau, Jill G. Zwicker, and Ghassan Hamarneh. 2017. BrainNetCNN: Convolutional neural networks for brain networks; towards predicting neurodevelopment. NeuroImage 146 (2017), 1038--1049.
[17]
DH Kim and TI Zohdi. 2022. Tool path optimization of selective laser sintering processes using deep learning. Computational Mechanics 69, 1 (2022), 383--401.
[18]
Thomas N. Kipf and Max Welling. 2017. Semi-Supervised Classification with Graph Convolutional Networks. In International Conference on Learning Representations. https://openreview.net/forum?id=SJU4ayYgl
[19]
Wouter Kool, Herke van Hoof, and Max Welling. 2018. Attention, Learn to Solve Routing Problems!. In International Conference on Learning Representations.
[20]
Steven M LaValle and James J Kuffner Jr. 2001. Randomized kinodynamic planning. The international journal of robotics research 20, 5 (2001), 378--400.
[21]
Charles Eric Leiserson, Ronald L Rivest, Thomas H Cormen, and Clifford Stein. 1994. Introduction to algorithms (3 ed.). MIT press.
[22]
Bruno Lévy, Sylvain Petitjean, Nicolas Ray, and Jérome Maillot. 2002. Least squares conformal maps for automatic texture atlas generation. ACM Trans. Graph. 21, 3 (jul 2002), 362--371.
[23]
Kang Liao, Thibault Tricard, Michal Piovarči, Hans-Peter Seidel, and Vahid Babaei. 2023. Learning Deposition Policies for Fused Multi-Material 3D Printing. In 2023 IEEE International Conference on Robotics and Automation (ICRA). 12345--12352.
[24]
Timothy P Lillicrap, Jonathan J Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, and Daan Wierstra. 2015. Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971 (2015).
[25]
Liangheng Lv, Sunjie Zhang, Derui Ding, and Yongxiong Wang. 2019. Path planning via an improved DQN-based learning policy. IEEE Access 7 (2019), 67319--67330.
[26]
Ryosuke Matsuzaki, Taishi Nakamura, Kentaro Sugiyama, Masahito Ueda, Akira Todoroki, Yoshiyasu Hirano, and Yusuke Yamagata. 2018. Effects of set curvature and fiber bundle size on the printed radius of curvature by a continuous carbon fiber composite 3D printer. Additive Manufacturing 24 (2018), 93--102.
[27]
Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, and Martin Riedmiller. 2013. Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602 (2013).
[28]
Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A Rusu, Joel Veness, Marc G Bellemare, Alex Graves, Martin Riedmiller, Andreas K Fidjeland, Georg Ostrovski, et al. 2015. Human-level control through deep reinforcement learning. nature 518, 7540 (2015), 529--533.
[29]
Lam Nguyen, Johannes Buhl, and Markus Bambach. 2020. Continuous Eulerian tool path strategies for wire-arc additive manufacturing of rib-web structures with machine-learning-based adaptive void filling. Additive Manufacturing 35 (2020), 101265.
[30]
Petter Ogren and Naomi Ehrich Leonard. 2005. A convergent dynamic window approach to obstacle avoidance. IEEE Transactions on Robotics 21, 2 (2005), 188--195.
[31]
Sushrut Pavanaskar, Sushrut Pande, Youngwook Kwon, Zhongyin Hu, Alla Sheffer, and Sara McMains. 2015. Energy-efficient vector field based toolpaths for CNC pocketmachining. Journal of Manufacturing Processes 20 (2015), 314--320.
[32]
Mark Pfeiffer, Samarth Shukla, Matteo Turchetta, Cesar Cadena, Andreas Krause, Roland Siegwart, and Juan Nieto. 2018. Reinforced imitation: Sample efficient deep reinforcement learning for mapless navigation by leveraging prior demonstrations. IEEE Robotics and Automation Letters 3, 4 (2018), 4423--4430.
[33]
Michal Piovarči, Michael Foshey, Jie Xu, Timmothy Erps, Vahid Babaei, Piotr Didyk, Szymon Rusinkiewicz, Wojciech Matusik, and Bernd Bickel. 2022. Closed-loop control of direct ink writing via reinforcement learning. ACM Transactions on Graphics (TOG) 41, 4 (2022), 1--10.
[34]
Mian Qin, Junhao Ding, Shuo Qu, Xu Song, Charlie CL Wang, and Wei-Hsin Liao. 2023a. Deep Reinforcement Learning Based Toolpath Generation for Thermal Uniformity in Laser Powder Bed Fusion Process. Additive Manufacturing (2023), 103937.
[35]
Mian Qin, Shuo Qu, Junhao Ding, Xu Song, Shiming Gao, Charlie CL Wang, and Wei-Hsin Liao. 2023b. Adaptive toolpath generation for distortion reduction in laser powder bed fusion process. Additive Manufacturing 64 (2023), 103432.
[36]
Chunlei Qiu, Nicholas JE Adkins, and Moataz M Attallah. 2013. Microstructure and tensile properties of selectively laser-melted and of HIPed laser-melted Ti-6Al-4V. Materials Science and Engineering: A 578 (2013), 230--239.
[37]
Keval S Ramani, Chuan He, Yueh-Lin Tsai, and Chinedum E Okwudire. 2022. SmartScan: An intelligent scanning approach for uniform thermal distribution, reduced residual stresses and deformations in PBF additive manufacturing. Additive Manufacturing 52 (2022), 102643.
[38]
Seyed Hamid Reza Sanei and Diana Popescu. 2020. 3D-printed carbon fiber reinforced polymer composites: a systematic review. Journal of Composites Science 4, 3 (2020), 98.
[39]
David Silver, Aja Huang, Chris J Maddison, Arthur Guez, Laurent Sifre, George Van Den Driessche, Julian Schrittwieser, Ioannis Antonoglou, Veda Panneershelvam, Marc Lanctot, et al. 2016. Mastering the game of Go with deep neural networks and tree search. Nature 529, 7587 (2016), 484--489.
[40]
David Silver, Julian Schrittwieser, Karen Simonyan, Ioannis Antonoglou, Aja Huang, Arthur Guez, Thomas Hubert, Lucas Baker, Matthew Lai, Adrian Bolton, et al. 2017. Mastering the game of go without human knowledge. Nature 550, 7676 (2017), 354--359.
[41]
Xingyuan Sun, Geoffrey Roeder, Tianju Xue, Ryan P Adams, and Szymon Rusinkiewicz. 2023. More stiffness with less fiber: End-to-end fiber path optimization for 3d-printed composites. In Proceedings of the 8th ACM Symposium on Computational Fabrication. 1--14.
[42]
Thomas George Thuruthel, Egidio Falotico, Federico Renda, and Cecilia Laschi. 2018. Model-based reinforcement learning for closed-loop dynamic control of soft robotic manipulators. IEEE Transactions on Robotics 35, 1 (2018), 124--134.
[43]
Binyu Wang, Zhe Liu, Qingbiao Li, and Amanda Prorok. 2020a. Mobile robot path planning in dynamic environments through globally guided reinforcement learning. IEEE Robotics and Automation Letters 5, 4 (2020), 6932--6939.
[44]
Junpeng Wang, Jun Wu, and Rüdiger Westermann. 2020b. A globally conforming lattice structure for 2D stress tensor visualization. Computer graphics forum 39, 3 (2020), 417--427.
[45]
Weiming Wang, Tuanfeng Y Wang, Zhouwang Yang, Ligang Liu, Xin Tong, Weihua Tong, Jiansong Deng, Falai Chen, and Xiuping Liu. 2013. Cost-effective printing of 3D objects with skin-frame structures. ACM Transactions on Graphics (ToG) 32, 6 (2013), 1--10.
[46]
Alexander J Wolfer, Jeremy Aires, Kevin Wheeler, Jean-Pierre Delplanque, Alexander Rubenchik, Andy Anderson, and Saad Khairallah. 2019. Fast solution strategy for transient heat conduction for arbitrary scan paths in additive manufacturing. Additive Manufacturing 30 (2019), 100898.
[47]
Chenming Wu, Rui Zeng, Jia Pan, Charlie C. L. Wang, and Yong-Jin Liu. 2019. Plant Phenotyping by Deep-Learning-Based Planner for Multi-Robots. IEEE Robotics and Automation Letters 4, 4 (2019), 3113--3120.
[48]
Rundong Wu, Huaishu Peng, François Guimbretière, and Steve Marschner. 2016. Printing arbitrary meshes with a 5DOF wireframe printer. ACM Transactions on Graphics (TOG) 35, 4 (2016), 1--9.
[49]
Kohei Yamamoto, Jose Victorio Salazar Luces, Keiichi Shirasu, Yamato Hoshikawa, Tomonaga Okabe, and Yasuhisa Hirata. 2022. A novel single-stroke path planning algorithm for 3D printers using continuous carbon fiber reinforced thermoplastics. Additive Manufacturing 55 (2022), 102816.
[50]
Eugene Zhang, Konstantin Mischaikow, and Greg Turk. 2005. Feature-based surface parameterization and texture mapping. ACM Transactions on Graphics (TOG) 24, 1 (2005), 1--27.
[51]
Guoquan Zhang, Yaohui Wang, Jian He, and Yi Xiong. 2022. A graph-based path planning method for additive manufacturing of continuous fiber-reinforced planar thin-walled cellular structures. Rapid Prototyping Journal ahead-of-print (2022).
[52]
Guoquan Zhang, Yaohui Wang, Jian He, and Yi Xiong. 2023. A graph-based path planning method for additive manufacturing of continuous fiber-reinforced planar thin-walled cellular structures. Rapid Prototyping Journal 29, 2 (2023), 344--353.
[53]
Haoqi Zhang, Jiayun Chen, and Dongmin Yang. 2021. Fibre misalignment and breakage in 3D printing of continuous carbon fibre reinforced thermoplastic composites. Additive Manufacturing 38 (2021), 101775.
[54]
Allan Zhao, Jie Xu, Mina Konaković-Luković, Josephine Hughes, Andrew Spielberg, Daniela Rus, and Wojciech Matusik. 2020. RoboGrammar: graph grammar for terrain-optimized robot design. ACM Trans. Graph. 39, 6, Article 188 (nov 2020), 16 pages.
[55]
Haisen Zhao, Fanglin Gu, Qi-Xing Huang, Jorge Garcia, Yong Chen, Changhe Tu, Bedrich Benes, Hao Zhang, Daniel Cohen-Or, and Baoquan Chen. 2016. Connected fermat spirals for layered fabrication. ACM Transactions on Graphics (TOG) 35, 4 (2016), 1--10.
[56]
Haisen Zhao, Hao Zhang, Shiqing Xin, Yuanmin Deng, Changhe Tu, Wenping Wang, Daniel Cohen-Or, and Baoquan Chen. 2018. DSCarver: decompose-and-spiral-carve for subtractive manufacturing. ACM Transactions on Graphics (TOG) 37, 4 (2018), 1--14.

Cited By

View all
  • (2025)Toolpath generation for high density spatial fiber printing guided by principal stressesComposites Part B: Engineering10.1016/j.compositesb.2025.112154295(112154)Online publication date: Apr-2025
  • (2025)Automated toolpath design of 3D concrete printing structural componentsAdditive Manufacturing10.1016/j.addma.2025.104662100(104662)Online publication date: Feb-2025

Index Terms

  1. Learning Based Toolpath Planner on Diverse Graphs for 3D Printing

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Graphics
    ACM Transactions on Graphics  Volume 43, Issue 6
    December 2024
    1828 pages
    EISSN:1557-7368
    DOI:10.1145/3702969
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 19 November 2024
    Published in TOG Volume 43, Issue 6

    Check for updates

    Author Tags

    1. toolpath planning
    2. wire-frame model
    3. continuous fiber
    4. powder bed fusion
    5. 3D printing
    6. reinforcement learning

    Qualifiers

    • Research-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)227
    • Downloads (Last 6 weeks)95
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)Toolpath generation for high density spatial fiber printing guided by principal stressesComposites Part B: Engineering10.1016/j.compositesb.2025.112154295(112154)Online publication date: Apr-2025
    • (2025)Automated toolpath design of 3D concrete printing structural componentsAdditive Manufacturing10.1016/j.addma.2025.104662100(104662)Online publication date: Feb-2025

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Login options

    Full Access

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media