Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
SpringerLink
Log in

FC Portugal: RoboCup 2023 3D Simulation League Champions

  • Conference paper
  • First Online:
RoboCup 2023: Robot World Cup XXVI (RoboCup 2023)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 14140))

Included in the following conference series:

  • 298 Accesses

Abstract

FC Portugal, a team from the universities of Porto and Aveiro, achieved the second consecutive victory in the main competition of the 2023 RoboCup 3D Simulation League. The team registered 18 wins, 1 tie, and 3 losses, scoring a total of 109 goals while conceding only 13. The codebase used in this competition was developed in Python after RoboCup 2021. This paper presents a brief overview of its structure along with the new features developed for this year’s competition. The key developments include a revised dribble technique, designed to keep the ball further from the robot to prevent ball-holding fouls in compliance with new rules, and the introduction of a new programming language called TSAL. TSAL enables the creation of high-level team strategies in robotic soccer, combining deep symbolic reinforcement learning with human sub-optimal knowledge to optimize team tactics.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The official rules can be found at https://ssim.robocup.org/3d-simulation/3d-rules/.

  2. 2.

    https://us.softbankrobotics.com/nao.

  3. 3.

    3D magmaChallenge tool https://github.com/magmaOffenburg/magmaChallenge.

References

  1. Abdolmaleki, A., Simões, D., Lau, N., Reis, L.P., Neumann, G.: Learning a humanoid kick with controlled distance. In: Behnke, S., Sheh, R., Sarıel, S., Lee, D.D. (eds.) RoboCup 2016. LNCS (LNAI), vol. 9776, pp. 45–57. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-68792-6_4

    Chapter  Google Scholar 

  2. Abreu, M., Kasaei, M., Reis, L.P., Lau, N.: FC Portugal: RoboCup 2022 3D simulation league and technical challenge champions. In: Eguchi, A., Lau, N., Paetzel-Prüsmann, M., Wanichanon, T. (eds.) RoboCup 2022. LNCS, vol. 13561, pp. 313–324. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-28469-4_26

    Chapter  Google Scholar 

  3. Abreu, M., Lau, N., Sousa, A., Reis, L.P.: Learning low level skills from scratch for humanoid robot soccer using deep reinforcement learning. In: 2019 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC), pp. 256–263. IEEE (2019)

    Google Scholar 

  4. Abreu, M., Reis, L.P., Cardoso, H.L.: Learning high-level robotic soccer strategies from scratch through reinforcement learning. In: 2019 IEEE International Conference on Autonomous Robot Systems and Competitions, pp. 128–134. IEEE (2019)

    Google Scholar 

  5. Abreu, M., Reis, L.P., Lau, N.: Learning to run faster in a humanoid robot soccer environment through reinforcement learning. In: Chalup, S., Niemueller, T., Suthakorn, J., Williams, M.-A. (eds.) RoboCup 2019. LNCS (LNAI), vol. 11531, pp. 3–15. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-35699-6_1

    Chapter  Google Scholar 

  6. Abreu, M., Reis, L.P., Lau, N.: Addressing imperfect symmetry: a novel symmetry-learning actor-critic extension. arXiv preprint arXiv:2309.02711 (2023)

  7. Abreu, M., Silva, T., Teixeira, H., Reis, L.P., Lau, N.: 6D localization and kicking for humanoid robotic soccer. J. Intell. Robot. Syst. 102(2), 1–25 (2021)

    Article  Google Scholar 

  8. Amelia, E., et al.: magmaFatProxy (2023). https://github.com/magmaOffenburg/magmaFatProxy

  9. Boedecker, J., Asada, M.: SimSpark-concepts and application in the robocup 3D soccer simulation league. In: Proceedings of the SIMPAR-2008 Workshop on The Universe of RoboCup Simulators, Venice, Italy (2008)

    Google Scholar 

  10. Cravo, J.: SPlanner: Uma Aplicação Gráfica de Definição Flexível de Jogadas Estudadas no RoboCup. Master’s thesis, University of Porto, Porto, Portugal (2011)

    Google Scholar 

  11. Kasaei, M., Abreu, M., Lau, N., Pereira, A., Reis, L.P.: A CPG-based agile and versatile locomotion framework using proximal symmetry loss. arXiv preprint arXiv:2103.00928 (2021)

  12. Kasaei, M., Abreu, M., Lau, N., Pereira, A., Reis, L.P.: Robust biped locomotion using deep reinforcement learning on top of an analytical control approach. Robot. Auton. Syst. 146, 103900 (2021)

    Article  Google Scholar 

  13. Kasaei, M., Abreu, M., Lau, N., Pereira, A., Reis, L.P., Li, Z.: Learning hybrid locomotion skills - learn to exploit residual actions and modulate model-based gait control. Front. Robot. AI 10 (2023)

    Google Scholar 

  14. Kasaei, S.M., Simões, D., Lau, N., Pereira, A.: A hybrid ZMP-CPG based walk engine for biped robots. In: Ollero, A., Sanfeliu, A., Montano, L., Lau, N., Cardeira, C. (eds.) ROBOT 2017. AISC, vol. 694, pp. 743–755. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-70836-2_61

    Chapter  Google Scholar 

  15. MacAlpine, P., Liu, B., Macke, W., Wang, C., Stone, P.: UT Austin villa: RoboCup 2021 3D simulation league competition champions. In: Alami, R., Biswas, J., Cakmak, M., Obst, O. (eds.) RoboCup 2021. LNCS (LNAI), vol. 13132, pp. 314–326. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-98682-7_26

    Chapter  Google Scholar 

  16. Mota, L.: Multi-robot coordination using flexible setplays: applications in RoboCup’s simulation and middle-size leagues. Ph.D. thesis, University of Porto (2011)

    Google Scholar 

  17. Mota, L., Lau, N., Reis, L.P.: Co-ordination in RoboCup’s 2D simulation league: Setplays as flexible, multi-robot plans. In: 2010 IEEE Conference on Robotics, Automation and Mechatronics, pp. 362–367 (2010)

    Google Scholar 

  18. Mota, L., Reis, L.P.: Setplays: achieving coordination by the appropriate use of arbitrary pre-defined flexible plans and inter-robot communication. In: 1st International ICST Conference on Robot Communication and Coordination (2007)

    Google Scholar 

  19. Mota, L., Reis, L.P., Lau, N.: Multi-robot coordination using setplays in the middle size and simulation leagues. Mechatronics 21(2), 434–444 (2011)

    Article  Google Scholar 

  20. Mota, P.: A team strategy programming language applied to robotic soccer. Master’s thesis, University of Porto, Porto, Portugal (2023)

    Google Scholar 

  21. Reis, L.P., Almeida, F., Mota, L., Lau, N.: Coordination in multi-robot systems: applications in robotic soccer. In: Filipe, J., Fred, A. (eds.) ICAART 2012. CCIS, vol. 358, pp. 3–21. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-36907-0_1

    Chapter  Google Scholar 

  22. Reis, L.P., Lopes, R., Mota, L., Lau, N.: Playmaker: graphical definition of formations and setplays. In: 5th Iberian Conference on Information Systems and Technologies, pp. 1–6 (2010)

    Google Scholar 

  23. Schulman, J., Wolski, F., Dhariwal, P., Radford, A., Klimov, O.: Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 (2017)

  24. Simões, D., Amaro, P., Silva, T., Lau, N., Reis, L.P.: Learning low-level behaviors and high-level strategies in humanoid soccer. In: Silva, M.F., Luís Lima, J., Reis, L.P., Sanfeliu, A., Tardioli, D. (eds.) ROBOT 2019. AISC, vol. 1093, pp. 537–548. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-36150-1_44

    Chapter  Google Scholar 

  25. Simões, M.A., Mascarenhas, G., Fonseca, R., dos Santos, V.M., Mascarenhas, F., Nogueira, T.: Bahiart setplays collecting toolkit and BahiaRT gym. Softw. Impacts 14, 100401 (2022)

    Article  Google Scholar 

  26. Teixeira, H., Silva, T., Abreu, M., Reis, L.P.: Humanoid robot kick in motion ability for playing robotic soccer. In: 2020 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC), pp. 34–39. IEEE (2020)

    Google Scholar 

  27. Xu, Y., Vatankhah, H.: SimSpark: an open source robot simulator developed by the RoboCup community. In: Behnke, S., Veloso, M., Visser, A., Xiong, R. (eds.) RoboCup 2013. LNCS (LNAI), vol. 8371, pp. 632–639. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-662-44468-9_59

    Chapter  Google Scholar 

Download references

Acknowledgments

The first author was supported by the Foundation for Science and Technology (FCT) under grant SFRH/BD/139926/2018. Additionally, this research was financially supported by FCT/MCTES (PIDDAC), under projects UIDB/00027/2020 (LIACC) and UIDB/00127/2020 (IEETA).

Author information

Authors and Affiliations

  1. LIACC/LASI/FEUP, Artificial Intelligence and Computer Science Lab, Faculty of Engineering of the University of Porto, University of Porto, Porto, Portugal

    Miguel Abreu & Luís Paulo Reis

  2. LIACC/LASI/FCUP, Artificial Intelligence and Computer Science Lab, Faculty of Sciences of the University of Porto, University of Porto, Porto, Portugal

    Pedro Mota & Mário Florido

  3. IEETA/LASI/DETI, Institute of Electronics and Informatics Engineering of Aveiro, Department of Electronics, Telecommunications and Informatics, University of Aveiro, Aveiro, Portugal

    Nuno Lau

Authors
  1. Miguel Abreu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pedro Mota
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Luís Paulo Reis
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nuno Lau
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Mário Florido
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Miguel Abreu .

Editor information

Editors and Affiliations

  1. ENIB/Naval Group Pacific, Plouzané, France

    Cédric Buche

  2. University of Naples Federico II, Naples, Italy

    Alessandra Rossi

  3. Bahia State University, Salvador, Brazil

    Marco Simões

  4. University of Miami, Coral Gables, FL, USA

    Ubbo Visser

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Abreu, M., Mota, P., Reis, L.P., Lau, N., Florido, M. (2024). FC Portugal: RoboCup 2023 3D Simulation League Champions. In: Buche, C., Rossi, A., Simões, M., Visser, U. (eds) RoboCup 2023: Robot World Cup XXVI. RoboCup 2023. Lecture Notes in Computer Science(), vol 14140. Springer, Cham. https://doi.org/10.1007/978-3-031-55015-7_35

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-55015-7_35

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-55014-0

  • Online ISBN: 978-3-031-55015-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation