research-article

Using competitions to advance the development of standard test methods for response robots

Authors:

Jackrit SuthakornAuthors Info & Claims

PerMIS '12: Proceedings of the Workshop on Performance Metrics for Intelligent Systems

Pages 182 - 189

https://doi.org/10.1145/2393091.2393126

Published: 20 March 2012 Publication History

Get Access

Abstract

Competitions are an effective aid to the development and dissemination of standard test methods, especially in rapidly developing, fields with a wide variety of requirements and capabilities such as Urban Search and Rescue robotics. By exposing the development process to highly developmental systems that push the boundaries of current capabilities, it is possible to gain an insight into how the test methods will respond to the robots of the future. The competition setting also allows for the rapid iterative refinement of the test methods and apparatuses in response to new developments.

For the research community, introducing the concepts behind the test methods at the research and development stage can also help to guide their work towards the operationally relevant requirements embodied by the test methods and apparatuses. This also aids in the dissemination of the test methods themselves as teams fabricate them in their own laboratories and re-use them in work outside the competition.

In this paper, we discuss how international competitions, and in particular the RoboCupRescue Robot League competition, have played a crucial role in the development of standard test metrics for response robots as part of the ASTM International Committee of Homeland Security Applications; Operational Equipment; Robots (E54.08.01). We will also discuss how the competition has helped to drive a vibrant robot developer community towards solutions that are relevant to first responders.

References

[1]

ASTM International. E2826 Standard Test Method for Evaluating Emergency Response Robot Capabilities: Mobility: Confined Area Terrains: Continuous Pitch/Roll Ramps. Technical report, ASTM International, 2011.

Google Scholar

[2]

ASTM International. E2827 Standard Test Method for Evaluating Emergency Response Robot Capabilities: Mobility: Confined Area Terrains: Crossing Pitch/Roll Ramps. Technical report, ASTM International, 2011.

Google Scholar

[3]

ASTM International. E2828 Standard Test Method for Evaluating Emergency Response Robot Capabilities: Mobility: Confined Area Terrains: Symmetric Stepfields. Technical report, ASTM International, 2011.

Google Scholar

[4]

R. J. Full, K. Autumn, J. I. Chung, and A. Ahn. Rapid negotiation of rough terrain by the death-head cockroach. American Zoologist, 38: 81A, 1998.

Google Scholar

[5]

A. Jacoff, A. Downs, A. Virts, and E. Messina. Stepfield Pallets: Repeatable Terrain for Evaluating Robot Mobility. In Performance Metrics for Intelligent Systems Workshop, 2008.

Digital Library

Google Scholar

[6]

A. Jacoff, S. Tadokoro, E. Mihankhah, T. Kimra, J. Pellenz, A. Birk, J. Suthakorn, M. Hofbauer, and A. L. Gutierrez. RoboCupRescue Robot League: Rules 2011.2. http://www.nist.gov/el/isd/upload/Robocup_Rules_2011.pdf, 2011.

Google Scholar

[7]

S. Schwertfeger, A. Jacoff, C. Scrapper, J. Pellenz, and A. Kleiner. Evaluation of Maps using Fixed Shapes: The Fiducial Map Metric. In Performance Metrics for Intelligent Systems Workshop, 2010.

Digital Library

Google Scholar

[8]

R. Sheh, T. Kimura, E. Mihankhah, J. Pellenz, S. Schwertfeger, and J. Suthakorn. The RoboCupRescue Robot League: Guiding Robots Towards Fieldable Capabilities. In International Workshop on Advanced Robotics and Social Impacts, 2011.

Google Scholar

[9]

K. Shimaoka, K. Ogane, and T. Kimura. An Evaluation Test Field Design for a USAR Robot considering a Collapsed Japanese House. In International Symposium on Safety, Security and Rescue Robotics, 2011.

Crossref

Google Scholar

[10]

A. Virts, A. Jacoff, and A. Downs. RoboCupRescue Arena Assembly Guide 2011. http://www.nist.gov/el/isd/upload/2011_Assembly_Guide.pdf, 2011.

Google Scholar

Cited By

View all

Regnier RBarbosa VLecadre SDelaborde AKalouguine ACaon DGalibert OBernard G(2024)New Datasets on Artificial Intelligence for Weed Identification2024 IEEE International Conference on Omni-layer Intelligent Systems (COINS)10.1109/COINS61597.2024.10622108(1-5)Online publication date: 29-Jul-2024
https://doi.org/10.1109/COINS61597.2024.10622108
Daun KVon Stryk O(2023)Requirements and Challenges for Autonomy and Assistance Functions for Ground Rescue Robots in Reconnaissance Missions2023 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR)10.1109/SSRR59696.2023.10499930(83-90)Online publication date: 13-Nov-2023
https://doi.org/10.1109/SSRR59696.2023.10499930
Regnier RAvrin GBarbosa VBoffety DKalouguine ALardy-Fontan S(2021)Validation de méthodologies d’évaluation de solutions de désherbage autonomes, dans le cadre des projets Challenge ROSE et METRICS.Revue Ouverte d'Intelligence Artificielle10.5802/roia.82:1(11-32)Online publication date: 17-Nov-2021
https://doi.org/10.5802/roia.8
Show More Cited By

Using competitions to advance the development of standard test methods for response robots
1. Computer systems organization
  1. Embedded and cyber-physical systems
2. Computing methodologies
  1. Artificial intelligence
    1. Control methods
    2. Planning and scheduling

Recommendations

Design and Simulation of Autonomous Mobile Robots Obstacle Avoidance System
LNCS on Transactions on Edutainment XIII - Volume 10092

Autonomous mobile robot is a completely unknown or partially unknown, of its complex environment, which requires the ability to avoid obstacles in order to move safely and avoid the collisions while navigating. To solve this problem, it opted to propose ...
Attractor dynamics approach to joint transportation by autonomous robots: theory, implementation and validation on the factory floor

This paper shows how non-linear attractor dynamics can be used to control teams of two autonomous mobile robots that coordinate their motion in order to transport large payloads in unknown environments, which might change over time and may include ...
Robot simulation physics validation
PerMIS '07: Proceedings of the 2007 Workshop on Performance Metrics for Intelligent Systems

Computer simulation of robot performance is an essential tool for the development of robot software. In order for simulation results to be valid for implementation on real hardware, the accuracy of the simulation model must be verified. If developers ...

Comments

Information & Contributors

Information

Published In

PerMIS '12: Proceedings of the Workshop on Performance Metrics for Intelligent Systems

March 2012

243 pages

ISBN:9781450311267

DOI:10.1145/2393091

General Chair:
Elena Messina
NIST
,
Program Chair:
Raj Madhavan
UMD-CP/NIST

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SIGAI: ACM Special Interest Group on Artificial Intelligence

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 March 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

PerMIS'12

Sponsor:

University of Maryland
NIST

PerMIS'12: Performance Metrics for Intelligent Systems

March 20 - 22, 2012

Maryland, College Park

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
132
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)2

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Regnier RBarbosa VLecadre SDelaborde AKalouguine ACaon DGalibert OBernard G(2024)New Datasets on Artificial Intelligence for Weed Identification2024 IEEE International Conference on Omni-layer Intelligent Systems (COINS)10.1109/COINS61597.2024.10622108(1-5)Online publication date: 29-Jul-2024
https://doi.org/10.1109/COINS61597.2024.10622108
Daun KVon Stryk O(2023)Requirements and Challenges for Autonomy and Assistance Functions for Ground Rescue Robots in Reconnaissance Missions2023 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR)10.1109/SSRR59696.2023.10499930(83-90)Online publication date: 13-Nov-2023
https://doi.org/10.1109/SSRR59696.2023.10499930
Regnier RAvrin GBarbosa VBoffety DKalouguine ALardy-Fontan S(2021)Validation de méthodologies d’évaluation de solutions de désherbage autonomes, dans le cadre des projets Challenge ROSE et METRICS.Revue Ouverte d'Intelligence Artificielle10.5802/roia.82:1(11-32)Online publication date: 17-Nov-2021
https://doi.org/10.5802/roia.8
Daun KSchnaubelt MKohlbrecher Svon Stryk O(2021)HectorGrapher: Continuous-time Lidar SLAM with Multi-resolution Signed Distance Function Registration for Challenging Terrain2021 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR)10.1109/SSRR53300.2021.9597690(152-159)Online publication date: 25-Oct-2021
https://dl.acm.org/doi/10.1109/SSRR53300.2021.9597690
Gabdrahmanov RTsoy TBai YSvinin MMagid E(2021)Automatic Generation of Random Step Environment Models for Gazebo SimulatorRobotics for Sustainable Future10.1007/978-3-030-86294-7_36(408-420)Online publication date: 4-Sep-2021
https://doi.org/10.1007/978-3-030-86294-7_36
Daun KKohlbrecher SSturm Jvon Stryk O(2019)Large Scale 2D Laser SLAM using Truncated Signed Distance Functions2019 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR)10.1109/SSRR.2019.8848964(222-228)Online publication date: Sep-2019
https://doi.org/10.1109/SSRR.2019.8848964
Miura HWatanabe AOkugawa MMiura TKoganeya T(2019)Plant inspection by using a ground vehicle and an aerial robot: lessons learned from plant disaster prevention challenge in world robot summit 2018Advanced Robotics10.1080/01691864.2019.169057534:2(104-118)Online publication date: 17-Nov-2019
https://doi.org/10.1080/01691864.2019.1690575
Baumgartner LKohlbrecher SEuler JRitter TStute MMeurisch CMuhlhauser MHollick Mvon Stryk OFreisleben B(2017)Emergency communication in challenged environments via unmanned ground and aerial vehicles2017 IEEE Global Humanitarian Technology Conference (GHTC)10.1109/GHTC.2017.8239244(1-9)Online publication date: Oct-2017
https://doi.org/10.1109/GHTC.2017.8239244
Schwertfeger SYu T(2016)Matching Paths in Topological MapsIFAC-PapersOnLine10.1016/j.ifacol.2016.07.73649:15(224-229)Online publication date: 2016
https://doi.org/10.1016/j.ifacol.2016.07.736
Sheh RSchwertfeger SVisser A(2016)16 Years of RoboCup RescueKI - Künstliche Intelligenz10.1007/s13218-016-0444-x30:3-4(267-277)Online publication date: 16-Aug-2016
https://doi.org/10.1007/s13218-016-0444-x
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

Design and Simulation of Autonomous Mobile Robots Obstacle Avoidance System

Attractor dynamics approach to joint transportation by autonomous robots: theory, implementation and validation on the factory floor

Robot simulation physics validation

Comments

Published In

Sponsors

In-Cooperation

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

References

Cited By

Recommendations

Design and Simulation of Autonomous Mobile Robots Obstacle Avoidance System

Attractor dynamics approach to joint transportation by autonomous robots: theory, implementation and validation on the factory floor

Robot simulation physics validation

Comments

Information

Published In

Sponsors

In-Cooperation

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations