extended-abstract

Multi-touch interface for controlling multiple mobile robots

Authors:

Jun Kato,

Daisuke Sakamoto,

Masahiko Inami,

Takeo IgarashiAuthors Info & Claims

CHI EA '09: CHI '09 Extended Abstracts on Human Factors in Computing Systems

Pages 3443 - 3448

https://doi.org/10.1145/1520340.1520500

Published: 04 April 2009 Publication History

Get Access

Abstract

We must give some form of a command to robots in order to have the robots do a complex task. An initial instruction is required even if they do their tasks autonomously. We therefore need interfaces for the operation and teaching of robots. Natural languages, joysticks, and other pointing devices are currently used for this purpose. These interfaces, however, have difficulty in operating multiple robots simultaneously. We developed a multi-touch interface with a top-down view from a ceiling camera for controlling multiple mobile robots. The user specifies a vector field followed by all robots on the view. This paper describes the user interface and its implementation, and future work of the project.

Supplementary Material

MOV File (p3443.mov)

Download
8.46 MB

References

[1]

Rogalla, O., Ehrenmann, M., Zollner, R., Becher, R., and Dillmann, R. Using Gesture and Speech Control for Command a Robot Assistant. In Proc. IEEE International Workshop on Robot and Human Interactive Communication, IEEE Press (2002), 454--459.

Crossref

Google Scholar

[2]

Fong, T., Thorpe, C., and Glass B. PdaDriver: A Handheld System for Remote Driving. In Proc. IEEE International Concefence on Advanced Robotics, 2003.

Google Scholar

[3]

Choi, Y.S., Anderson C.D., Glass J.D., and Kemp, C.C. Laser pointers and a touch screen: Intuitive Interfaces for Autonomous Mobile Manipulation for the Motor Impaired. In Proc. ACCESS Conference on Computers and Accessibility, ACM Press (2008), 225--232.

Digital Library

Google Scholar

[4]

Pham, D.T., Awadalla, M.H., and Eldukhri, E.E. Adaptive and cooperative mobile robots. In Proc. IMechE, 221 (3), 279--293, 2007.

Google Scholar

[5]

Fong, T., Thorpe, C., and Baur C. Multi-Robot Remote Driving With Collaborative Control. In IEEE Trans. on Industrial Electronics, 50(4), 699--704, August 2003.

Crossref

Google Scholar

[6]

Driewer, F., Sauer, M., and Schilling, K. Discussion of Challenges for User Interfaces in Human-Robot Teams. In Proc. European Conference on Mobile Robots, 2007.

Google Scholar

[7]

Han, J.Y. Low-cost multi-touch sensing through frustrated total internal reflection. In Proc. UIST 2005, ACM Press(2005), 115--118.

Digital Library

Google Scholar

[8]

Borenstein, J., and Koren Y. Real-Time Obstacle Avoidance for Fast Mobile Robots. In IEEE Trans. on Systems, Man and Cybernetics, 19(5), 1179--1187, October 1989.

Crossref

Google Scholar

[9]

Fukuchi, K., Rekimoto, J. Marble Market: Bimanual Interactive Game with a Body Shape Sensor. In Proc. ICEC 2007, Springer (2007), 374--380.

Digital Library

Google Scholar

[10]

Skubic, M., Anderson, D., Blisard, S., Perzanowski, D., and Schultz, A. Using a hand-drawn sketch to control a team of robots. Autonomous Robots, 22(4), 399--410, May 2007.

Digital Library

Google Scholar

[11]

Craig, W.R., Flocks, Herds, and Schools: A Distributed Behavioral Model. Computer Graphics, 21(4), 25--34, July 1987.

Digital Library

Google Scholar

Cited By

View all

Meyer JPrabhakar APinosky AAbraham ITaylor ASchlafly MPopovic KDiniz GTeich BSimidchieva BClark SMurphey T(2024)Scale-Invariant Specifications for Human–Swarm SystemsIEEE Transactions on Field Robotics10.1109/TFR.2024.34947211(276-291)Online publication date: 2024
https://doi.org/10.1109/TFR.2024.3494721
Jia YDong YXu BSun C(2023)TIUI: Touching Live Video for Telepresence OperationIEEE Transactions on Mobile Computing10.1109/TMC.2021.311255922:4(2458-2472)Online publication date: 1-Apr-2023
https://doi.org/10.1109/TMC.2021.3112559
Suzuki RKarim AXia THedayati HMarquardt N(2022)Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic InterfacesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517719(1-33)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517719
Show More Cited By

Index Terms

Multi-touch interface for controlling multiple mobile robots
1. Applied computing
  1. Operations research
    1. Industry and manufacturing
      1. Command and control
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

Sketch and run: a stroke-based interface for home robots
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Numerous robots have been developed, and some of them are already being used in homes, institutions, and workplaces. Despite the development of useful robot functions, the focus so far has not been on user interfaces of robots. General users of robots ...
Interactive Teleoperation Interface for Semi-autonomous Control of Robot Arms
CRV '14: Proceedings of the 2014 Canadian Conference on Computer and Robot Vision

We propose and develop an interactive semi-autonomous control of robot arms. Our system controls two interactions: (1) A user can naturally control a robot arm by a direct linkage to the arm motion from the tracked human skeleton. (2) An autonomous ...
Research into the application of AI robots in community home leisure interaction
Abstract
This paper focuses on comprehensive application of artificial intelligence robots for community-based leisure interaction. We propose a multiple-layer perceptron network to design and implement the intelligent interactive home robot system, which ...

Comments

Information & Contributors

Information

Published In

CHI EA '09: CHI '09 Extended Abstracts on Human Factors in Computing Systems

April 2009

2470 pages

ISBN:9781605582474

DOI:10.1145/1520340

General Chair:
Dan R. Olsen
Brigham Young University
,
Program Chairs:
Ken Hinckley
Microsoft Research
,
Meredith Ringel Morris
Microsoft Research
,
Scott Hudson
Carnegie Mellon University
,
Saul Greenberg
University of Calgary

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 April 2009

Check for updates

Author Tags

Qualifiers

Extended-abstract

Conference

CHI '09

Sponsor:

CHI '09: CHI Conference on Human Factors in Computing Systems

April 4 - 9, 2009

MA, Boston, USA

Acceptance Rates

CHI EA '09 Paper Acceptance Rate 385 of 1,130 submissions, 34%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

25
Total Citations
View Citations
1,354
Total Downloads

Downloads (Last 12 months)23
Downloads (Last 6 weeks)3

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Meyer JPrabhakar APinosky AAbraham ITaylor ASchlafly MPopovic KDiniz GTeich BSimidchieva BClark SMurphey T(2024)Scale-Invariant Specifications for Human–Swarm SystemsIEEE Transactions on Field Robotics10.1109/TFR.2024.34947211(276-291)Online publication date: 2024
https://doi.org/10.1109/TFR.2024.3494721
Jia YDong YXu BSun C(2023)TIUI: Touching Live Video for Telepresence OperationIEEE Transactions on Mobile Computing10.1109/TMC.2021.311255922:4(2458-2472)Online publication date: 1-Apr-2023
https://doi.org/10.1109/TMC.2021.3112559
Suzuki RKarim AXia THedayati HMarquardt N(2022)Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic InterfacesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517719(1-33)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517719
Merrad WHéloir AKolski CKrüger A(2021)RFID-based tangible and touch tabletop for dual reality in crisis management contextJournal on Multimodal User Interfaces10.1007/s12193-021-00370-216:1(31-53)Online publication date: 19-Mar-2021
https://doi.org/10.1007/s12193-021-00370-2
Kim LDrew DDomova VFollmer SBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)User-defined Swarm Robot ControlProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376814(1-13)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376814
Bier SLi RWang W(2020)A Full-Dimensional Robot Teleoperation Platform2020 11th International Conference on Mechanical and Aerospace Engineering (ICMAE)10.1109/ICMAE50897.2020.9178871(186-191)Online publication date: Jul-2020
https://doi.org/10.1109/ICMAE50897.2020.9178871
Johari KKarumpulli NTan U(2019)Complementing Speech Interaction Design with Touch for Multi-Robot SystemsTENCON 2019 - 2019 IEEE Region 10 Conference (TENCON)10.1109/TENCON.2019.8929506(1400-1405)Online publication date: Oct-2019
https://doi.org/10.1109/TENCON.2019.8929506
Merrad WHabib LHéloir AKolski CKrueger A(2019)Tangible tabletops and dual reality for crisis managementProcedia Computer Science10.1016/j.procs.2019.04.051151:C(369-376)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.1016/j.procs.2019.04.051
Shen YHenry JWang HHo EKomura TShum H(2018)Data‐Driven Crowd Motion Control With Multi‐Touch GesturesComputer Graphics Forum10.1111/cgf.1333337:6(382-394)Online publication date: 26-Mar-2018
https://doi.org/10.1111/cgf.13333
Kim YAhn EKim G(2017)Evaluation of hand-foot coordinated quadruped interaction for mobile applicationsJournal on Multimodal User Interfaces10.1007/s12193-017-0254-y11:4(315-325)Online publication date: 16-Nov-2017
https://doi.org/10.1007/s12193-017-0254-y
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

Supplementary Material

References

Cited By

Index Terms

Recommendations

Sketch and run: a stroke-based interface for home robots

Interactive Teleoperation Interface for Semi-autonomous Control of Robot Arms

Research into the application of AI robots in community home leisure interaction

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations