abstract

PinpointFly: An Egocentric Position-pointing Drone Interface using Mobile AR

Authors:

Yoshifumi KitamuraAuthors Info & Claims

SA '19: SIGGRAPH Asia 2019 Emerging Technologies

Pages 34 - 35

https://doi.org/10.1145/3355049.3360534

Published: 17 November 2019 Publication History

Get Access

Abstract

We propose PinpointFly, an egocentric drone interface that allows users to arbitrarily position and rotate a flying drone using position control interactions on a see-through mobile AR where the position and direction of the drone are visually enhanced with a virtual cast shadow. Unlike traditional speed control methods, users hold a smartphone and precisely edit the drone’s motions and directions by dragging the cast shadow or a slider bar on the touchscreen.

References

[1]

Yu-An Chen, Mike Y. Chen, Te-Yen Wu, Tim Chang, Jun You Liu, Yuan-Chang Hsieh, Leon Yulun Hsu, Ming-Wei Hsu, Paul Taele, and Neng-Hao Yu. 2018. ARPilot: Designing and Investigating AR Shooting Interfaces on Mobile Devices for Drone Videography. In Proceedings of MobileHCI ’18. 42:1–42:8.

Digital Library

Google Scholar

[2]

Sergio Garrido-Jurado, Rafael Muñoz-Salinas, Francisco Madrid-Cuevas, and Rafael Medina-Carnicer. 2015. Generation of fiducial marker dictionaries using Mixed Integer Linear Programming. Pattern Recognition 51 (10 2015).

Digital Library

Google Scholar

[3]

Shunichi Kasahara, Ryuma Niiyama, Valentin Heun, and Hiroshi Ishii. 2013. exTouch: Spatially-aware Embodied Manipulation of Actuated Objects Mediated by Augmented Reality. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction(TEI ’13). ACM, 223–228. https://doi.org/10.1145/2460625.2460661

Digital Library

Google Scholar

[4]

Kiam Heong Ang, G. Chong, and Yun Li. 2005. PID control system analysis, design, and technology. IEEE Transactions on Control Systems Technology 13, 4 (July 2005), 559–576.

Google Scholar

[5]

Francisco Romero-Ramirez, Rafael Muñoz-Salinas, and Rafael Medina-Carnicer. 2018. Speeded Up Detection of Squared Fiducial Markers. Image and Vision Computing 76 (06 2018). https://doi.org/10.1016/j.imavis.2018.05.004

Crossref

Google Scholar

[6]

K. Yonezawa and T. Ogawa. 2015. Flying robot manipulation system using a virtual plane. In 2015 IEEE Virtual Reality (VR). 313–314. https://doi.org/10.1109/VR.2015.7223421

Crossref

Google Scholar

[7]

Shumin Zhai. 2002. Human Performance in Six Degree of Freedom Input Control.

Google Scholar

Cited By

View all

Kim HChang W(2022)Intuitive Drone Control using Motion Matching between a Controller and a DroneArchives of Design Research10.15187/adr.2022.02.35.1.9335:1(93-113)Online publication date: 28-Feb-2022
https://doi.org/10.15187/adr.2022.02.35.1.93
Suzuki RKarim AXia THedayati HMarquardt N(2022)Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic InterfacesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517719(1-33)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517719
Zoric FVasiljevic GOrsag MKovacic Z(2022)Towards Intuitive HMI for UAV Control2022 International Conference on Smart Systems and Technologies (SST)10.1109/SST55530.2022.9954775(325-332)Online publication date: 19-Oct-2022
https://doi.org/10.1109/SST55530.2022.9954775
Show More Cited By

Index Terms

PinpointFly: An Egocentric Position-pointing Drone Interface using Mobile AR
1. Computing methodologies
  1. Computer graphics
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
    2. Interaction paradigms

Index terms have been assigned to the content through auto-classification.

Recommendations

PinpointFly: An Egocentric Position-control Drone Interface using Mobile AR
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Accurate drone positioning is challenging because pilots only have a limited position and direction perception of a flying drone from their perspective. This makes conventional joystick-based speed control inaccurate and more complicated and ...
Campus guide system using drone and AR marker

This paper describes the design of a campus guide system using a drone. Recently, various types of unmanned aerial vehicles known as drones have been developed worldwide. The most important advantage of drones over conventional helicopters is probably ...
AR-Arm: Augmented Visualization for Guiding Arm Movement in the First-Person Perspective
AH '16: Proceedings of the 7th Augmented Human International Conference 2016

In many activities, such as martial arts, physical exercise, and physiotherapy, the users are asked to perform a sequence of body movements with highly accurate arm positions. Sometimes, the movements are too complicated for users to learn, even by ...

Comments

Information & Contributors

Information

Published In

SA '19: SIGGRAPH Asia 2019 Emerging Technologies

November 2019

54 pages

ISBN:9781450369428

DOI:10.1145/3355049

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 November 2019

Check for updates

Author Tags

Qualifiers

Abstract
Research
Refereed limited

Conference

SA '19

Sponsor:

SIGGRAPH

SA '19: SIGGRAPH Asia 2019

November 17 - 20, 2019

QLD, Brisbane, Australia

Acceptance Rates

Overall Acceptance Rate 178 of 869 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
375
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)2

Reflects downloads up to 11 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Kim HChang W(2022)Intuitive Drone Control using Motion Matching between a Controller and a DroneArchives of Design Research10.15187/adr.2022.02.35.1.9335:1(93-113)Online publication date: 28-Feb-2022
https://doi.org/10.15187/adr.2022.02.35.1.93
Suzuki RKarim AXia THedayati HMarquardt N(2022)Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic InterfacesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517719(1-33)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517719
Zoric FVasiljevic GOrsag MKovacic Z(2022)Towards Intuitive HMI for UAV Control2022 International Conference on Smart Systems and Technologies (SST)10.1109/SST55530.2022.9954775(325-332)Online publication date: 19-Oct-2022
https://doi.org/10.1109/SST55530.2022.9954775
Ribeiro RRamos JSafadinho DReis ARabadão CBarroso JPereira A(2021)Web AR Solution for UAV Pilot Training and Usability TestingSensors10.3390/s2104145621:4(1456)Online publication date: 19-Feb-2021
https://doi.org/10.3390/s21041456
Medeiros ARatsamee POrlosky JUranishi YHigashida MTakemura H(2021)3D pointing gestures as target selection tools: guiding monocular UAVs during window selection in an outdoor environmentROBOMECH Journal10.1186/s40648-021-00200-w8:1Online publication date: 16-Apr-2021
https://doi.org/10.1186/s40648-021-00200-w
Chen LTakashima KFujita KKitamura YKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)PinpointFly: An Egocentric Position-control Drone Interface using Mobile ARProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445110(1-13)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445110
Kiyokawa M(2020)SHIGGRAPH Asia 2019 Overview ReportSIGGRAPH Asia 2019参加報告The Journal of The Institute of Image Information and Television Engineers10.3169/itej.74.51274:3(512-515)Online publication date: 2020
https://doi.org/10.3169/itej.74.512
Alleaume VBaillard CFradet MJouet PLaurent ALuo T(2020)Introduction to AR-Bot, an AR system for robot navigationProceedings of the 26th ACM Symposium on Virtual Reality Software and Technology10.1145/3385956.3422112(1-2)Online publication date: 1-Nov-2020
https://dl.acm.org/doi/10.1145/3385956.3422112
Chacko SGranado ARajKumar AKapila V(2020)An Augmented Reality Spatial Referencing System for Mobile Robots2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS45743.2020.9340742(4446-4452)Online publication date: 24-Oct-2020
https://dl.acm.org/doi/10.1109/IROS45743.2020.9340742

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

References

Cited By

Index Terms

Recommendations

PinpointFly: An Egocentric Position-control Drone Interface using Mobile AR

Campus guide system using drone and AR marker

AR-Arm: Augmented Visualization for Guiding Arm Movement in the First-Person Perspective

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

HTML Format

Share

Share this Publication link

Share on social media

Affiliations