demonstration

MARIM: Mobile Augmented Reality for Interactive Manuals

Authors:

Tam V. Nguyen,

Dorothy Tan,

Bilal Mirza,

Jose SepulvedaAuthors Info & Claims

MM '16: Proceedings of the 24th ACM international conference on Multimedia

Pages 689 - 690

https://doi.org/10.1145/2964284.2973807

Published: 01 October 2016 Publication History

Get Access

Abstract

In this work, we present a practical system which uses mobile devices for interactive manuals. In particular, there are two modes provided in the system, namely, expert/trainer and trainee modes. Given the expert/trainer editor, experts design the step-by-step interactive manuals. For each step, the experts capture the images by using phones/tablets and provide visual instructions such as interest regions, text, and action animations. In the trainee mode, the system utilizes the existing object detection and tracking algorithms to identify the step scene and retrieve the respective instruction to be displayed on the mobile device. The trainee then follows the displayed instruction. Once each step is performed, the trainee commands the devices to proceed to the next step.

References

[1]

YouTube. http://www.youtube.com/.

Google Scholar

[2]

Instructables. http://www.instructables.com/.

Google Scholar

[3]

WikiHow. http://www.wikihow.com/.

Google Scholar

[4]

Epson Moverio glasses. https://www.epson.com/cgi-bin/Store/jsp/Landing/moverio-bt-2000-smart-headset.do.

Google Scholar

[5]

D. Lowe. Distinctive image features from scale-invariant keypoints. IJCV, 60(2):91--110, 2004.

Digital Library

Google Scholar

[6]

T. V. Nguyen and J. Sepulveda. Salient object detection via augmented hypotheses. In IJCAI, pages 2176--2182, 2015.

Digital Library

Google Scholar

[7]

G. Stockman and L. G. Shapiro. Computer Vision. Prentice Hall PTR, Upper Saddle River, NJ, USA, 1st edition, 2001.

Digital Library

Google Scholar

Cited By

View all

Palmarini RDel Amo IAriansyah DKhan SErkoyuncu JRoy R(2023)Fast Augmented Reality Authoring: Fast Creation of AR Step-by-Step Procedures for Maintenance OperationsIEEE Access10.1109/ACCESS.2023.323587111(8407-8421)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3235871
Nguyen TRaghunath SPhung KOngwere TTran M(2022)Revisiting natural user interaction in virtual worldJournal of Ambient Intelligence and Humanized Computing10.1007/s12652-022-04496-314:3(2443-2453)Online publication date: 7-Dec-2022
https://doi.org/10.1007/s12652-022-04496-3
Tan SArshad HAbdullah A(2021)An improved colour binary descriptor algorithm for mobile augmented realityVirtual Reality10.1007/s10055-021-00519-0Online publication date: 11-May-2021
https://doi.org/10.1007/s10055-021-00519-0
Show More Cited By

Index Terms

MARIM: Mobile Augmented Reality for Interactive Manuals
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Mixed / augmented reality
    2. Image manipulation
      1. Image processing

Recommendations

ASMIM: Augmented Reality Authoring System for Mobile Interactive Manuals
IMCOM '18: Proceedings of the 12th International Conference on Ubiquitous Information Management and Communication

In this paper, we introduce a practical system which uses mobile devices for interactive manuals. In particular, there are two modes provided in the system, namely, expert/trainer and trainee modes. Given the expert/trainer editor, experts design the ...
Dropping Hints: Visual Hints for Improving Learning using Mobile Augmented Reality
SUI '24: Proceedings of the 2024 ACM Symposium on Spatial User Interaction

In traditional learning, students frequently need help mastering mathematical concepts due to the complexity of the content and static and non-interactive teaching methods. However, the ubiquity of mobile phones and their enabling impact on Augmented ...
Jigsaw: Authoring Immersive Storytelling Experiences with Augmented Reality and Internet of Things
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

Augmented Reality (AR) presents new opportunities for immersive storytelling. However, this immersiveness faces two main hurdles. First, AR’s immersive quality is often confined to visual elements, such as pixels on a screen. Second, crafting immersive ...

Comments

Information & Contributors

Information

Published In

MM '16: Proceedings of the 24th ACM international conference on Multimedia

October 2016

1542 pages

ISBN:9781450336031

DOI:10.1145/2964284

General Chairs:
Alan Hanjalic
Delft University of Technology
,
Cees Snoek
Qualcomm Research Netherlands / University of Amsterdam
,
Marcel Worring
University of Amsterdam
,
Moderator:
Dick Bulterman
CWI / VU University Amsterdam
,
Program Chairs:
Benoit Huet
EURECOM
,
Aisling Kelliher
Virginia Tech
,
Yiannis Kompatsiaris
CERTH-ITI
,
Jin Li
Microsoft

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2016

Check for updates

Author Tags

Qualifiers

Demonstration

Funding Sources

Singapore Ministry of Education

Conference

MM '16

Sponsor:

SIGMM

MM '16: ACM Multimedia Conference

October 15 - 19, 2016

Amsterdam, The Netherlands

Acceptance Rates

MM '16 Paper Acceptance Rate 52 of 237 submissions, 22%;

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
291
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)1

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Palmarini RDel Amo IAriansyah DKhan SErkoyuncu JRoy R(2023)Fast Augmented Reality Authoring: Fast Creation of AR Step-by-Step Procedures for Maintenance OperationsIEEE Access10.1109/ACCESS.2023.323587111(8407-8421)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3235871
Nguyen TRaghunath SPhung KOngwere TTran M(2022)Revisiting natural user interaction in virtual worldJournal of Ambient Intelligence and Humanized Computing10.1007/s12652-022-04496-314:3(2443-2453)Online publication date: 7-Dec-2022
https://doi.org/10.1007/s12652-022-04496-3
Tan SArshad HAbdullah A(2021)An improved colour binary descriptor algorithm for mobile augmented realityVirtual Reality10.1007/s10055-021-00519-0Online publication date: 11-May-2021
https://doi.org/10.1007/s10055-021-00519-0
Nguyen TKamma SAdari VLesthaeghe TBoehnlein TKramb V(2020)Mixed reality system for nondestructive evaluation trainingVirtual Reality10.1007/s10055-020-00483-1Online publication date: 19-Nov-2020
https://doi.org/10.1007/s10055-020-00483-1
Nguyen TMirza BTan DSepulveda J(2018)ASMIMProceedings of the 12th International Conference on Ubiquitous Information Management and Communication10.1145/3164541.3164592(1-6)Online publication date: 5-Jan-2018
https://dl.acm.org/doi/10.1145/3164541.3164592
Apaza YTumailla RHancco WPaz-Valderrama ACorrales-Delgado CLoaiza M(2018)Systematic Mapping Study on High-Level Content Design Frameworks for Augmented Reality2018 20th Symposium on Virtual and Augmented Reality (SVR)10.1109/SVR.2018.00037(192-201)Online publication date: Oct-2018
https://doi.org/10.1109/SVR.2018.00037

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

ASMIM: Augmented Reality Authoring System for Mobile Interactive Manuals

Dropping Hints: Visual Hints for Improving Learning using Mobile Augmented Reality

Jigsaw: Authoring Immersive Storytelling Experiences with Augmented Reality and Internet of Things

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations