EyesOnMe: Investigating Haptic and Visual User Guidance for Near-Eye Positioning of Mobile Phones for Self-Eye-Examinations
Article No.: 133, Pages 1 - 10
Abstract
The scarcity of professional ophthalmic equipment in rural areas and during exceptional situations such as the COVID-19 pandemic highlights the need for tele-ophthalmology. This late-breaking work presents a novel method for guiding users to a specific pose (3D position and 3D orientation) near the eye for mobile self-eye examinations using a smartphone. The user guidance is implemented utilizing haptic and visual modalities to guide the user and subsequently capture a close-up photo of the user’s eyes. In a within-subject user study (n=24), the required time, success rate, and perceived demand for the visual and haptic feedback conditions were examined. The results indicate that haptic feedback was the most efficient and least cognitively demanding in the positioning task near the eye, whereas relying on only visual feedback can be more difficult due to the near focus point or refractive errors.
Supplementary Material
Pre-recorded Video Presentation
- Download
- 107.66 MB
References
[1]
Artsiom Ablavatski, Andrey Vakunov, Ivan Grishchenko, Karthik Raveendran, and Matsvei Zhdanovich. 2020. Real-time Pupil Tracking from Monocular Video for Digital Puppetry. CoRR abs/2006.11341 (2020). arXiv:2006.11341https://arxiv.org/abs/2006.11341
[2]
JohnDavis Akkara and Anju Kuriakose. 2018. Innovative smartphone apps for ophthalmologists. Kerala Journal of Ophthalmology 30, 2 (2018), 138. https://doi.org/10.4103/kjo.kjo_68_18
[3]
John D. Akkara and Anju Kuriakose. 2020. Commentary: Gamifying teleconsultation during COVID-19 lockdown. Indian journal of ophthalmology 68, 6 (2020), 1013–1014. https://doi.org/10.4103/ijo.IJO_1495_20
[4]
John Davis Akkara and Anju Kuriakose. 2020. Commentary: Teleophthalmology and electronic medical records: Weighing the pros and cons of unavoidable progress. Indian journal of ophthalmology 68, 2 (2020), 367–368. https://doi.org/10.4103/ijo.ijo_2082_19
[5]
Apple. 2023. iPhone 14 - Technical Specifications. Apple. Retrieved Jan 10, 2023 from https://www.apple.com/iphone-14/specs/
[6]
J. C. Arbeláez, Roberto Viganò, and Gilberto Osorio-Gómez. 2019. Haptic Augmented Reality (HapticAR) for assembly guidance. International Journal on Interactive Design and Manufacturing (IJIDeM) 13, 2 (2019), 673–687. https://doi.org/10.1007/s12008-019-00532-3
[7]
Lokeshwari Aruljyothi, Anuja Janakiraman, B. Malligarjun, and Balasundaram Manohar Babu. 2021. Smartphone applications in ophthalmology: A quantitative analysis. Indian journal of ophthalmology 69, 3 (2021), 548–553. https://doi.org/10.4103/ijo.IJO_1480_20
[8]
Colin Barry, Jessica de Souza, Yinan Xuan, Jason Holden, Eric Granholm, and Edward Jay Wang. 2022. At-Home Pupillometry Using Smartphone Facial Identification Cameras. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 235, 12 pages. https://doi.org/10.1145/3491102.3502493
[9]
Silvia Bonfanti, Angelo Gargantini, and Andrea Vitali. 2015. A Mobile Application for the Stereoacuity Test. Springer, Cham, 315–326. https://doi.org/10.1007/978-3-319-21070-4 _32
[10]
Carlo Bonferroni. 1936. Teoria statistica delle classi e calcolo delle probabilita. Pubblicazioni del R Istituto Superiore di Scienze Economiche e Commericiali di Firenze 8 (1936), 3–62.
[11]
Rupert R A Bourne, Jaimie D Steinmetz, Jost B Jonas, and Theo Vos. 2021. Trends in prevalence of blindness and distance and near vision impairment over 30 years: an analysis for the Global Burden of Disease Study. The Lancet. Global health 9, 2 (2021), e130–e143. https://doi.org/10.1016/S2214-109X(20)30425-3
[12]
W. G. Cochran. 1950. THE COMPARISON OF PERCENTAGES IN MATCHED SAMPLES. Biometrika 37, 3-4 (12 1950), 256–266. https://doi.org/10.1093/biomet/37.3-4.256
[13]
EyeQue Corporation. 2021. EyeQue - Vision Test From Home. Retrieved Dec 1, 2022 from https://www.eyeque.com/
[14]
James M. Coughlan, Brandon Biggs, Marc-Aurèle Rivière, and Huiying Shen. 2020. An Audio-Based 3D Spatial Guidance AR System for Blind Users. Computers helping people with special needs :... International Conference, ICCHP... : proceedings. International Conference on Computers Helping People with Special Needs 12376 (2020), 475–484. https://doi.org/10.1007/978-3-030-58796-3_55
[15]
Michael B. Dillencourt, Hanan Samet, and Markku Tamminen. 1992. A General Approach to Connected-Component Labeling for Arbitrary Image Representations. J. ACM 39, 2 (apr 1992), 253–280. https://doi.org/10.1145/128749.128750
[16]
Alexander Duane. 1922. Studies in Monocular and Binocular Accommodation with their Clinical Applications. American Journal of Ophthalmology 5, 11 (1922), 865–877. https://doi.org/10.1016/S0002-9394(22)90793-7
[17]
Milton Friedman. 1937. The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance. J. Amer. Statist. Assoc. 32, 200 (1937), 675–701. https://doi.org/10.1080/01621459.1937.10503522
[18]
GoCheck Kids. 2021. GoCheck Kids - Pediatric Vision Screening Solution. Retrieved Dec 1, 2022 from https://www.gocheckkids.com/
[19]
Google. 2022. MediaPipe Iris. Retrieved Dec 16, 2022 from https://google.github.io/mediapipe/solutions/iris.html
[20]
Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Human Mental Workload, Peter A. Hancock and Najmedin Meshkati (Eds.). Advances in Psychology, Vol. 52. North-Holland, 139–183. https://doi.org/10.1016/S0166-4115(08)62386-9
[21]
Hassan Hashemi, Akbar Fotouhi, Abbasali Yekta, Reza Pakzad, Hadi Ostadimoghaddam, and Mehdi Khabazkhoob. 2018. Global and regional estimates of prevalence of refractive errors: Systematic review and meta-analysis. Journal of current ophthalmology 30, 1 (2018), 3–22. https://doi.org/10.1016/j. joco.2017.08.009
[22]
Rachel Hecht, Ming Li, Quirina M. B. de Ruiter, William F. Pritchard, Xiaobai Li, Venkatesh Krishnasamy, Wael Saad, John W. Karanian, and Bradford J. Wood. 2020. Smartphone Augmented Reality CT-Based Platform for Needle Insertion Guidance: A Phantom Study. Cardiovascular and interventional radiology 43, 5 (2020), 756–764. https://doi.org/10.1007/s00270-019-02403-6
[23]
Asim Kichloo, Michael Albosta, Kirk Dettloff, Farah Wani, Zain El-Amir, Jagmeet Singh, Michael Aljadah, Raja Chandra Chakinala, Ashok Kumar Kanugula, Shantanu Solanki, and Savneek Chugh. 2020. Telemedicine, the current COVID-19 pandemic and the future: a narrative review and perspectives moving forward in the USA. Family medicine and community health 8, 3 (2020). https://doi.org/10.1136/fmch-2020-000530
[24]
William H. Kruskal and W. Allen Wallis. 1952. Use of Ranks in One-Criterion Variance Analysis. J. Amer. Statist. Assoc. 47, 260 (1952), 583–621. https://doi.org/10.1080/01621459.1952.10483441
[25]
Jean-François Lapointe, Heather Molyneaux, and Mohand Saïd Allili. 2020. A Literature Review of AR-Based Remote Guidance Tasks with User Studies. In Virtual, Augmented and Mixed Reality. Industrial and Everyday Life Applications, Jessie Y. C. Chen and Gino Fragomeni (Eds.). Lecture Notes in Computer Science, Vol. 12191. Springer International Publishing, Cham, 111–120. https://doi.org/10.1007/978-3-030-49698-2_8
[26]
Neha Misra, Rohit C. Khanna, Asha L. Mettla, Srinivas Marmamula, Varsha M. Rathi, and Anthony V. Das. 2020. Role of teleophthalmology to manage anterior segment conditions in vision centres of south India: EyeSmart study-I. Indian journal of ophthalmology 68, 2 (2020), 362–367. https://doi.org/10.4103/ijo.IJO _991_19
[27]
Vitor F. Pamplona, Ankit Mohan, Manuel M. Oliveira, and Ramesh Raskar. 2010. NETRA. ACM Transactions on Graphics 29, 4 (2010), 1–8. https://doi.org/10.1145/1778765.1778814
[28]
PeekVision. 2018. Peek Vision. Retrieved Dec 1, 2022 from https://www.peekvision.org/en_GB/peek-solutions/peek-acuity/
[29]
Warachaya Phanphruk, Yingna Liu, Katharine Morley, Jacqueline Gavin, Ankoor S. Shah, and David G. Hunter. 2019. Validation of StrabisPIX, a Mobile Application for Home Measurement of Ocular Alignment. Translational vision science & technology 8, 2 (2019), 9. https://doi.org/10.1167/tvst.8.2.9
[30]
Amar Pujari. 2021. Smartphone Ophthalmoscopy: is there a place for it?Clinical Ophthalmology (Auckland, NZ) 15 (2021), 4333. https://doi.org/10.2147/OPTH.S243103
[31]
Shrinivas Pundlik, Matteo Tomasi, Rui Liu, Kevin Houston, and Gang Luo. 2019. Development and Preliminary Evaluation of a Smartphone App for Measuring Eye Alignment. Translational vision science & technology 8, 1 (2019), 19. https://doi.org/10.1167/tvst.8.1.19
[32]
Pavel Rojtberg. 2019. User Guidance for Interactive Camera Calibration. Springer, Cham, 268–276. https://doi.org/10.1007/978-3-030-21607-8_21
[33]
Hillary K. Rono, Andrew Bastawrous, David Macleod, Emmanuel Wanjala, Gian Luca Di Tanna, Helen A. Weiss, and Matthew J. Burton. 2018. Smartphone-based screening for visual impairment in Kenyan school children: a cluster randomised controlled trial. The Lancet. Global health 6, 8 (2018), e924–e932. https://doi.org/10.1016/S2214-109X(18)30244-4
[34]
H. Samet and M. Tamminen. 1988. Efficient component labeling of images of arbitrary dimension represented by linear bintrees. IEEE Transactions on Pattern Analysis and Machine Intelligence 10, 4 (1988), 579–586. https://doi.org/10.1109/34.3918
[35]
Samsung. 2023. Specifications - Samsung Galaxy S22. Retrieved Jan 10, 2023 from https://www.samsung.com/global/galaxy/galaxy-s22/specs/
[36]
S. S. Shapiro and M. B. Wilk. 1965. An Analysis of Variance Test for Normality (Complete Samples). Biometrika 52, 3/4 (1965), 591–611. http://www.jstor.org/stable/2333709
[37]
Mollianna Walker, Alba Duvall, Mackenzie Daniels, Mailynh Doan, Luke E. Edmondson, Edward W. Cheeseman, M. Edward Wilson, Rupal H. Trivedi, and Mae Millicent W. Peterseim. 2020. Effectiveness of the iPhone GoCheck Kids smartphone vision screener in detecting amblyopia risk factors. Journal of AAPOS : the official publication of the American Association for Pediatric Ophthalmology and Strabismus 24, 1 (2020), 16.e1–16.e5. https://doi.org/10.1016/j. jaapos.2019.10.007
[38]
Frank Wilcoxon. 1945. Individual Comparisons by Ranking Methods. Biometrics Bulletin 1, 6 (1945), 80–83. http://www.jstor.org/stable/3001968
Index Terms
- EyesOnMe: Investigating Haptic and Visual User Guidance for Near-Eye Positioning of Mobile Phones for Self-Eye-Examinations
Recommendations
Accommodation-invariant computational near-eye displays
Although emerging virtual and augmented reality (VR/AR) systems can produce highly immersive experiences, they can also cause visual discomfort, eyestrain, and nausea. One of the sources of these symptoms is a mismatch between vergence and focus cues. ...
Non-overlayed Guidance in Augmented Reality: User Study in Radio-Pharmacy
Intelligent Human Computer InteractionAbstractIn many traditional industries, production instructions are usually provided on paper. Past research has shown the effectiveness of Augmented Reality (AR) for virtual user guidance in various cases. Usually, the main focus lies on 3D overlays and ...
Haptic-Driven Visual Playback
ISM '14: Proceedings of the 2014 IEEE International Symposium on MultimediaHap tics refers to a tactile feedback technology which allows users to touch and feel objects in virtual environments. However, it is hard to share the visual-hap tic experience, which relies too much on the computer hardware and the hap tic virtual ...
Comments
Information & Contributors
Information
Published In
April 2023
3914 pages
ISBN:9781450394222
DOI:10.1145/3544549
Copyright © 2023 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 19 April 2023
Check for updates
Author Tags
Qualifiers
- Work in progress
- Research
- Refereed limited
Conference
CHI '23
Sponsor:
Acceptance Rates
Overall Acceptance Rate 6,164 of 23,696 submissions, 26%
Upcoming Conference
CHI 2025
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 152Total Downloads
- Downloads (Last 12 months)78
- Downloads (Last 6 weeks)4
Reflects downloads up to 24 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format