Portable form filling assistant for the visually impaired
Abstract
The filling of printed forms has always been an issue for the visually impaired. Though optical character recognition technology has helped many blind people to 'read' the world, there is not a single device that allows them to fill out apaper-based form without a human assistant. The task of filling forms is however an essential part of their daily lives, for example, for access to social security or benefits. This paper describes a solution that allows a blind person to complete paper-based forms, pervasively and independently, using only off-the-shelf equipment including a Smartphone, aclipboard with slidingruler, and aballpoint pen. A dynamic color fiduciary (point of reference) marker is designed so that it can be moved by the user to any part of the form such that all regions can be "visited". This dynamic color fiduciary marker is robust to camera focus and partial occlusion, allowing flexibility in handling the Smartphone with embedded camera. Feedback is given to the blind user via both voice and tone to facilitate efficient guidance in filling out the form. Experimental results have shown that this prototype can help visually impaired people to fill out a form independently.
References
[1]
Y. Cho and U. Neumann. Multiring fiducial systems for scalable fiducial-tracking augmented reality. Presence: Teleoper. Virtual Environ., 10(6):599--612, 2001.
[2]
E. Costanza and J. Huang. Designable visual markers. In CHI '09: Proceedings of the 27th International Conference on Human Factors in Computing Systems, pages 1879--1888, New York, NY, USA, 2009. ACM.
[3]
Handel. Statistical Machine (U.S. Patent 1,915,993), 1933.
[4]
T. Ihle, H. Schirmer, and S. Fuchs. Interpretation of printed forms for blind people. In CAIP '95: Proceedings of the 6th International Conference on Computer Analysis of Images and Patterns, pages 550--555, London, UK, 1995. Springer-Verlag.
[5]
IRS. Accessible IRS tax products. http://www.irs.gov/formspubs/, June 2010.
[6]
H. Kato and M. Billinghurst. Marker tracking and hmd calibration for a video-based augmented reality conferencing system. In IWAR '99: Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality, page 85, Washington, DC, USA, 1999. IEEE Computer Society.
[7]
D. Kirk, A. Sellen, S. Taylor, N. Villar, and S. Izadi. Putting the physical into the digital: issues in designing hybrid interactive surfaces. In BCS HCI '09: Proceedings of the 2009 British Computer Society Conference on Human-Computer Interaction, pages 35--44, Swinton, UK, UK, 2009. British Computer Society.
[8]
J. Lee. Hacking the nintendo wii remote. Pervasive Computing, IEEE, 7(3):39--45, july-sept.2008.
[9]
J. Marco, E. Cerezo, S. Baldassarri, E. Mazzone, and J. C. Read. Bringing tabletop technologies to kindergarten children. In BCS HCI '09: Proceedings of the 2009 British Computer Society Conference on Human-Computer Interaction, pages 103--111, Swinton, UK, UK, 2009. British Computer Society.
[10]
J.-S. Park and B.-J. Lee. Vision-based real-time camera match moving using a known marker. Optical Engineering, 47(2):027201, 2008.
[11]
QuantumTechnology. Products for people who are blind. http://www.quantumtechnology.com.au/blindness, June 2010.
[12]
J. G. Sheridan, J. Tompkin, A. Maciel, and G. Roussos. Diy design process for interactive surfaces. In BCS HCI '09: Proceedings of the 2009 British Computer Society Conference on Human-Computer Interaction, pages 485--493, Swinton, UK, UK, 2009. British Computer Society.
[13]
A. State, G. Hirota, D. T. Chen, W. F. Garrett, and M. A. Livingston. Superior augmented reality registration by integrating landmark tracking and magnetic tracking. In SIGGRAPH, pages 429--438, 1996.
[14]
J. Varadarajan and S. Madhvanath. Digital ink to form alignment for electronic clipboard devices. In DAS '08: Proceedings of the 2008 The Eighth IAPR International Workshop on Document Analysis Systems, pages 622--628, Washington, DC, USA, 2008. IEEE Computer Society.
[15]
VisionAustralia. Taxi transport subsidy. http://www.visionaustralia.org.au/info.aspx?page=991, June 2010.
[16]
D. Wagner, G. Reitmayr, A. Mulloni, T. Drummond, and D. Schmalstieg. Pose tracking from natural features on mobile phones. In ISMAR '08: Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, pages 125--134, Washington, DC, USA, 2008. IEEE Computer Society.
[17]
G. Zufferey, P. Jermann, S. Do-Lenh, and P. Dillenbourg. Using augmentations as bridges from concrete to abstract representations. In BCS HCI '09: Proceedings of the 2009 British Computer Society Conference on Human-Computer Interaction, pages 130--139, Swinton, UK, UK, 2009. British Computer Society.
Recommendations
Mobile device accessibility for the visually impaired: problems mapping and recommendations
Mobile devices can be an important ally that improves the quality of life of visually impaired people by permitting greater independence in the execution of certain tasks and facilitating social inclusion. This work presents a systematic review that ...
Application for the configuration and adaptation of the Android operating system for the visually impaired
W4A '18: Proceedings of the 15th International Web for All ConferenceMobile devices can be used as assistive technologies as they help improve the quality of life of people with visual impairments (PVI). Despite the advantages of mobile devices, it is necessary to overcome some challenges regarding the difficulties of ...
A shape-free, designable 6-DoF marker tracking method for camera-based interaction in mobile environment
MM '10: Proceedings of the 18th ACM international conference on MultimediaWe developed a novel marker tracking method with shape-free designable markers, which can be visually meaningful to users. The method can work fast enough to provide a real-time camerabased interaction even on low performance CPUs such as one used in ...
Comments
Information & Contributors
Information
Published In
Publisher
BCS Learning & Development Ltd.
Swindon, United Kingdom
Publication History
Published: 06 September 2010
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 127Total Downloads
- Downloads (Last 12 months)29
- Downloads (Last 6 weeks)9
Reflects downloads up to 12 Sep 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in