Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Tactile Working Memory Capacity of Users Who Are Blind in an Electronic Travel Aid Application with a Vibration Belt

Published: 25 April 2020 Publication History

Abstract

Electronic travel aids (ETAs) can increase the safety and comfort of pedestrians who have a visual impairment by displaying obstacles through a vibrotactile navigation belt. Building a complete picture of relevant obstacles and finding a safe route requires ETA users to integrate vibrotactile cues over time and space in their tactile working memory. Previous research suggests that the sense of touch exhibits a working memory that has characteristics similar to vision and audition. However, the capacity of the tactile working memory and the effects of secondary tasks are still under-researched. We investigated tactile working memory capacity of 14 adolescent participants who are blind in an immediate, whole report recall test. Participants received trials consisting of one to five vibration patterns presented sequentially at different locations on their torso representing obstacles with a direction (vibration location) and distance (vibration pattern). Recall performance was assessed under four conditions: baseline and with distracting background sounds and/or while walking with the long cane. Both walking and ignoring distracting sounds are relevant for everyday use of an ETA and were expected to decrease memory performance. We calculated the 75% correct scores for two memory performance measures: the number of items in a trial (numerosity), and item location and pattern correct. In the baseline condition, the scores were close to ceiling (i.e., 5 items). However, in the presence of distracting sounds and while walking, the scores were reduced to 3.2 items for numerosity and 1.6 items for location and identity correct. We recommend using 2 items as the maximum tactile working memory load in an applied setting unless users are trained and/or can adopt their strategy without unacceptable costs, such as reducing their walking speed.

References

[1]
World Health Organization. 2018. Fact Sheet: Blindness and Vision Impairment (October 11, 2018). Retrieved March 11, 2020 from http://www.who.int/en/news-room/fact-sheets/detail/blindness-and-visual-impairment.
[2]
D. Dakopoulos and N. G. Bourbakis. 2010. Wearable obstacle avoidance electronic travel aids for blind: A survey. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) 40, 1 (2010), 25--35.
[3]
N. Fallah, I. Apostolopoulos, K. Bekris, and E. Folmer. 2013. Indoor human navigation systems: A survey. Interacting with Computers 25, 1 (2013), 21--33.
[4]
Ó. I. Jóhannesson, R. Hoffmann, V. V. Valgeirsdóttir, R. Unnthorsson, A. Moldoveanu, and Á. Kristjánsson. 2017. Relative vibrotactile spatial acuity of the torso. Experimental Brain Research 235, 11 (2017), 3505--3515.
[5]
J. B. F. Van Erp. 2005. Vibrotactile spatial acuity on the torso: Effects of location and timing parameters. In Proceedings of the 1st Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (World Haptics Conference’05). IEEE, Los Alamitos, CA, 80--85.
[6]
R. Hoffmann, S. Spagnol, Á. Kristjánsson, and R. Unnthorsson. 2018. Evaluation of an audio-haptic sensory substitution device for enhancing spatial awareness for the visually impaired. Optometry and Vision Science 95, 9 (2018), 757--765.
[7]
J. B. F. Van Erp. 2005. Presenting directions with a vibro tactile torso display. Ergonomics 48 (2005), 302--313.
[8]
L. R. Elliott, J. B. F. Van Erp, E. S. Redden, and M. Duistermaat. 2010. Field based validation of a tactile navigation device. IEEE Transactions on Haptics 3, 2 (2010), 78--87.
[9]
H. Burton and R. J. Sinclair. 2000. Attending to and remembering tactile stimuli: A review of brain imaging data and single-neuron responses. Journal of Clinical Neurophysiology 17, 6 (2000), 575--591.
[10]
K. Oberauer, S. Farrell, C. Jarrold, and S. Lewandowsky. 2016. What limits working memory capacity? Psychological Bulletin 142, 7 (2016), 758--799.
[11]
L. Wanga, M. Bodner, and Y.-D. Zhou. 2013. Distributed neural networks of tactile working memory. Journal of Physiology, Paris 107 (2013), 452--458.
[12]
T. D. Bancroft and P. Servos. 2011. Distractor frequency influences performance in vibrotactile working memory. Experimental Brain Research 208 (2011), 529--532.
[13]
J. A. Harris, I. M. Harris, and M. E. Diamond. 2001. The topography of tactile working memory. Journal of Neuroscience 21 (2001), 8262--8269.
[14]
J. A. Harris, C. Miniussi, I. M. Harris, and M. E. Diamond. 2002. Transient storage of a tactile memory trace in primary somatosensory cortex. Journal of Neuroscience 22 (2002), 8720--8725.
[15]
J. W. Hill and J. C. Bliss. 1968. Modeling a tactile sensory register. Perception 8 Psychophysics 4, 2 (1968), 91--101.
[16]
T. D. Bancroft, W. E. Hockley, and P. Servos. 2012. Can vibrotactile working memory store multiple items? Neuroscience Letters 514, 1 (2012), 31--34.
[17]
J. C. Bliss, H. D. Crane, P. K. Mansfield, and J. T. Townsend. 1966. Information available in brief tactile presentations. Perception 8 Psychophysics 1 (1966), 273--283.
[18]
E. V. Sullivan and M. T. Turvey. 1974. On the-short-term retention of serial, tactile stimuli. Memory 8 Cognition 2, 4 (1974), 600--606.
[19]
A. Gallace, H. Z. Tan, P. Haggard, and C. Spence. 2008. Short term memory for tactile stimuli. Brain Research 190 (2008), 132--142.
[20]
M. Auvray, A. Gallace, and C. Spence. 2011. Tactile short-term memory for stimuli presented on the fingertips and across the rest of the body surface. Attention, Perception 8 Psychophysics 73 (2011), 1227--1241.
[21]
R. L. Klatzky, N. A. Giudice, J. R. Marston, J. Tietz, R. G. Colledge, and K. L. Loomis. 2008. An n-back task using vibrotactile stimulation with comparison to an auditory analogue. Behavior Research Methods 40, 1 (2008), 367--372.
[22]
F. Delogu, W. M. Bergmann Tiest, T. C. W. Nijboer, A. M. L. Kappers, and A. Postma. 2013. Binding in haptics: Integration of “what” and “where” information in working memory for active touch. PLoS One 8, 2 (2013), e55606.
[23]
L. Eriksson, J. B. F. Van Erp, O. Carlander, B. Levin, H. A. H. C. Van Veen, and J. E. Veltman. 2006. Vibrotactile and visual threat cueing with high G threat intercept in dynamic flight simulation. In Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting, 1547--1551.
[24]
J. B. F. Van Erp and H. A. H. C. Van Veen. 2004. Vibrotactile in-vehicle navigation system. Transportation Research Part F: Traffic Psychology and Behaviour 7, 4--5 (2004), 247--256.
[25]
J. B. F. Van Erp, L. C. M. Kroon, T. Mioch, and K. I. Paul. 2017. Obstacle detection display for visually impaired: Coding of direction, distance, and height on a vibrotactile waist band. Frontiers in ICT 4 (2017), 23.
[26]
L. Zeng, G. Weber, M. Simros, P. Conradie, J. Saldien, I. Ravyse, J. B. F. Van Erp, and T. Mioch. 2017. Range-IT: Detection and multimodal presentation of indoor objects for visually impaired people. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI’17). ACM, New York, NY, Article 54, 6 pages.
[27]
J. B. F. Van Erp. 2007. Tactile Displays for Navigation and Orientation: Perception and Behaviour. Ph.D. Dissertation, Utrecht University, the Netherlands.
[28]
J. Sánchez and M. Elías. 2007. Guidelines for designing mobility and orientation software for blind children. In Human-Computer Interaction—INTERACT 2007. Lecture Notes in Computer Science, Vol. 4662. Springer, 375--388. 35
[29]
A. D. Heyes. 1984. The Sonic Pathfinder: A new electronic travel aid. Journal of Visual Impairment and Blindness 78, 5 (1984), 200--202.
[30]
S. Shoval, I. Ulrich, and J. Borenstein. 2001. Computerized obstacle avoidance systems for the blind and visually impaired. In Intelligent Systems and Technologies in Rehabilitation Engineering, H. N. L. Teodorescu and L. C. Jain (Eds.). CRC Press, Boca, Raton, FL, 413--448.
[31]
J. L. Szalma and P. A. Hancock. 2011. Noise effects on human performance: A meta-analytic synthesis. Psychological Bulletin 137, 4 (2011), 682--707.
[32]
B. Postle. 2006. Working memory as an emergent property of the mind and brain. Neuroscience 139 (2006), 23--38.
[33]
K. Oberauer. 2009. Interference between storage and processing in working memory: Feature overwriting, not similarity-based competition. Memory 8 Cognition 37 (2009), 346--357.
[34]
C. D. Wickens. 2008. Multiple resources and mental workload. Human Factors 50, 3 (2008), 449--455. 001872008x288394
[35]
S. G. Hart and L. E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in Psychology 52 (1988), 139--183.
[36]
M. A. Heller. 1989. Tactile memory in sighted and blind observers: The influence of orientation and rate of presentation. Perception 18 (1989), 121--133.
[37]
K. Sathian and R. Stilla. 2010. Cross-modal plasticity of tactile perception in blindness. Restorative Neurology and Neuroscience 28, 2 (2010), 271--281.
[38]
S. Millar. 1999. Memory in touch. Psicothema 11, 4 (1999), 747--767.
[39]
T. G. Philippi, J. B. F. Van Erp, and P. J. Werkhoven. 2008. Multisensory temporal numerosity judgment. Brain Research 1242 (2008), 116--125.
[40]
C. D. Wickens, D. L. Sandry, and M. Vidulich. 1983. Compatibility and resource competition between modalities of input, central processing, and output. Human Factors 25, 2 (1983), 227--248. 001872088302500209
[41]
P. A. Hancock, T. Oron-Gilad, and J. L. Szalma. 2006. Elaborations of the multiple-resource theory of attention. In Attention: From Theory to Practice. A. F. Kramer, D. A. Wiegmann, and A. Kirlik (Eds.). Oxford Scholarship Online, 45--56.
[42]
F. Cnossen. 2000. Adaptive Strategies and Goal Management in Car Drivers. Ph.D. Dissertation. University of Groningen.
[43]
S. Banburry and D. C. Berry. 1998. Disruption of office-related tasks by speech and office noise. British Journal of Psychology 89, 3 (1998), 499--517.
[44]
F. Botta, V. Santangelo, A. Raffone, D. Sanabria, J. Lupiáñez, and M. O. Belardinelli. 2011. Multisensory integration affects visuo-spatial working memory. Journal of Experimental Psychology: Human Perception and Performance 37, 4 (2011), 1099--1109.
[45]
J. B. F. Van Erp, T. G. Philippi, and P. J. Werkhoven. 2014. Multisensory memory for object identity and location. In Haptics: Neuroscience, Devices, Modeling, and Applications. Lecture Notes in Computer Science, Vol. 8618. Springer, 169—176.
[46]
M. A. Heller. 1987. Improving the passive tactile digit span. Bulletin of the Psychonomic Society 25 (1987), 257--258.
[47]
D. Ostry, N. Moray, and G. Marks. 1976. Attention, practice, and semantic targets. Journal of Experimental Psychology: Human Perception and Performance 2, 3 (1976), 326--336.
[48]
J. Borenstein and I. Ulrich. 1997. The GuideCane—A computerized travel aid for the active guidance of blind pedestrians. In Proceedings of International Conference on Robotics and Automation. IEEE, Los Alamitos, CA.
[49]
N. Deshpande, E. J. Metter, S. Ling, R. Conwit, and L. Ferrucci. 2008. Physiological correlates of age-related decline in vibrotactile sensitivity. Neurobiology of Aging 29, 5 (2008), 765--773.
[50]
A. L. De Dieuleveult, P. C. Siemonsma, J. B. F. Van Erp, and A.-M. Brouwer. 2017. Effects of aging in multisensory integration: A systematic review. Frontiers in Aging Neuroscience 9, Article 80 (2017), 1--14.

Cited By

View all
  • (2024)The Effect of Directional Tactile Memory of the Back of the User on Reaction Time and AccuracyElectronics10.3390/electronics1313248213:13(2482)Online publication date: 25-Jun-2024
  • (2024)MyWay: a 3D and audio-enhanced transportation learning kit for the visually impaired teenagersCCF Transactions on Pervasive Computing and Interaction10.1007/s42486-024-00163-yOnline publication date: 23-Jul-2024
  • (2023)“Why are there so many steps?”: Improving Access to Blind and Low Vision Music Learning through Personal Adaptations and Future Design IdeasACM Transactions on Accessible Computing10.1145/361566316:3(1-20)Online publication date: 21-Sep-2023
  • Show More Cited By

Index Terms

  1. Tactile Working Memory Capacity of Users Who Are Blind in an Electronic Travel Aid Application with a Vibration Belt

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Transactions on Accessible Computing
        ACM Transactions on Accessible Computing  Volume 13, Issue 2
        June 2020
        184 pages
        ISSN:1936-7228
        EISSN:1936-7236
        DOI:10.1145/3397192
        Issue’s Table of Contents
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 25 April 2020
        Accepted: 01 November 2019
        Revised: 01 September 2019
        Received: 01 December 2018
        Published in TACCESS Volume 13, Issue 2

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. Tactile display
        2. blind
        3. electronic travel aids
        4. human information processing
        5. working memory

        Qualifiers

        • Research-article
        • Research
        • Refereed

        Funding Sources

        • EU FP7 SME Program

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)56
        • Downloads (Last 6 weeks)4
        Reflects downloads up to 17 Jan 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)The Effect of Directional Tactile Memory of the Back of the User on Reaction Time and AccuracyElectronics10.3390/electronics1313248213:13(2482)Online publication date: 25-Jun-2024
        • (2024)MyWay: a 3D and audio-enhanced transportation learning kit for the visually impaired teenagersCCF Transactions on Pervasive Computing and Interaction10.1007/s42486-024-00163-yOnline publication date: 23-Jul-2024
        • (2023)“Why are there so many steps?”: Improving Access to Blind and Low Vision Music Learning through Personal Adaptations and Future Design IdeasACM Transactions on Accessible Computing10.1145/361566316:3(1-20)Online publication date: 21-Sep-2023
        • (2022)What Is Targeted When We Train Working Memory? Evidence From a Meta-Analysis of the Neural Correlates of Working Memory Training Using Activation Likelihood EstimationFrontiers in Psychology10.3389/fpsyg.2022.86800113Online publication date: 30-Mar-2022
        • (2022)Digital Technologies in Orientation and Mobility Instruction for People Who are Blind or Have Low VisionProceedings of the ACM on Human-Computer Interaction10.1145/35556226:CSCW2(1-25)Online publication date: 11-Nov-2022
        • (2022)Digital Mental Health and Social ConnectednessProceedings of the ACM on Human-Computer Interaction10.1145/35556206:CSCW2(1-27)Online publication date: 11-Nov-2022
        • (2022)Heterogeneity in Algorithm-Assisted Decision-Making: A Case Study in Child Abuse Hotline ScreeningProceedings of the ACM on Human-Computer Interaction10.1145/35551016:CSCW2(1-33)Online publication date: 11-Nov-2022
        • (2022)The Architectural Design of Smart Embedded Blind Stick by Using IOTInternational Conference on Innovative Computing and Communications10.1007/978-981-19-2821-5_45(539-551)Online publication date: 27-Sep-2022
        • (2022)Modality-Specific Effect of Cueing on Inter-Manual Coordination in Bimanual Force Control Tasks with Accentuated- or Attenuated-Force ProductionHaptic Interaction10.1007/978-3-031-46839-1_3(28-40)Online publication date: 12-Nov-2022
        • (2020)Ultrasonic Sensor based Smart Cap as Electronic Travel Aid for Blind People2020 Third International Conference on Smart Systems and Inventive Technology (ICSSIT)10.1109/ICSSIT48917.2020.9214226(873-877)Online publication date: Aug-2020

        View Options

        Login options

        Full Access

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media