Mental Rotation Skill Shapes Haptic Exploration Strategies
Pages 339 - 350
Abstract
Haptic exploration strategies have been traditionally studied focusing on hand movements and neglecting how objects are moved in space. However, in daily life situations touch and movement cannot be disentangled. Furthermore, the relation between object manipulation as well as performance in haptic tasks and spatial skill is still little understood. In this study, we used iCube, a sensorized cube recording its orientation in space as well as the location of the points of contact on its faces. Participants had to explore the cube faces where little pins were positioned in varying number and count the number of pins on the faces with either even or odd number of pins. At the end of this task, they also completed a standard visual mental rotation test (MRT). Results showed that higher MRT scores were associated with better performance in the task with iCube both in term of accuracy and exploration speed and exploration strategies associated with better performance were identified. High performers tended to rotate the cube so that the explored face had the same spatial orientation (i.e., they preferentially explored the upward face and rotated iCube to explore the next face in the same orientation). They also explored less often twice the same face and were faster and more systematic in moving from one face to the next. These findings indicate that iCube could be used to infer subjects’ spatial skill in a more natural and unobtrusive fashion than with standard MRTs.
References
[1]
J. M. Loomis and S. J. Lederman, “Tactual perception,” in Handbook of Perception and Human Performance, K. Boff, L. Kaufman, and J. Thomas, Eds. New York: Wiley: Wiley, 1986, pp. 1–41.
[2]
S. J. Lederman and R. L. Klatzky, “Extracting object properties through haptic exploration,”Acta Psychol., vol. 15, no. 1, pp. 29–40, 1993.
[3]
S. J. Lederman and R. L. Klatzky, “Hand movements: A window into haptic object recognition,”Cogn. Psychol., vol. 19, pp. 342–368, 1987.
[4]
A. Sciutti, F. Damonte, M. Alloisio, and G. Sandini, “Visuo-Haptic exploration for multimodal memory,”Front. Integr. Neurosci., vol. 13, May2019, Art. no.
[5]
A. M. Fernandes and P. B. Albuquerque, “Tactual perception: A review of experimental variables and procedures,”Cogn. Process., vol. 13, no. 4, pp. 285–301, Nov.2012.
[6]
C. Spence and A. Gallace, “Recent developments in the study of tactile attention.,”Can. J. Exp. Psychol. Can. Psychol. expérimentale, vol. 61, no. 3, pp. 196–207, 2007.
[7]
S. J. Lederman, R. L. Klatzky, A. Collins, and J. Wardell, “Exploring environments by hand or foot: Time-based heuristics for encoding distance in movement space,”J. Exp. Psychol. Learn. Mem. Cogn., vol. 13, no. 4, pp. 606–614, 1987.
[8]
S. E. M. Jansen, W. M. Bergmann Tiest, and A. M. L. Kappers, “Haptic exploratory behavior during object discrimination: A novel automatic annotation method,”PLoS One, vol. 10, no. 2, Feb.2015, Art. no.
[9]
A. Sciutti and G. Sandini, “The role of object motion in visuo-haptic exploration during development,” in Proc. Jt. IEEE 9th Int. Conf. Dev. Learn. Epigenetic Robot., Oslo, Norway, 2019, pp. 123–128.
[10]
A. Sciutti and G. Sandini, “To move or not to move: Development of fine-tuning of object motion in haptic exploration,”IEEE Trans. Cogn. Dev. Syst., to be published.
[11]
J. E. Roberts and M. A. Bell, “The effects of age and sex on mental rotation performance, verbal performance, and brain electrical activity,”Dev. Psychobiol., vol. 40, no. 4, pp. 391–407, 2001.
[12]
G. A. Tagaris, et al., “Functional magnetic resonance imaging of mental rotation and memory scanning: A multidimensional scaling analysis of brain activation patterns,”Brain Res. Rev., vol. 26, no. 2–3, pp. 106–112, 1998.
[13]
A. C. Papanicolaou, G. Deutsch, W. T. Bourbon, K. W. Will, D. W. Loring, and H. M. Eisenberg, “Convergent evoked potential and cerebral blood flow evidence of task-specific hemispheric differences,”Electroencephalogr. Clin. Neurophysiol., vol. 66, no. 6, pp. 515–520, Jun.1987.
[14]
K. Kucian, M. von Aster, T. Loenneker, T. Dietrich, F. W. Mast, and E. Martin, “Brain activation during mental rotation in school children and adults,”J. Neural Transm., vol. 114, no. 5, pp. 675–686, May2007.
[15]
W. Gaughran, “Cognitive modelling for engineers,” in Proc. Amer. Soc. Eng. Educ. Annu. Conf. Expo., 2002.
[16]
W. M. Bergmann-Tiest, J. Norman, M. Kahrimanovic, and A. M. Kappers, “Hand movements during haptic object exploration,” in Percep. 39. Suppl., pp. 132–133, 2010.
[17]
A. M. Kappers and F. T. Douw, “Hand movement investigations inspired by yarbus,” in Proc. IEEE World Haptics Conf., 2011, pp. 281–285.
[18]
H. P. Thakur, A. J. Bastian, and S. S. Hsiao, “Multidigit movement synergies of the human hand in an unconstrained haptic exploration task,”J. Neurosci., vol. 28, no. 6, pp. 1271–1281, 2008.
[19]
L. Besançon, A. Ynnerman, D. F. Keefe, L. Yu, and T. Isenberg, “The state of the art of spatial interfaces for 3D visualization,”Comput. Graph. Forum, vol. 40, no. 1, pp. 293–326, 2021.
[20]
P. Issartel, L. Besançon, T. Isenberg, and M. Ammi, “A tangible volume for portable 3D interaction,” in Proc. IEEE Int. Symp. Mixed Augmented Reality, Merida, Mexico, 2016, pp. 215–220.
[21]
M. Cordeil, B. Bach, Y. Li, E. Wilson, and T. Dwyer, “Design space for spatio-data coordination: Tangible interaction devices for immersive information visualisation,” in Proc. IEEE Pacific Visual. Symp., Seoul, Korea (South), 2017, pp. 46–50.
[22]
L. Besançon, M. Sereno, L. Yu, M. Ammi, and T. Isenberg, “Hybrid touch/tangible spatial 3D data selection,”Comput. Graph. Forum, vol. 38, no. 3, pp. 553–567, 2019.
[23]
R. I. Tivadar, et al., “Mental rotation of digitally-rendered haptic objects,”Front. Integr. Neurosci., vol. 13, 2019, Art. no.
[24]
R. I. Tivadar, C. Chappaz, F. Anaflous, J. Roche, and M. M. Murray, “Mental rotation of digitally-rendered haptic objects by the visually-impaired,”Front. Neurosci., vol. 14, 2020, Art. no.
[25]
F. Leo, et al., “Blind persons get improved sense of orientation and mobility in large outdoor spaces by means of a tactile pin-array matrix,” in Proc. CHI Workshop Hacking Blind Navigation, 2019.
[26]
L. Brayda, F. Leo, C. Baccelliere, C. Vigini, and E. Cocchi, “A refreshable tactile display effectively supports cognitive mapping followed by orientation and mobility tasks,” in Proc. 2019 Workshop Multimedia for Accessible Hum. Comput. Interface, 2019, pp. 9–15.
[27]
L. Brayda, F. Leo, C. Baccelliere, E. Ferrari, and C. Vigini, “Updated tactile feedback with a pin array matrix helps blind people to reduce self-location errors,”Micromachines, vol. 9, no. 7, 2018, Art. no.
[28]
K. Romeo, S. Gay, M.-A. Riviere, and E. Pissaloux, “Exploring maps with touch: An inclusive haptic device,” in Proc. ICCHP - Future Perspectives AT, eAccessibility eInclusion, 2020, pp. 93–98.
[29]
S. Lebaz, C. Jouffrais, and D. Picard, “Haptic identification of raised-line drawings: High visuospatial imagers outperform low visuospatial imagers,”Psychol. Res., vol. 76, no. 5, pp. 667–675, 2012.
[30]
T. Kalisch, J.-C. Kattenstroth, R. Kowalewski, M. Tegenthoff, and H. R. Dinse, “Cognitive and tactile factors affecting human haptic performance in later life,”PLoS One, vol. 7, no. 1, Jan.2012, Art. no.
[31]
F. Leo, et al., “Improving spatial working memory in blind and sighted youngsters using programmable tactile displays,”SAGE Open Med, vol. 6, Jan.2018, Art. no.
[32]
T. Vecchi, C. Tinti, and C. Cornoldi, “Spatial memory and integration processes in congenital blindness,”NeuroRep., vol. 15, no. 18, pp. 2787–2790, 2004.
[33]
M. Peters, B. Laeng, K. Latham, M. Jackson, R. Zaiyouna, and C. Richardson, “A redrawn vandenberg and kuse mental rotations test: Different versions and factors that affect performance.,”Brain Cogn., vol. 28. pp. 39–58, 1995.
[34]
R. N. Shepard and J. Metzler, “Mental rotation of three-dimensional objects,”Science, vol. 171, no. 3972, pp. 701–703, 1971.
[35]
“jamovi.”The Jamovi Project, Sidney, Australia, 2021, [Online]. Available: https://www.jamovi.org
[36]
Y. Benjamini and Y. Hochberg, “Controlling the false discovery rate: A practical and powerful approach to multiple testing,”J. R. Statist. Soc. Ser. B, vol. 57, no. 1, pp. 289–300, Jan.1995.
[37]
M. E. Glickman, S. R. Rao, and M. R. Schultz, “False discovery rate control is a recommended alternative to Bonferroni-type adjustments in health studies,”J. Clin. Epidemiol., vol. 67, no. 8, pp. 850–857, 2014.
[38]
R. Nouchi, et al., “Brain training game boosts executive functions, working memory and processing speed in the young adults: A randomized controlled trial,”PLoS One, vol. 8, no. 2, Feb.2013, Art. no.
[39]
S. Shioiri, T. Yamazaki, K. Matsumiya, and I. Kuriki, “Rotation-independent representations for haptic movements,”Sci. Rep., vol. 3, no. 1, Dec.2013, Art. no.
[40]
R. D. Easton, K. Srinivas, and A. J. Greene, “Do vision and haptics share common representations? Implicit and explicit memory within and between modalities.,”J. Exp. Psychol. Learn. Mem. Cogn., vol. 23, no. 1, pp. 153–163, 1997.
[41]
A. T. Woods and F. N. Newell, “Visual, haptic and cross-modal recognition of objects and scenes,”J. Physiol., vol. 98, no. 1–3, pp. 147–159, Jan.2004.
[42]
S. Lacey, C. Campbell, and K. Sathian, “Vision and touch: Multiple or multisensory representations of objects?,”Perception, vol. 36, no. 10, pp. 1513–1521, Oct.2007.
[43]
A. Zangaladze, C. M. Epstein, S. T. Grafton, and K. Sathian, “Involvement of visual cortex in tactile discrimination of orientation,”Nature, vol. 401, no. 6753, pp. 587–590, Oct.1999.
[44]
A. Amedi, R. Malach, T. Hendler, S. Peled, and E. Zohary, “Visuo-haptic object-related activation in the ventral visual pathway,”Nat. Neurosci., vol. 4, no. 3, pp. 324–330, Mar.2001.
[45]
R. Malach, et al., “Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex,”Proc. Natl. Acad. Sci. USA., vol. 92, no. 18, pp. 8135–8139, Aug.1995.
[46]
L. Merabet, G. Thut, B. Murray, J. Andrews, S. Hsiao, and A. Pascual-Leone, “Feeling by sight or seeing by touch?,”Neuron, vol. 42, no. 1, pp. 173–179, Apr.2004.
[47]
G. Pellizzer and A. P. Georgopoulos, “Common processing constraints for visuomotor and visual mental rotations,”Exp. Brain Res., vol. 93, no. 1, 1993.
[48]
F. Leo, E. Cocchi, and L. Brayda, “The effect of programmable tactile displays on spatial learning skills in children and adolescents of different visual disability,”IEEE Trans. Neural Syst. Rehabil. Eng., vol. 25, no. 7, pp. 861–872, Jul.2017.
[49]
R. L. Klatzky, S. J. Lederman, and C. Reed, “There's more to touch than meets the eye: The salience of object attributes for haptics with and without vision.,”J. Exp. Psychol. Gen., vol. 116, no. 4, pp. 356–369, 1987.
Index Terms
- Mental Rotation Skill Shapes Haptic Exploration Strategies
Index terms have been assigned to the content through auto-classification.
Recommendations
Haptic Illusion Glove: A Glove for Illusionary Touch Feedback when Grasping Virtual Objects
MuC '19: Proceedings of Mensch und Computer 2019When touching virtual objects, we lack haptic feedback using commonly and commercially available VR controllers, such as the HTC Vive Controller or Oculus Touch. Haptic Illusion Glove is a wearable device used to create the haptic illusion when grasping ...
Comments
Information & Contributors
Information
Published In
This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see https://creativecommons.org/licenses/by/4.0/.
Publisher
IEEE Computer Society Press
Washington, DC, United States
Publication History
Published: 01 April 2022
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 16 Feb 2025