Feedback is... late: measuring multimodal delays in mobile device touchscreen interaction
T Kaaresoja, S Brewster - … Conference on Multimodal Interfaces and the …, 2010 - dl.acm.org
T Kaaresoja, S Brewster
International Conference on Multimodal Interfaces and the Workshop on …, 2010•dl.acm.orgMultimodal interaction is becoming common in many kinds of devices, particularly mobile
phones. If care is not taken in design and implementation, there may be latencies in the
timing of feedback in the different modalities may have unintended effects on users. This
paper introduces an easy to implement multimodal latency measurement tool for
touchscreen interaction. It uses off-the-shelf components and free software and is capable of
measuring latencies accurately between different interaction events in different modalities …
phones. If care is not taken in design and implementation, there may be latencies in the
timing of feedback in the different modalities may have unintended effects on users. This
paper introduces an easy to implement multimodal latency measurement tool for
touchscreen interaction. It uses off-the-shelf components and free software and is capable of
measuring latencies accurately between different interaction events in different modalities …
Multimodal interaction is becoming common in many kinds of devices, particularly mobile phones. If care is not taken in design and implementation, there may be latencies in the timing of feedback in the different modalities may have unintended effects on users. This paper introduces an easy to implement multimodal latency measurement tool for touchscreen interaction. It uses off-the-shelf components and free software and is capable of measuring latencies accurately between different interaction events in different modalities. The tool uses a high-speed camera, a mirror, a microphone and an accelerometer to measure the touch, visual, audio and tactile feedback events that occur in touchscreen interaction. The microphone and the accelerometer are both interfaced with a standard PC soundcard that makes the measurement and analysis simple. The latencies are obtained by hand and eye using a slow-motion video player and an audio editor. To validate the tool, we measured four commercial mobile phones. Our results show that there are significant differences in latencies, not only between the devices, but also between different applications and modalities within one device. In this paper the focus is on mobile touchscreen devices, but with minor modifications our tool could be also used in other domains.
ACM Digital Library