Dynamics and Interaction in BCI and Music Spaces
John Williamson        
Roderick Murray-Smith
This
PASCAL funded pump-priming project aims to bring continuous and uncertain interaction methods into both brain-computer interfaces, and to the interactive exploration of song spaces. By treating the interaction problem as a continuous control process, a range of novel techniques can be brought to bear on the BCI and song exploration problem.
EEG brain-computer interfaces suffer from high noise levels and heavily-lagged dynamics. Existing user interface models are inefficient and frustrating for interaction. By explictly taking the noise and dynamical properties of the BCI control signals into account, more suitable interfaces can be devised.
The song-exploration problem involves navigation of very high-dimesional feature spaces. The mapping from these spaces to user intention is uncertain. Uncertain and predictive displays, combined with intelligent navigation controls, can aid users in intuitively navigating musical spaces.
This work is in collaboration with the
IDA group at Fraunhofer First and the
Intelligent Signal Processsing Group at DTU.
The following publications have been generated during this project:
- B. Blankertz, M. Krauledat, G. Dornhege, J. Williamson, R. Murray-Smith, and K.-R. Müller, A Note on Brain Actuated Spelling with the Berlin Brain-Computer Interface, HCI International, China, 2007. pdf video
- J. Williamson, R. Murray-Smith, S. Hughes, Shoogle: Multimodal Excitatory Interaction on Mobile Devices, Proceedings of ACM SIG CHI Conference, San Jose, 2007. pdf video
- S. Strachan, J. Williamson, R. Murray-Smith, Show me the way to Monte Carlo: density-based trajectory navigation, Proceedings of ACM SIG CHI Conference, San Jose, 2007. pdf
- J. Williamson, R. Murray-Smith, S. Hughes, Devices as Interactive Physical Containers: The Shoogle System, Extended abstracts of ACM SIG CHI Conference, San Jose, 2007. pdf video
- J. Williamson, R. Murray-Smith, S. Hughes, S., Excitatory Multimodal Interaction on Mobile Devices, DCS Technical Report Series TR-2006-228, Dept of Computing Science, University of Glasgow, 2006. pdf , video
- B. Blankertz, G. Dornhege, M. Krauledat, M. Schröder, J. Williamson, R. Murray-Smith, K.R. Müller, The Berlin Brain-Computer Interface presents the novel mental typewriter Hex-o-Spell, 3rd International BCI Workshop and Training Course, Graz, 2006. pdf video (38Mb)
- J. Williamson, S. Strachan, R. Murray-Smith, It’s a Long Way to Monte-Carlo: Probabilistic GPS Navigation, Proceedings of Mobile HCI 2006, Helsinki, 2006. pdf video