Abstract
This paper explores the effectiveness of prompting abstract paintings’ viewers’ inspiration and imagination by the authors’ gaze based music generation system. The authors’ music generation system detects the viewer’s gaze by a gaze detection equipment. At each of the gaze staying positions in the painting, the color of that point is converted to the sound so that as the gaze moves, music that consists of the converted time series sounds is generated. Experiments using six subjects and six abstract paintings were conducted for the three cases in which the subjects see the abstract paintings without hearing any music, while hearing pre-selected music and while hearing the viewers’ gaze based music generated by the authors’ system. The experimental results imply that “hearing gaze based music” could stimulate the viewers’ inspiration and imagination best, “hearing pre-selected music” second best, and “without music” third best.
Chapter PDF
Similar content being viewed by others
References
Wassily Kandinsky - Compositions, http://www.wassilykandinsky.net/compositions.php
Ogusu, T., et al.: Analysis of Gaze Behaviors of Viewers Who See Abstract Paintings and Proposal of its Application to Music Composition. In: IEICE General Conference, vol. A, p. 254 (March 2012) (in Japanese)
Centre Iannis Xenakis, http://www.centre-iannis-xenakis.org
Nagashima, Y.: Discussion for PGS (Polyagogic Graphic Synthesizer), Information Processing Society of Japan, SIG Technical Report, 2005-MUS-59 (7) (2005) (in Japanese)
Iura, T.: New Creative for Imagery and Music in Digital Media - Expressive Effect through Audio and Visual Interaction. Journal of Kansai University Faculty of Informatics (34) (2011) (in Japanese)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Ogusu, T., Ohya, J., Kurumisawa, J., Yonemura, S. (2014). Inspiring Viewers of Abstract Painting by a Gaze Based Music Generation. In: Stephanidis, C. (eds) HCI International 2014 - Posters’ Extended Abstracts. HCI 2014. Communications in Computer and Information Science, vol 434. Springer, Cham. https://doi.org/10.1007/978-3-319-07857-1_38
Download citation
DOI: https://doi.org/10.1007/978-3-319-07857-1_38
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07856-4
Online ISBN: 978-3-319-07857-1
eBook Packages: Computer ScienceComputer Science (R0)