The sound of light: induced synesthesia for augmenting the photography experience
Pages 745 - 750
Abstract
This paper presents a novel approach to assist users of digital cameras and augment their photograph taking experience. To this end, a realtime analysis of the images framed by the camera is conducted to assess composition, exposure and presence of human subjects. The resulting information is used to give users feedback about their photographs before they release the shutter. The main contribution of this paper is the use of synesthetic feedback: a musical composition that maps aspects resulting from the realtime analysis of images is composed and played back to the photographer. A preliminary study shows that musical attributes can be controlled to provide effective feedback about the visual modality.
References
[1]
Brewster, S., McAdam, C., McDonald, J., and Maciver, J. Rethinking camera user interfaces. In Digital Photography VIII, vol. 8299, SPIE (2012).
[2]
Brewster, S. A., and Johnston, J. Multimodal interfaces for camera phones. MobileHCI '08, ACM (2008), 387--390.
[3]
Koelsch, S., and Siebel, W. A. Towards a neural basis of music perception. Trends in Cognitive Sciences 9, 12 (2005), 578 -- 584.
[4]
McAdam, C., Pinkerton, C., and Brewster, S. A. Novel interfaces for digital cameras and camera phones. MobileHCI '10, ACM (2010), 143--152.
[5]
Obrador, P., Schmidt-Hackenberg, L., and Oliver, N. The role of image composition in image aesthetics. In Image Processing, Conf., IEEE (2010), 3185--3188.
Index Terms
- The sound of light: induced synesthesia for augmenting the photography experience
Recommendations
XiaoIce Band: A Melody and Arrangement Generation Framework for Pop Music
KDD '18: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data MiningWith the development of knowledge of music composition and the recent increase in demand, an increasing number of companies and research institutes have begun to study the automatic generation of music. However, previous models have limitations when ...
PopMAG: Pop Music Accompaniment Generation
MM '20: Proceedings of the 28th ACM International Conference on MultimediaIn pop music, accompaniments are usually played by multiple instruments (tracks) such as drum, bass, string and guitar, and can make a song more expressive and contagious by arranging together with its melody. Previous works usually generate multiple ...
Pop Music Generation: From Melody to Multi-style Arrangement
Special Issue on KDD 2018, Regular Papers and Survey PaperMusic plays an important role in our daily life. With the development of deep learning and modern generation techniques, researchers have done plenty of works on automatic music generation. However, due to the special requirements of both melody and ...
Comments
Information & Contributors
Information
Published In
April 2013
3360 pages
ISBN:9781450319522
DOI:10.1145/2468356
- General Chair:
- Wendy E. Mackay,
- Program Chairs:
- Stephen Brewster,
- Susanne Bødker
Copyright © 2013 Copyright is held by the owner/author(s).
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 27 April 2013
Check for updates
Author Tags
Qualifiers
- Poster
Conference
CHI '13
Sponsor:
Acceptance Rates
CHI EA '13 Paper Acceptance Rate 630 of 1,963 submissions, 32%;
Overall Acceptance Rate 6,164 of 23,696 submissions, 26%
Upcoming Conference
CHI 2025
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 243Total Downloads
- Downloads (Last 12 months)2
- Downloads (Last 6 weeks)0
Reflects downloads up to 13 Jan 2025
Other Metrics
Citations
Cited By
View allView Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in