Article

CaMus²: collaborative music performance with mobile camera phones

Authors:

Michael Rohs and

Georg EsslAuthors Info & Claims

ACE '07: Proceedings of the international conference on Advances in computer entertainment technology

June 2007

Pages 190 - 195

https://doi.org/10.1145/1255047.1255086

Published: 13 June 2007 Publication History

Abstract

CaMus2 is a multi-user multi-phone extension of the CaMus system. Mobile camera phones use their cameras to track position, rotation, height, and other parameters over a marker sheet to allow interactive performance of music. Multiple camera phones can use the same or separate marker sheets and send their interaction parameters via Bluetooth to a computer where the sensor information is converted to MIDI format to allow control of a wide range of sound generation and manipulation hardware and software. The semantics of the mapping of MIDI message to performance parameters of the camera interactions are fed back into the visualization on the camera phone.

References

[1]

F. Behrendt. Handymusik. Klangkunst und 'mobile devices'. Epos, 2005. Available online at: www.epos.uos.de/music/templates/buch.php?id=57 (retrieved on April 1, 2007).

[2]

W. Carter and L. S. Liu. Location33: A mobile musical. In NIME '05: Proceedings of the 2005 Conference on New Interfaces for Musical Expression, pages 176--179, May 2005.

Digital Library

[3]

G. Essl and M. Rohs. Mobile STK for Symbian OS. In Proc. International Computer Music Conference, pages l278--281, New Orleans, November 2006.

[4]

G. W. Fitzmaurice. Situated information spaces and spatially aware palmtop computers. Commun. ACM, 36(7):39--49, 1993.

Digital Library

[5]

L. Gaye, L. E. Holmquist, F. Behrendt, and A. Tanaka. Mobile music technology: Report on an emerging community. In NIME '06: Proceedings of the 2006 conference on New interfaces for musical expression, pages 22--25, June 2006.

Digital Library

[6]

L. Gaye, R. Mazé, and L. E. Holmquist. Sonic City: The urban environment as a musical interface. In NIME '03: Proc. 2003 conference on New interfaces for musical expression, pages 109--115, May 2003.

Digital Library

[7]

M. Kaltenbrunner. Interactive music for mobile digital music players. In Inspirational Idea for the International Computer Music Conference (ICMC), Barcelona, Spain, Sept. 2005.

[8]

G. Levin. Dialtones - a telesymphony. www.flong.com/telesymphony, September 2 2001. Retrieved on April 1, 2007.

[9]

S. Mehra, P. Werkhoven, and M. Worring. Navigating on handheld displays: Dynamic versus static peephole navigation. ACM Trans. Comput.-Hum. Interact., 13(4):448--457, 2006.

Digital Library

[10]

E.R. Miranda and M.M. Wanderley. New Digital Musical Instruments: Control and Interaction Beyond the Keyboard. A-R Editions, 2006.

Digital Library

[11]

M. Rohs and G. Essl. Which one is better? - information navigation techniques for spatially aware handheld displays. In ICMI '06: Proceedings of the 8th International Conference on Multimodal Interfaces, pages 100--107, Nov. 2006.

Digital Library

[12]

M. Rohs, G. Essl, and M. Roth. CaMus: Live music performance using camera phones and visual grid tracking. In Proceedings of the 6th International Conference on New Instruments for Musical Expression (NIME), pages 31--36, June 2006.

Digital Library

[13]

G. Schiemer and M. Havryliv. Pocket Gamelan: Tuneable trajectories for flying sources in Mandala 3 and Mandala 4. In NIME '06: Proceedings of the 2006 conference on New interfaces for musical expression, pages 37--42, June 2006.

Digital Library

[14]

S. Strachan, P. Eslambolchilar, R. Murray-Smith, S. Hughes, and S. O'Modhrain. GpsTunes: Controlling navigation via audio feedback. In MobileHCI '05: Proceedings of the 7th international conference on Human computer interaction with mobile devices & services, pages 275--278, Sept. 2005.

Digital Library

[15]

A. Tanaka and P. Gemeinboeck. A framework for spatial interaction in locative media. In NIME '06: Proceedings of the 2006 conference on New interfaces for musical expression, pages 26--30, June 2006.

Digital Library

[16]

N. Warren, M. Jones, S. Jones, and D. Bainbridge. Navigation via continuously adapted music. In CHI '05: CHI '05 extended abstracts on Human factors in computing systems, pages 1849--1852, Apr. 2005.

Digital Library

[17]

D. Waters. Mobile music challenges 'iPod age'. BBC News Online, Monday, 7 March 2005. Available online at news.bbc.co.uk/1/hi/technology/4315481.stm (retrieved on April 1, 2007).

[18]

T. Yamauchi and I. Toru. Mobile user-interface for music (poster). In Proceedings of the Mobile Music Workshop, Vancouver, Canada, May 25 2005.

[19]

K.-P. Yee. Peephole displays: Pen interaction on spatially aware handheld computers. In CHI '03: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 1--8, Apr. 2003.

Digital Library

Cited By

Park S(2021)ARLooper: A Mobile AR Application for Collaborative Sound Recording and PerformancePerception, Representations, Image, Sound, Music10.1007/978-3-030-70210-6_35(554-562)Online publication date: 10-Mar-2021
https://doi.org/10.1007/978-3-030-70210-6_35
Hong E(2019)DrWebusic : Real-time Interactive Audio System on the WebJournal of Digital Contents Society10.9728/dcs.2019.20.9.175520:8(1755-1761)Online publication date: 30-Sep-2019
https://doi.org/10.9728/dcs.2019.20.9.1755
De Prisco RMalandrino DZaccagnino GZaccagnino R(2017)BAND: A mobile-based collaboration system for composing and playing music2017 4th International Conference on Systems and Informatics (ICSAI)10.1109/ICSAI.2017.8248544(1625-1630)Online publication date: Nov-2017
https://doi.org/10.1109/ICSAI.2017.8248544
Show More Cited By

Index Terms

Recommendations

Sensing-based interaction for information navigation on handheld displays
MobileHCI '07: Proceedings of the 9th international conference on Human computer interaction with mobile devices and services

Information navigation on handheld displays is characterized by the small display dimensions and limited input capabilities of today's mobile devices. Special strategies are required to help users navigate to off-screen content and develop awareness of ...
Read More
CaMus²: optical flow and collaboration in camera phone music performance
NIME '07: Proceedings of the 7th international conference on New interfaces for musical expression

CaMus² allows collaborative performance with mobile camera phones. The original CaMus project was extended to support multiple phones performing in the same space and generating MIDI signals to control sound generation and manipulation software or ...
Read More
Map navigation with mobile devices: virtual versus physical movement with and without visual context
ICMI '07: Proceedings of the 9th international conference on Multimodal interfaces

A user study was conducted to compare the performance of three methods for map navigation with mobile devices. These methods are joystick navigation, the dynamic peephole method without visual context, and the magic lens paradigm using external visual ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ACE '07: Proceedings of the international conference on Advances in computer entertainment technology

June 2007

324 pages

ISBN:9781595936400

DOI:10.1145/1255047

General Chairs:
Masa Inakage
Keio University
,
Newton Lee
NUS Hollywood Lab
,
Manfred Tscheligi
University of Salzburg
,
Program Chairs:
Regina Bernhaupt
University of Salzburg
,
Stephane Natkin
Conservatoire National des Arts et Métiers

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 June 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ACE2007

Sponsor:

ACE2007: International Conference on Advances in Computer Entertainment Technology

June 13 - 15, 2007

Salzburg, Austria

Acceptance Rates

Overall Acceptance Rate 36 of 90 submissions, 40%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
374
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Other Metrics

View Author Metrics

Citations

Cited By

Park S(2021)ARLooper: A Mobile AR Application for Collaborative Sound Recording and PerformancePerception, Representations, Image, Sound, Music10.1007/978-3-030-70210-6_35(554-562)Online publication date: 10-Mar-2021
https://doi.org/10.1007/978-3-030-70210-6_35
Hong E(2019)DrWebusic : Real-time Interactive Audio System on the WebJournal of Digital Contents Society10.9728/dcs.2019.20.9.175520:8(1755-1761)Online publication date: 30-Sep-2019
https://doi.org/10.9728/dcs.2019.20.9.1755
De Prisco RMalandrino DZaccagnino GZaccagnino R(2017)BAND: A mobile-based collaboration system for composing and playing music2017 4th International Conference on Systems and Informatics (ICSAI)10.1109/ICSAI.2017.8248544(1625-1630)Online publication date: Nov-2017
https://doi.org/10.1109/ICSAI.2017.8248544
Wang GSalazar SOh JHamilton R(2015)World Stage: Crowdsourcing Paradigm for Expressive Social Mobile MusicJournal of New Music Research10.1080/09298215.2014.99173944:2(112-128)Online publication date: 16-Feb-2015
https://doi.org/10.1080/09298215.2014.991739
Mancini MVarni GKleimola JVolpe GCamurri A(2010)Human movement expressivity for mobile active music listeningJournal on Multimodal User Interfaces10.1007/s12193-010-0047-z4:1(27-35)Online publication date: 18-Aug-2010
https://doi.org/10.1007/s12193-010-0047-z

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents