research-article

Mobile collaborative live video mixing

Authors:

M. Esbjörnsson,

O. JuhlinAuthors Info & Claims

MobileHCI '08: Proceedings of the 10th international conference on Human computer interaction with mobile devices and services

Pages 157 - 166

https://doi.org/10.1145/1409240.1409258

Published: 02 September 2008 Publication History

Abstract

We report on design research investigating a possible combination of mobile collaborative live video production and V Jing. In an attempt to better understand future forms of collaborative live media production, we study how VJs produce and mix visuals live. In the practice of producing visuals through interaction with both music and visitors, VJing embodies interesting properties that could inform the design of emerging mobile services. As a first step to examine a generation of new applications, we tease out some characteristics of VJ production and live performance. We then decide on the requirements both for how visitors could capture and transmit live video using their mobile phones and how this new medium could be integrated within VJ aesthetics and interaction. Finally, we present the SwarmCam application, which has been implemented to investigate these requirements.

References

[1]

Andersen, T. H. (2005). In the Mixxx: Novel Digital DJ Interfaces. Proceedings of CHI 2005. ACM, 1136--1137.

Digital Library

[2]

Beamish, T., Maclean, K. and Fels, S. (2004). Manipulating Music: Multimodal Interaction for DJs. Proceedings of CHI 2004. ACM. 327--334.

Digital Library

[3]

Bernard, D. (2006). Visual Wallpaper, VJ Theory.net Published 12/10/06.

[4]

Broth, M. (2004). The Production of a live TV---interview through mediated interaction. Proceedings of Logic and Methodology 2004. SISWO

[5]

Crevits, B. (2006). The roots of VJing --- A historical overview. VJ audio-visual art + VJ culture (ed. Mi-chael Faulkner/D-Fuse). Laurence King Publishing, 14--19.

[6]

Dessens, D. (2008). SanchTV. Available at: http://www.sanchtv.com/ (Accessed 3rd, Feb, 2008).

[7]

Engström, A., Esbjörnsson, M., Juhlin, O. and Norlin, C. (2007). More TV! - Support for local and collaborative production and consumption of mobile TV. Adjunct Proceedings of EuroITV 2007, 173--177.

[8]

Engström, A., Esbjörnsson, M. and Juhlin, O. (2008). Nighttime visual media production in club environments. To be presented at the Night and darkness: Interaction after dark - Workshop, at CHI 2008.

[9]

Esbjörnsson, M., Juhlin, O. and Östergren, M. (2004). Traffic Encounters and Hocman - Associating Motorcycle Ethnography with Design. Personal and Ubiquitous Computing, Springer Verlag, vol. 8, no. 2, 92--99.

Digital Library

[10]

Gates, C., Subramanian, S. and Gutwin, C. (2006). DJ's Perspectives on Interaction and Awareness in Nightclubs. Proceedings of DIS 2006. ACM, 70--79.

Digital Library

[11]

Gondouin, B. (2004). Grains and Pixels. Available at: http://www.bertrandgondouin.net/post/Grains-Pixels (Accessed 3^rd, Feb, 2008).

[12]

Jacucci, G., Oulasvirta, A., Salovaara, A. and Sarvas, R. (2005). Supporting the Shared Experience of Spectators through Mobile Group Media. Proceedings of Group 2005. ACM, 207--216.

Digital Library

[13]

Kirk, D., Sellen, A., Harper, R., and Wood, K. (2007). Understanding videowork. Proceedings of CHI 2007. ACM, 61--70.

Digital Library

[14]

Lippit, T. M. (2006). Turntable music in the digital era: designing alternative tools for new turntable expression. Proceedings of NIME 2006. IRCAM, 71--74.

Digital Library

[15]

Lund, H. (2008). Philosophy and cultural theory of vjing and realtime interactive performance. Available at: http://www.vjtheory.net/book.htm (Accessed 3^rd, Feb, 2008).

[16]

Manovich, L. (2001). The Language of New Media. MIT Press, 155--157.

[17]

Miller, P. D. (2004). Rhythm Science. MIT Press.

[18]

Pacemaker. (2007). Available at: http://www.pacemaker.net/. (Accessed 6^th, Dec, 2007).

[19]

Redström, J. (2001). Designing Everyday Computational Things (doctoral thesis). Gothenburg Studies in Informatics, no. 20, Dept. of Informatics, Göteborg University.

[20]

Reeves, S., Benford, S., O'Malley, C. and Fraser, M. (2005). Designing the Spectator Experience. Proceedings of CHI 2005. ACM, 741--750.

Digital Library

[21]

Sarvas, R., Viikari, M., Pesonen, J. And Nevanlinna, H. (2004). MobShare: Controlled and Immediate Sharing of Mobile Images. Proceedings of MUM 2004. ACM, 724--731.

Digital Library

[22]

Slayden, A., Spasojevic, M., Hans, M. and Smith, M. (2005). The DJammer: "Air-Scratching" and Freeing the DJ to Join the Party. Proceedings of CHI 2005. ACM, 1789--1792.

Digital Library

[23]

Sheridan, J. G., Dix, A., Lock, S. and Bayliss, A. (2004). Understanding Interaction in Ubiquitous Guerilla Performances in Playful Arenas. Proceedings of HCI 2004. Springer Verlag, 3--18.

[24]

Stampfl, P. (2003). Augmented Reality Disk Jockey --- AR/DJ. Proceedings of SIGGRAPH 2003. ACM Press, 1.

Digital Library

[25]

Storsjö, M. (2007) The design of Movino - S60 phone client, OS X components and video server. http://www.movino.org/ (Accessed 3rd, Feb, 2008).

[26]

Tazaki, A. (2006). InstantShareCam: Turning Users From Passive Media Consumers to Active Media Producers. Presented at the Workshop Investigating new user experience challenges in iTV: mobility & sociability, held at CHI'2006.

[27]

Tokuhisa, S., Iwata, Y. and Inakage, M. (2007). rhythmism: A VJ Performance System with Maracas based Devices. Proceedings of ACE 2007. ACM, 204--207.

Digital Library

[28]

Virkhaus, V. (2006). Concert visuals. VJ audio-visual art + VJ culture (ed. Mi-chael Faulkner/D-Fuse). Laurence King Publishing, 14--19.

[29]

Zimmerman J., Forlizzi, J., and Evenson, S., Research Through Design as a Method for Interaction Design Research in HCI. Proceedings of CHI 2007, April 28---May 3, 2007, San Jose, California, USA.

Digital Library

Cited By

Nishimura MTakegawa YMatsumura KHirata K(2021)Pokerepo Join: Construction of a Virtual Companion Experience SystemHuman-Computer Interaction. Design and User Experience Case Studies10.1007/978-3-030-78468-3_43(626-642)Online publication date: 3-Jul-2021
https://doi.org/10.1007/978-3-030-78468-3_43
Takegawa YMatsumura KManabe H(2019)PokeRepo Go++Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video10.1145/3317697.3325126(230-238)Online publication date: 4-Jun-2019
https://dl.acm.org/doi/10.1145/3317697.3325126
Hamilton WLupfer NBotello NTesch TStacy AMerrill JWilliford BBentley FKerne AMandryk RHancock MPerry MCox A(2018)Collaborative Live Media CurationProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174129(1-14)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3174129
Show More Cited By

Index Terms

Mobile collaborative live video mixing
1. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

User Requirements for Live Sound Visualization System Using Multitrack Audio
AM '17: Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences

In this paper, we identify design requirements for a screen-based system that enables live sound visualization using multitrack audio. Our mixed methodology is grounded in user-centered design and involved a review of the literature to assess the state-...
Live Cinema: designing an instrument for cinema editing as a live performance
NIME '04: Proceedings of the 2004 conference on New interfaces for musical expression

This paper describes the design of an expressive tangible interface for cinema editing as a live performance. A short survey of live video practices is provided. The Live Cinema instrument is a cross between a musical instrument and a film editing tool, ...
MusicalAid: A Playful Collaborative Music Tool for People Finding it Difficult to Handle Common Instruments
TEI '24: Proceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction

MusicalAid is a tangible music system that allows people with different musical literacy and gross/fine motoric skills to play and create music together, either guided by a predefined rhythm or in a ‘free play’ mode. The system is composed of a main unit ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

MobileHCI '08: Proceedings of the 10th international conference on Human computer interaction with mobile devices and services

September 2008

568 pages

ISBN:9781595939524

DOI:10.1145/1409240

Conference Chairs:
Henri ter Hofte
Telematica Instituut
,
Ingrid Mulder
Telematica Instituut & Rotterdam University

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 September 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MobileHCI08

MobileHCI08: 10th International Conference on Human Computer Interaction with Mobile Devices and Services

September 2 - 5, 2008

Amsterdam, The Netherlands

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

43
Total Citations
View Citations
1,012
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)2

Reflects downloads up to 28 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Nishimura MTakegawa YMatsumura KHirata K(2021)Pokerepo Join: Construction of a Virtual Companion Experience SystemHuman-Computer Interaction. Design and User Experience Case Studies10.1007/978-3-030-78468-3_43(626-642)Online publication date: 3-Jul-2021
https://doi.org/10.1007/978-3-030-78468-3_43
Takegawa YMatsumura KManabe H(2019)PokeRepo Go++Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video10.1145/3317697.3325126(230-238)Online publication date: 4-Jun-2019
https://dl.acm.org/doi/10.1145/3317697.3325126
Hamilton WLupfer NBotello NTesch TStacy AMerrill JWilliford BBentley FKerne AMandryk RHancock MPerry MCox A(2018)Collaborative Live Media CurationProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174129(1-14)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3174129
Shirzadian NRedi JRöggla TPanza ANack FCesar P(2018)Immersion and Togetherness: How Live Visualization of Audience Engagement Can Enhance Music EventsAdvances in Computer Entertainment Technology10.1007/978-3-319-76270-8_34(488-507)Online publication date: 21-Feb-2018
https://doi.org/10.1007/978-3-319-76270-8_34
Olowe IGrierson MBarthet MFazekas GBarthet MStockman T(2017)User Requirements for Live Sound Visualization System Using Multitrack AudioProceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences10.1145/3123514.3123527(1-8)Online publication date: 23-Aug-2017
https://dl.acm.org/doi/10.1145/3123514.3123527
Cunha BUscamayta APimentel Mde Jesus Lima Gomes Fde Andrade Lira Rabelo Rde Salles Soares Neto CWillrich RCamillo Teixeira Cde Almeida Jde Carvalho W(2016)Opportunistic Recording of Live Experiences Using Multiple Mobile DevicesProceedings of the 22nd Brazilian Symposium on Multimedia and the Web10.1145/2976796.2988164(99-102)Online publication date: 8-Nov-2016
https://dl.acm.org/doi/10.1145/2976796.2988164
Hamilton WTang JVenolia GInkpen KZillner JHuang DWhitney PMurray JBasapur SAli Hasan NHuber J(2016)RivuletProceedings of the ACM International Conference on Interactive Experiences for TV and Online Video10.1145/2932206.2932211(31-42)Online publication date: 17-Jun-2016
https://dl.acm.org/doi/10.1145/2932206.2932211
Freeman DBalakrishnan RFoth MJu WSchroeter RViller S(2016)Improv RemixProceedings of the 2016 ACM Conference on Designing Interactive Systems10.1145/2901790.2901894(533-542)Online publication date: 4-Jun-2016
https://dl.acm.org/doi/10.1145/2901790.2901894
Bartindale TSchofield GWright PKaye JDruin ALampe CMorris DHourcade J(2016)Scaffolding Community Documentary Film Making using Commissioning TemplatesProceedings of the 2016 CHI Conference on Human Factors in Computing Systems10.1145/2858036.2858102(2705-2716)Online publication date: 7-May-2016
https://dl.acm.org/doi/10.1145/2858036.2858102
Stohr DWilk SToteva IEffelsberg WSteinmetz R(2016)Context Not Content: A Novel Approach to Real-Time User-Generated Video Composition2016 IEEE International Symposium on Multimedia (ISM)10.1109/ISM.2016.0021(65-70)Online publication date: Dec-2016
https://doi.org/10.1109/ISM.2016.0021
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents