research-article

Machine Improvisation with Variable Markov Oracle: Toward Guided and Structured Improvisation

Authors:

Shlomo DubnovAuthors Info & Claims

Computers in Entertainment (CIE), Volume 14, Issue 3

Article No.: 4, Pages 1 - 18

https://doi.org/10.1145/2905371

Published: 31 December 2016 Publication History

Abstract

In this article, we describe the Variable Markov Oracle and how it can be used in stylistic machine music improvisation scenarios. A Variable Markov Oracle is a data structure capable of identifying repeated subsequences within a multivariate time series. A Variable Markov Oracle symbolizes a time series by maximizing an information theoretic measure. After symbolizing the time series, repetitive structures can be extracted and used for music improvisation. We present a machine improvisation framework, using a Variable Markov Oracle, that is capable of generating novel audio content for either real-time or stored audio input. This work focuses on guided improvisation and structured improvisation.

References

[1]

Cyril Allauzen, Maxime Crochemore, and Mathieu Raffinot. 1999. Factor oracle: A new structure for pattern matching. In Theory and Practice of Informatics (SOFSEM'99). Springer, 295--310.

Digital Library

[2]

Antoine Allombert, Raphël Marczak, Myriam Desainte-Catherine, Pascal Baltazar, Laurent Garnier, and Blue Yeti. 2010. Virage: Designing an interactive intermedia sequencer from users requirements and theoretical background. In Proceedings of the International Computer Music Conference.

[3]

Charles Ames. 1987. Automated composition in retrospect: 1956--1986. Leonardo 20, 2 (January 1987), 169--185.

[4]

Christopher Ariza. 2009. The interrogator as critic: The turing test and the evaluation of generative music systems. Computer Music Journal 33, 2 (2009), 48--70.

Digital Library

[5]

Gérard Assayag and Georges Bloch. 2007. Navigating the oracle: A heuristic approach. In Proceedings of the International Computer Music Conference, Vol. 7. 405--412.

[6]

Gérard Assayag, Georges Bloch, Marc Chemillier, Arshia Cont, and Shlomo Dubnov. 2006. Omax brothers: A dynamic yopology of agents for improvization learning. In Proceedings of the 1st ACM Workshop on Audio and Music Computing Multimedia. ACM, 125--132.

Digital Library

[7]

Gérard Assayag and Shlomo Dubnov. 2004. Using factor oracles for machine improvisation. Soft Computing 8, 9 (2004), 604--610.

Digital Library

[8]

Arshia Cont, Shlomo Dubnov, and Gérard Assayag. 2007. Guidage: A fast audio query guided assemblage. In Proceedings of International Computer Music Conference (ICMC).

[9]

Matthew E. P. Davies and Mark D. Plumbley. 2007. Context-dependent beat tracking of musical audio. IEEE Transactions on Audio, Speech, and Language Processing 15, 3 (2007), 1009--1020.

Digital Library

[10]

Alexandre Donze, Sophie Libkind, Sanjit A. Seshia, and David Wessel. 2013. Control Improvisation with Application to Music. Technical Report. DTIC Document.

[11]

Shlomo Dubnov. 2006. Spectral anticipations. Computer Music Journal 30, 2 (2006), 63--83.

Digital Library

[12]

Shlomo Dubnov and Gérard Assayag. 2013. Memex and Composer Duets: Computer-aided composition using style mixing. Open Music Composers Book 2 (2013), 53--66.

[13]

Shlomo Dubnov, Gérard Assayag, and Arshia Cont. 2011. Audio oracle analysis of musical information rate. In Proceedings of the 2011 5th IEEE International Conference on Semantic Computing (ICSC'11). IEEE, 567--571.

Digital Library

[14]

Shlomo Dubnov, Gérard Assayag, and Arshia Cont. 2007. Audio oracle: A new algorithm for fast learning of audio structures. In Proceedings of International Computer Music Conference (ICMC).

[15]

Shlomo Dubnov, Gerard Assayag, Olivier Lartillot, and Gill Bejerano. 2003. Using machine-learning methods for musical style modeling. Computer 36, 10 (2003), 73--80.

Digital Library

[16]

José Echeveste, Arshia Cont, Jean-Louis Giavitto, and Florent Jacquemard. 2013. Operational semantics of a domain specific language for real time musician--computer interaction. Discrete Event Dynamic Systems 23, 4 (2013), 343--383.

Digital Library

[17]

Arne Eigenfeldt. 2014. Generating structure--towards large-scale formal generation. In Proceedings of the 10th Artificial Intelligence and Interactive Digital Entertainment Conference.

[18]

Arne Eigenfeldt, Oliver Bown, Philippe Pasquier, and Aengus Martin. 2013. Towards a taxonomy of musical metacreation: Reflections on the first musical metacreation weekend. In Proceedings of the Artificial Intelligence and Interactive Digital Entertainment Conference (AHDE3'13).

[19]

Arne Eigenfeldt, Adam Burnett, and Philippe Pasquier. 2012. Evaluating musical metacreation in a live performance context. In Proceedings of the 3rd International Conference on Computational Creativity. Citeseer, 140--144.

[20]

Arne Eigenfeldt and Philippe Pasquier. 2013. Evolving structures for electronic dance music. In Proceedings of the 15th Annual Conference on Genetic and Evolutionary Computation. ACM, 319--326.

Digital Library

[21]

Sebastian Ewert, Meinard Müller, and Roger B. Dannenberg. 2011. Towards reliable partial music alignments using multiple synchronization strategies. In Adaptive Multimedia Retrieval. Understanding Media and Adapting to the User. Springer, 35--48.

Digital Library

[22]

Eliot Handelman and Andie Sigler. 2014. Artik: Articulation and dynamics from structural pattern analysis. In Proceedings of the 10th Artificial Intelligence and Interactive Digital Entertainment Conference.

[23]

Arnaud Lefebvre and Thierry Lecroq. 2002. Compror: On-line lossless data compression with a factor oracle. Information Processing Letters 83, 1 (2002), 1--6.

Digital Library

[24]

Arnaud Lefebvre, Thierry Lecroq, and Joël Alexandre. 2003. An improved algorithm for finding longest repeats with a modified factor oracle. Journal of Automata, Languages and Combinatorics 8, 4 (2003), 647--657.

Digital Library

[25]

Max V. Mathews, Joan E. Miller, F. Richard Moore, John R. Pierce, and Jean-Claude Risset. 1969. The Technology of Computer Music. MIT Press, Cambridge.

Digital Library

[26]

François Pachet and Pierre Roy. 2011. Markov constraints: Steerable generation of Markov sequences. Constraints 16, 2 (2011), 148--172.

Digital Library

[27]

Renato Panda, Ricardo Malheiro, Bruno Rocha, António Oliveira, and Rui Pedro Paiva. 2013. Multi-modal music emotion recognition: A new dataset, methodology and comparative analysis. In Proceedings of the 10th International Symposium on Computer Music Multidisciplinary Research.

[28]

Dana Ron, Yoram Singer, and Naftali Tishby. 1996. The power of amnesia: Learning probabilistic automata with variable memory length. Machine Learning 25, 2--3 (1996), 117--149.

Digital Library

[29]

Pierre Roy and François Pachet. 2013. Enforcing Meter in Finite-Length Markov Sequences. In Twenty-Seventh AAAI Conference on Artificial Intelligence.

Digital Library

[30]

Greg Surges and Shlomo Dubnov. 2013. Feature selection and composition using PyOracle. In Proceedings of the 9th Artificial Intelligence and Interactive Digital Entertainment Conference.

[31]

Martin J. Wainwright and Michael I. Jordan. 2008. Graphical models, exponential families, and variational inference. Foundations and Trends in Machine Learning 1, 1--2 (2008), 1--305.

Digital Library

[32]

Cheng-i Wang and Shlomo Dubnov. 2014. Guided music synthesis with variable Markov oracle. In Proceedings of the 10th Artificial Intelligence and Interactive Digital Entertainment Conference.

[33]

Cheng-i Wang and Shlomo Dubnov. 2015. The variable Markov oracle: Algorithms for human gesture applications. IEEE MultiMedia 22, 4 (2015), 52--67.

Cited By

Assayag GBonnasse-Gahot LBorg J(2024)Cocreative Interaction: Somax2 and the REACH ProjectComputer Music Journal10.1162/comj_a_00662(1-19)Online publication date: 6-Feb-2024
https://doi.org/10.1162/comj_a_00662
Carvalho NBernardes G(2021)SyVMO: Synchronous Variable Markov Oracle for Modeling and Predicting Multi-part Musical StructuresArtificial Intelligence in Music, Sound, Art and Design10.1007/978-3-030-72914-1_3(37-51)Online publication date: 2-Apr-2021
https://doi.org/10.1007/978-3-030-72914-1_3

Index Terms

Machine Improvisation with Variable Markov Oracle: Toward Guided and Structured Improvisation
1. Applied computing
  1. Arts and humanities
    1. Sound and music computing

Recommendations

SyVMO: Synchronous Variable Markov Oracle for Modeling and Predicting Multi-part Musical Structures
Artificial Intelligence in Music, Sound, Art and Design
Abstract
We present SyVMO, an algorithmic extension of the Variable Markov Oracle algorithm, to model and predict multi-part dependencies from symbolic music manifestations. Our model has been implemented as a software application named INCITe for computer-...
Performer-centered visual feedback for human-machine improvisation
Theoretical and Practical Computer Applications in Entertainment

This article describes the design and implementation of the Multimodal Interactive Musical Improvisation (Mimi) system. Unique to Mimi is its visual interface, which provides the performer with instantaneous and continuous information on the state of ...
Emergent formal structures of factor oracle-driven musical improvisations
MCM'11: Proceedings of the Third international conference on Mathematics and computation in music

In this article, improvisations created with the factor oracle, a commonly used data structure in machine models of musical improvisation, are shown to exhibit certain formal structures independent of the musical content. We posit that these structures ...

Comments

Information & Contributors

Information

Published In

cover image Computers in Entertainment

Computers in Entertainment Volume 14, Issue 3

Special Issue on Musical Metacreation, Part II

Fall 2016

109 pages

EISSN:1544-3574

DOI:10.1145/3023312

Issue’s Table of Contents

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 December 2016

Accepted: 01 March 2016

Revised: 01 November 2015

Received: 01 May 2015

Published in CIE Volume 14, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
189
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)3

Reflects downloads up to 17 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Assayag GBonnasse-Gahot LBorg J(2024)Cocreative Interaction: Somax2 and the REACH ProjectComputer Music Journal10.1162/comj_a_00662(1-19)Online publication date: 6-Feb-2024
https://doi.org/10.1162/comj_a_00662
Carvalho NBernardes G(2021)SyVMO: Synchronous Variable Markov Oracle for Modeling and Predicting Multi-part Musical StructuresArtificial Intelligence in Music, Sound, Art and Design10.1007/978-3-030-72914-1_3(37-51)Online publication date: 2-Apr-2021
https://doi.org/10.1007/978-3-030-72914-1_3

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Issue’s Table of Contents