Image communications in RACE 1994-1995. [IEE Conference Publications 1994, 64 (1994)]. L. van Noo... more Image communications in RACE 1994-1995. [IEE Conference Publications 1994, 64 (1994)]. L. van Noorden, P. Delogne. Abstract. During 1993 the European Commission made two calls for proposals for R&D work in Image ...
The European Union RACE (R&D in advanced communications technologies in Europe) and the futur... more The European Union RACE (R&D in advanced communications technologies in Europe) and the future ACTS (advanced communications technologies and services) programs have been contributing and continue to contribute to world-wide developments in audio-visual services. The paper focuses on research progress in: (1) Image data compression. Several methods of image analysis leading to the use of encoders based on improved hybrid DCT-DPCM (MPEG or not), object oriented, hybrid region/waveform or knowledge-based coding methods are discussed. (2) Program production in the aspects of 3D imaging, data acquisition, virtual scene construction, pre-processing and sequence generation. (3) Interoperability and multimedia access systems. The diversity of material available and the introduction of interactive or near- interactive audio-visual services led to the development of prestandards for video-on-demand (VoD) and interworking of multimedia services storage systems and customer premises equipment.
Interactive Digital Multimedia Services is the largest domain of the European Union's ACTS pr... more Interactive Digital Multimedia Services is the largest domain of the European Union's ACTS programme (Advanced Communication Technology and Services). The work in the domain will have a strong impact on the daily lives of the citizens. The projects cover a substantial part of the converging broadcasting, telecommunications and information technology. ACTS will help the sector actors to maintain and develop further their competitive strength on the basis of pre-competitive, pre-normative and pre-regulatory co-operation. Users will gain an understanding of future services. An overview is presented of the 50 or so projects ordered according to the following topics: multimedia contents manipulation and management; presentation, interaction and storage; transmission media; interworking across different networks; support for commercial services; trials; and transition scenarios/economics.
The electrocardiogram is traditionally used to diagnose a large number of heart pathologies. Rese... more The electrocardiogram is traditionally used to diagnose a large number of heart pathologies. Research to improve the readability and classification of cardiac signals includes studies geared toward sonification of the electrocardiographic signal and others involving features related to music processing, such as Mel-frequency cepstral coefficients. In terms of music processing features, this study seeks to use music information retrieval (MIR) features as electrocardiographic signal descriptors. The study compares the discriminatory capability of the introduced features in relation to standard groups such as heart rate variability, wavelet transform, descriptive statistics, Mel coefficients and fractal analysis, evaluated using classification algorithms; the signals analyzed were extracted from public databases. The group of features extracted from wavelet transform and the MIR group showed a high level of discrimination; the best representation of the ECG signals in the study was achieved in most cases by the MIR features. Moreover, a correlation coefficient higher than 0.8 was found between a number of MIR and other feature groups, indicating a likely relationship between the electrocardiographic signals and MIR features. These results suggest the feasibility of representing the analyzed signals by music information retrieval descriptors, giving the potential to consider these electrocardiographic signals as analogues to musical signals.
A number of phenomena related to the perception of isochronous tone sequences peak at a certain r... more A number of phenomena related to the perception of isochronous tone sequences peak at a certain rate (or tempo) and taper off at both slower and faster rates. In the present paper we start from the hypothesis that the peaking finds its origin in the presence of a damped ...
Chapter 7 The Functional Role and Bio-kinetics of Basic and Expressive Gestures in Activation and... more Chapter 7 The Functional Role and Bio-kinetics of Basic and Expressive Gestures in Activation and Sonification Leon van Noorden 1 1 Sound and Movement as Means for Communication In this chapter we want to reflect upon the role sound and movement can have in a ...
The intention of the experiment is to investigate whether different sounds have influence on hear... more The intention of the experiment is to investigate whether different sounds have influence on heart signal features in the situation the observer is judging the different sounds as positive or negative. As the heart is under (para)sympathetic control of the nervous system this experiment could give information about the processing of sound stimuli beyond the conscious processing of the subject. As the nature of the influence on the heart signal is not known these signals are to be analysed with AI/machine learning techniques. Heart rate variability (HRV) is a variable derived from the R-R interval peaks of electrocardiogram which exposes the interplay between the sympathetic and parasympathetic nervous system. In addition to its uses as a diagnostic tool and an active part in the clinic and research domain, the HRV has been used to study the effects of sound and music on the heart response; among others, it was observed that heart rate is higher in response to exciting music compared with tranquilizing music while heart rate variability and its low-frequency and high-frequency power are reduced. Nevertheless, it is still unclear which musical element is related to the observed changes. Thus, this study assesses the effects of harmonic intervals and noise stimuli on the heart response by using machine learning. The results show that noises and harmonic intervals change heart activity in a distinct way; e.g., the ratio between the axis of the ellipse fitted in the Poincaré plot increased between harmonic intervals and noise exposition. Moreover, the frequency content of the stimuli produces different heart responses, both with noise and harmonic intervals. In the case of harmonic intervals, it is also interesting to note how the effect of consonance quality could be found in the heart response.
Physiological experiments show that information about frequency of tones is coded in two distinct... more Physiological experiments show that information about frequency of tones is coded in two distinct ways in the auditory nerve. Nerve spikes can be distinguished as to when and where (in which nerve fiber) they occur. It is an old question whether the time or the place information plays a role in pitch perception.
Inspired by a theory of embodied music cognition, we investigate whether music can entrain the sp... more Inspired by a theory of embodied music cognition, we investigate whether music can entrain the speed of beat synchronized walking. If human walking is in synchrony with the beat and all musical stimuli have the same duration and the same tempo, then differences in walking speed can only be the result of music-induced differences in stride length, thus reflecting the vigor or physical strength of the movement. Participants walked in an open field in synchrony with the beat of 52 different musical stimuli all having a tempo of 130 beats per minute and a meter of 4 beats. The walking speed was measured as the walked distance during a time interval of 30 seconds. The results reveal that some music is 'activating' in the sense that it increases the speed, and some music is 'relaxing' in the sense that it decreases the speed, compared to the spontaneous walked speed in response to metronome stimuli. Participants are consistent in their observation of qualitative differences between the relaxing and activating musical stimuli. Using regression analysis, it was possible to set up a predictive model using only four sonic features that explain 60% of the variance. The sonic features capture variation in loudness and pitch patterns at periods of three, four and six beats, suggesting that expressive patterns in music are responsible for the effect. The mechanism may be attributed to an attentional shift, a subliminal audio-motor entrainment mechanism, or an arousal effect, but further study is needed to figure this out. Overall, the study supports the hypothesis that recurrent patterns of fluctuation affecting the binary meter strength of the music may entrain the vigor of the movement. The study opens up new perspectives for understanding the relationship between entrainment and expressiveness, with the possibility to develop applications that can be used in domains such as sports and physical rehabilitation.
Research by S. Handel and J. S. Oshinsky (1981) has shown that when tapping to polyrhythms, peopl... more Research by S. Handel and J. S. Oshinsky (1981) has shown that when tapping to polyrhythms, people synchronize with different subsequences depending on the overall tempo, with a global change from the faster component at slow tempi to the slower component at medium tempi and then to the overall repeating pattern at fast tempi. In this article, similar polyrhythmic patterns are studied, adding larger pitch intervals between the two sequences. The results largely confirm the findings of Handel and Oshinsky at small pitch intervals, but at larger pitch intervals, the importance of the overall pattern decreases in favor of the slow component of the polyrhythm. This effect can be explained by the increased possibility for streaming of the two components and the decrease in peripheral interaction of the coinciding tones. The results of the experiment are modeled following the resonance model for temporal selectivity proposed by L. Van Noorden and D. Moelants (1999). The preference for certain subsequences can be explained as a resonance phenomenon with a natural frequency of 2 Hz.
The present study focuses on the intricate relationship between human body movement and music, in... more The present study focuses on the intricate relationship between human body movement and music, in particular on how music may influence the way humans walk. In an experiment, participants were asked to synchronize their walking tempo with the tempo of musical and metronome stimuli. The walking tempo and walking speed were measured. The tempi of the stimuli varied between 50 and 190 beats per minute. The data revealed that people walk faster on music than on metronome stimuli and that walking on music can be modeled as a resonance phenomenon that is related to the perceptual resonance phenomenon as described by Van Noorden and Moelants (Van
This article presents the views of four sets of authors, each taking concepts of embodied cogniti... more This article presents the views of four sets of authors, each taking concepts of embodied cognition into problem spaces where the new paradigm can be applied. The first considers consequences of embodied cognition on the legal system. The second explores how embodied cognition can change how we interpret and interact with art and literature. The third examines how we move through architectural spaces from an embodied cognition perspective. And the fourth addresses how music cognition is influenced by the approach. Each contribution is brief. They are meant to suggest the potential reach of embodied cognition, increase the visibility of applications, and inspire potential avenues for research.
Measuring musically embodied movement. Please use this identifier to cite or link to this item: R... more Measuring musically embodied movement. Please use this identifier to cite or link to this item: Record Details. Record ID, 778123. Record Type, conference. Author, Frederik Styns; Leon vanNoorden; Dirk Moelants; Marc Leman. Title, Measuring musically embodied movement. ...
... Record Details. Record ID, 778155. Record Type, conference. Author, Leon van Noorden; Frederi... more ... Record Details. Record ID, 778155. Record Type, conference. Author, Leon van Noorden; Frederik Styns [801001868925] - Ghent University Frederik.Styns@UGent.be; Dirk Moelants [801000937321] - Ghent University Dirk.Moelants@UGent.be; ...
Modern mobile media players have sensors embedded in their hardware, allowing new ways to interac... more Modern mobile media players have sensors embedded in their hardware, allowing new ways to interact with the device. We build upon D-Jogger, an application that uses an accelerometer and gyroscope to analyze body movement in order to dynamically select music and adapt its tempo to the users" pace. Choosing the correct music during training sessions can have a positive effect on the performance, possibly due to the entrainment effect. However, the user control remains an issue: during a run session for example it is impossible to navigate in menus. For this, we propose a method of gesture recognition on a touchscreen for simple user input and feedback, making D-Jogger a multimodal media player.
Image communications in RACE 1994-1995. [IEE Conference Publications 1994, 64 (1994)]. L. van Noo... more Image communications in RACE 1994-1995. [IEE Conference Publications 1994, 64 (1994)]. L. van Noorden, P. Delogne. Abstract. During 1993 the European Commission made two calls for proposals for R&D work in Image ...
The European Union RACE (R&D in advanced communications technologies in Europe) and the futur... more The European Union RACE (R&D in advanced communications technologies in Europe) and the future ACTS (advanced communications technologies and services) programs have been contributing and continue to contribute to world-wide developments in audio-visual services. The paper focuses on research progress in: (1) Image data compression. Several methods of image analysis leading to the use of encoders based on improved hybrid DCT-DPCM (MPEG or not), object oriented, hybrid region/waveform or knowledge-based coding methods are discussed. (2) Program production in the aspects of 3D imaging, data acquisition, virtual scene construction, pre-processing and sequence generation. (3) Interoperability and multimedia access systems. The diversity of material available and the introduction of interactive or near- interactive audio-visual services led to the development of prestandards for video-on-demand (VoD) and interworking of multimedia services storage systems and customer premises equipment.
Interactive Digital Multimedia Services is the largest domain of the European Union's ACTS pr... more Interactive Digital Multimedia Services is the largest domain of the European Union's ACTS programme (Advanced Communication Technology and Services). The work in the domain will have a strong impact on the daily lives of the citizens. The projects cover a substantial part of the converging broadcasting, telecommunications and information technology. ACTS will help the sector actors to maintain and develop further their competitive strength on the basis of pre-competitive, pre-normative and pre-regulatory co-operation. Users will gain an understanding of future services. An overview is presented of the 50 or so projects ordered according to the following topics: multimedia contents manipulation and management; presentation, interaction and storage; transmission media; interworking across different networks; support for commercial services; trials; and transition scenarios/economics.
The electrocardiogram is traditionally used to diagnose a large number of heart pathologies. Rese... more The electrocardiogram is traditionally used to diagnose a large number of heart pathologies. Research to improve the readability and classification of cardiac signals includes studies geared toward sonification of the electrocardiographic signal and others involving features related to music processing, such as Mel-frequency cepstral coefficients. In terms of music processing features, this study seeks to use music information retrieval (MIR) features as electrocardiographic signal descriptors. The study compares the discriminatory capability of the introduced features in relation to standard groups such as heart rate variability, wavelet transform, descriptive statistics, Mel coefficients and fractal analysis, evaluated using classification algorithms; the signals analyzed were extracted from public databases. The group of features extracted from wavelet transform and the MIR group showed a high level of discrimination; the best representation of the ECG signals in the study was achieved in most cases by the MIR features. Moreover, a correlation coefficient higher than 0.8 was found between a number of MIR and other feature groups, indicating a likely relationship between the electrocardiographic signals and MIR features. These results suggest the feasibility of representing the analyzed signals by music information retrieval descriptors, giving the potential to consider these electrocardiographic signals as analogues to musical signals.
A number of phenomena related to the perception of isochronous tone sequences peak at a certain r... more A number of phenomena related to the perception of isochronous tone sequences peak at a certain rate (or tempo) and taper off at both slower and faster rates. In the present paper we start from the hypothesis that the peaking finds its origin in the presence of a damped ...
Chapter 7 The Functional Role and Bio-kinetics of Basic and Expressive Gestures in Activation and... more Chapter 7 The Functional Role and Bio-kinetics of Basic and Expressive Gestures in Activation and Sonification Leon van Noorden 1 1 Sound and Movement as Means for Communication In this chapter we want to reflect upon the role sound and movement can have in a ...
The intention of the experiment is to investigate whether different sounds have influence on hear... more The intention of the experiment is to investigate whether different sounds have influence on heart signal features in the situation the observer is judging the different sounds as positive or negative. As the heart is under (para)sympathetic control of the nervous system this experiment could give information about the processing of sound stimuli beyond the conscious processing of the subject. As the nature of the influence on the heart signal is not known these signals are to be analysed with AI/machine learning techniques. Heart rate variability (HRV) is a variable derived from the R-R interval peaks of electrocardiogram which exposes the interplay between the sympathetic and parasympathetic nervous system. In addition to its uses as a diagnostic tool and an active part in the clinic and research domain, the HRV has been used to study the effects of sound and music on the heart response; among others, it was observed that heart rate is higher in response to exciting music compared with tranquilizing music while heart rate variability and its low-frequency and high-frequency power are reduced. Nevertheless, it is still unclear which musical element is related to the observed changes. Thus, this study assesses the effects of harmonic intervals and noise stimuli on the heart response by using machine learning. The results show that noises and harmonic intervals change heart activity in a distinct way; e.g., the ratio between the axis of the ellipse fitted in the Poincaré plot increased between harmonic intervals and noise exposition. Moreover, the frequency content of the stimuli produces different heart responses, both with noise and harmonic intervals. In the case of harmonic intervals, it is also interesting to note how the effect of consonance quality could be found in the heart response.
Physiological experiments show that information about frequency of tones is coded in two distinct... more Physiological experiments show that information about frequency of tones is coded in two distinct ways in the auditory nerve. Nerve spikes can be distinguished as to when and where (in which nerve fiber) they occur. It is an old question whether the time or the place information plays a role in pitch perception.
Inspired by a theory of embodied music cognition, we investigate whether music can entrain the sp... more Inspired by a theory of embodied music cognition, we investigate whether music can entrain the speed of beat synchronized walking. If human walking is in synchrony with the beat and all musical stimuli have the same duration and the same tempo, then differences in walking speed can only be the result of music-induced differences in stride length, thus reflecting the vigor or physical strength of the movement. Participants walked in an open field in synchrony with the beat of 52 different musical stimuli all having a tempo of 130 beats per minute and a meter of 4 beats. The walking speed was measured as the walked distance during a time interval of 30 seconds. The results reveal that some music is 'activating' in the sense that it increases the speed, and some music is 'relaxing' in the sense that it decreases the speed, compared to the spontaneous walked speed in response to metronome stimuli. Participants are consistent in their observation of qualitative differences between the relaxing and activating musical stimuli. Using regression analysis, it was possible to set up a predictive model using only four sonic features that explain 60% of the variance. The sonic features capture variation in loudness and pitch patterns at periods of three, four and six beats, suggesting that expressive patterns in music are responsible for the effect. The mechanism may be attributed to an attentional shift, a subliminal audio-motor entrainment mechanism, or an arousal effect, but further study is needed to figure this out. Overall, the study supports the hypothesis that recurrent patterns of fluctuation affecting the binary meter strength of the music may entrain the vigor of the movement. The study opens up new perspectives for understanding the relationship between entrainment and expressiveness, with the possibility to develop applications that can be used in domains such as sports and physical rehabilitation.
Research by S. Handel and J. S. Oshinsky (1981) has shown that when tapping to polyrhythms, peopl... more Research by S. Handel and J. S. Oshinsky (1981) has shown that when tapping to polyrhythms, people synchronize with different subsequences depending on the overall tempo, with a global change from the faster component at slow tempi to the slower component at medium tempi and then to the overall repeating pattern at fast tempi. In this article, similar polyrhythmic patterns are studied, adding larger pitch intervals between the two sequences. The results largely confirm the findings of Handel and Oshinsky at small pitch intervals, but at larger pitch intervals, the importance of the overall pattern decreases in favor of the slow component of the polyrhythm. This effect can be explained by the increased possibility for streaming of the two components and the decrease in peripheral interaction of the coinciding tones. The results of the experiment are modeled following the resonance model for temporal selectivity proposed by L. Van Noorden and D. Moelants (1999). The preference for certain subsequences can be explained as a resonance phenomenon with a natural frequency of 2 Hz.
The present study focuses on the intricate relationship between human body movement and music, in... more The present study focuses on the intricate relationship between human body movement and music, in particular on how music may influence the way humans walk. In an experiment, participants were asked to synchronize their walking tempo with the tempo of musical and metronome stimuli. The walking tempo and walking speed were measured. The tempi of the stimuli varied between 50 and 190 beats per minute. The data revealed that people walk faster on music than on metronome stimuli and that walking on music can be modeled as a resonance phenomenon that is related to the perceptual resonance phenomenon as described by Van Noorden and Moelants (Van
This article presents the views of four sets of authors, each taking concepts of embodied cogniti... more This article presents the views of four sets of authors, each taking concepts of embodied cognition into problem spaces where the new paradigm can be applied. The first considers consequences of embodied cognition on the legal system. The second explores how embodied cognition can change how we interpret and interact with art and literature. The third examines how we move through architectural spaces from an embodied cognition perspective. And the fourth addresses how music cognition is influenced by the approach. Each contribution is brief. They are meant to suggest the potential reach of embodied cognition, increase the visibility of applications, and inspire potential avenues for research.
Measuring musically embodied movement. Please use this identifier to cite or link to this item: R... more Measuring musically embodied movement. Please use this identifier to cite or link to this item: Record Details. Record ID, 778123. Record Type, conference. Author, Frederik Styns; Leon vanNoorden; Dirk Moelants; Marc Leman. Title, Measuring musically embodied movement. ...
... Record Details. Record ID, 778155. Record Type, conference. Author, Leon van Noorden; Frederi... more ... Record Details. Record ID, 778155. Record Type, conference. Author, Leon van Noorden; Frederik Styns [801001868925] - Ghent University Frederik.Styns@UGent.be; Dirk Moelants [801000937321] - Ghent University Dirk.Moelants@UGent.be; ...
Modern mobile media players have sensors embedded in their hardware, allowing new ways to interac... more Modern mobile media players have sensors embedded in their hardware, allowing new ways to interact with the device. We build upon D-Jogger, an application that uses an accelerometer and gyroscope to analyze body movement in order to dynamically select music and adapt its tempo to the users" pace. Choosing the correct music during training sessions can have a positive effect on the performance, possibly due to the entrainment effect. However, the user control remains an issue: during a run session for example it is impossible to navigate in menus. For this, we propose a method of gesture recognition on a touchscreen for simple user input and feedback, making D-Jogger a multimodal media player.
Uploads
Papers by Leon van Noorden