Search Results

In the real-time demo, we demonstrate how to create a musical performance using juggling movement as an instrument. We have equipped juggling balls with accelerometers, gyroscopes, and WiFi sensors. The system measures acceleration and rotation in a ...

"Draw portraits by music", an interactive work of art. Compared with music visualization and image style conversion, it's AI's imitation of human synaesthetic. New portraits gradually appear on the screen and are synchronized with music in real-time. ...

In this paper, we present Synesthesia Wear, a full-body, customizable haptic interface, and demonstrate its capabilities with an untethered spatial computing experience. This wear not only looks as flexible as ordinary cloth, but also the attached ...

Syn(es)thetic Reality explores a new way of sensing the world by understanding sounds through colors. It looks to simulate projective chromesthesia, an experience of seeing colors involuntarily as a result of sound input. The project achieves this ...

This paper presents a game-like experience that translates tactile input into text, which captures the emotional qualities of that touch. We describe the experience and the system that generates it: a plush toy instrumented with pressure sensors, a ...

Digital devices usually contain pre-programmed constraints and behaviours. These behaviours are programmed by the architect of these devices. Analogue devices, on the other hand, are bound by the properties of the components connected to them. ...

Opto-Phono-Kinesia (OPK) is an audio-visual performance piece in which all media elements are controlled by the body movements of a single performer. The title is a play on a possible synesthetic state involving connections between vision, sound and ...

The Synesthesia Suit provides immersive embodied experience in Virtual Reality environment with vibro-tactile sensations on the entire body. Each vibro-tactile actuator provides not a simple vibration such as traditional game controller, but we designed ...

The Synesthesia Suit provides immersive embodied experience in Virtual Reality environment with vibro-tactile sensations on the entire body. Each vibro-tactile actuator provides not a simple vibration such as traditional game controller, but we designed ...

Site Weave is an interactive installation exploring the idea that different locations within a site are interconnected through music, that is; they exist in a musical network that creates a natural relationship between them. This network is revealed ...

This paper presents a novel approach to assist users of digital cameras and augment their photograph taking experience. To this end, a realtime analysis of the images framed by the camera is conducted to assess composition, exposure and presence of ...

"scoreLight" and "scoreBots" are two experimental platforms for performative sound design and manipulation. Both are essentially synesthetic interfaces - synesthetic musical instruments - capable of translating free-hand drawings into a sonic language ...

In this paper we present Synesthetic Video, an interactive video that allows to experience video in cross-sensorial ways, to hear its colors and to influence its visual properties with sound and music, through user interaction or ambient influence. Our ...

Demonstration of a proposal of correspondence between Light and Sound. This proposal is materially exemplified by means of a new hyperinstrument, which gives its users the control over a multi-sensorial algorithmic composition generated in real-time. ...

This paper represents a systemwhich explores the reality of colour in relation to sound and dedicated firstly to blind people, the challenges they live with, their psychology and their emotions. It’s an exploration of the infinite range of colours that ...

More and more AI researchers are trying to make robots dance to music. This installment of T&C features five essays showing how this research addresses issues that are central to dance.

To develop a software tool which simulates the experience of synesthesia to produce concrete, documentable expressions of creativity. A constitutive relationship between synesthesia and creativity (Campen, 2002) and an operational relationship between ...

This paper identifies "gaps" in the manifestation and behaviour of avatars that commonly occur in games. These gaps in embodiment are sometimes surprisingly conspicuous, and cannot always be attributed to simple hardware or software limitations. Most of ...

This report presents an interface for musical performance called the spinCycle. spinCycle enables performers to make visual patterns with brightly colored objects on a spinning turntable platter that get translated into musical arrangements in real-...