References: [1] Tatsuo Unemi, “SBArt4 as Automatic Art and Live Performance Tool”, GA 2011 – XIV ... more References: [1] Tatsuo Unemi, “SBArt4 as Automatic Art and Live Performance Tool”, GA 2011 – XIV Generative Art Conference, Rome, 2011. [2] www.intlab.soka.ac.jp/ ~unemi/sbart/4/ Abstract: As everyone knows, the sound effect and background music of motion picture is effective to emphasize what the author wanted to express. However, in case of fully automated generative animation, it is difficult to introduce such a method for design of accompanying sounds because the generator has no intention behind the process. This paper introduces a method to synthesize waveforms of sounds for an automated evolutionary animation [1, 2] by computer. To emphasize the emotional effects for viewers, it was designed as to fit the psychological effect of sounds with visuals under some intuitive correspondences between these two different modalities, such as a brighter image is associated with a higher pitch, a more complex texture inspires a noisier or more solid tone, and so on. The other mappings be...
References: [1] Tatsuo Unemi, “SBArt4 Breeding Abstract Animations in Real time”, Proc. of CEC 20... more References: [1] Tatsuo Unemi, “SBArt4 Breeding Abstract Animations in Real time”, Proc. of CEC 2010, pp. 4004-4009, Barcelona, Spain, 2010. Abstract: The recent innovation of graphics processing unit (GPU) improved the calculation performance to be fast enough to realize breeding animations in real time on the personal computer. SBArt4 compiles each expression in genotype into a type of shading language, Core Image kernel language, that directly runs on GPU. Even when it renders each frame of the animation in real time, it achieves enough speed for users to evaluate the product of an abstract animation immediately. The compiled code can be exported to another application that utilizes Core Image framework on MacOS X. Four types of video effect plug-ins for Final Cut Pro and an independent application for slide presentation were examined. It is useful not only to create an abstract animation in arbitrary size and duration but also to make a transition effect by deformation and/or dis...
Identity SA is an interactive and generative installation that combines a swarm-based simulation ... more Identity SA is an interactive and generative installation that combines a swarm-based simulation with real time camera based interaction. The agents’ distributions are transformed into “painterly” images by employing a variety of different visualization techniques and styles, such as texture surfaces, short line segments, font glyphs, curved lines, etc. Camera based Interaction is based on a simple motion detection algorithm that affects the agents’ movements as well as their coloring. Normally, an agent’s color is solely determined by its orientation, but whenever the tracking system detects a visitor’s motion, the agent’s color is additionally affected by the corresponding pixel color in the camera frame. It acts as a visual and acoustic mirror, which distorts the continuity of the visitor’s physical existence into ephemeral patterns and flowing motions.
The recent innovation of graphics processing unit (GPU) improved the calculation performance to b... more The recent innovation of graphics processing unit (GPU) improved the calculation performance to be fast enough to realize breeding animations in real time on the personal computer. SBArt4 compiles each expression in genotype into a type of shading language, Core Image kernel language, that directly runs on GPU. Even when it renders each frame of the animation in real time, it achieves enough speed for users to evaluate the product of an abstract animation immediately. The compiled code can be exported to another application that utilizes Core Image framework on MacOS X. Four types of video effect plug-ins for Final Cut Pro and an independent application for slide presentation were examined. It is useful not only to create an abstract animation in arbitrary size and duration but also to make a transition effect by deformation and/or discoloration.
Cycles is an interactive installation that establishes an intimate relationship between the visit... more Cycles is an interactive installation that establishes an intimate relationship between the visitor's physical body and simulated organisms. It explores notions of transience and identity that draw inspiration from Buddhist philosophy. Cycles creates a situation that causes the visitor to experience his or her own body in a state of mutability and transience. Cycles merges the appearance of the visitor's hand with a visual repres - entation of a swarm simulation. By bridging the gap between the virtual and physical, a hybrid entity comes into existence whose rapidly changing body blends artificial and natural properties. This hybrid entity progresses through a life cycle that reenacts the four Buddhist sufferings.
The project MediaFlies realizes an interactive multi agent system, which remixes life and prereco... more The project MediaFlies realizes an interactive multi agent system, which remixes life and prerecorded audio and video material. Agents engage in flocking and behavior synchronization and thereby control the material's continuously changing fragmentation and rearrangement. Visitors can influence the agents' behaviors via a video tracking system and thus shift the ratio of disorder and recognizability in MediaFlies acoustic and visual feedback.
References: [1] Tatsuo Unemi, “SBArt4 as Automatic Art and Live Performance Tool”, GA 2011 – XIV ... more References: [1] Tatsuo Unemi, “SBArt4 as Automatic Art and Live Performance Tool”, GA 2011 – XIV Generative Art Conference, Rome, 2011. [2] www.intlab.soka.ac.jp/ ~unemi/sbart/4/ Abstract: As everyone knows, the sound effect and background music of motion picture is effective to emphasize what the author wanted to express. However, in case of fully automated generative animation, it is difficult to introduce such a method for design of accompanying sounds because the generator has no intention behind the process. This paper introduces a method to synthesize waveforms of sounds for an automated evolutionary animation [1, 2] by computer. To emphasize the emotional effects for viewers, it was designed as to fit the psychological effect of sounds with visuals under some intuitive correspondences between these two different modalities, such as a brighter image is associated with a higher pitch, a more complex texture inspires a noisier or more solid tone, and so on. The other mappings be...
References: [1] Tatsuo Unemi, “SBArt4 Breeding Abstract Animations in Real time”, Proc. of CEC 20... more References: [1] Tatsuo Unemi, “SBArt4 Breeding Abstract Animations in Real time”, Proc. of CEC 2010, pp. 4004-4009, Barcelona, Spain, 2010. Abstract: The recent innovation of graphics processing unit (GPU) improved the calculation performance to be fast enough to realize breeding animations in real time on the personal computer. SBArt4 compiles each expression in genotype into a type of shading language, Core Image kernel language, that directly runs on GPU. Even when it renders each frame of the animation in real time, it achieves enough speed for users to evaluate the product of an abstract animation immediately. The compiled code can be exported to another application that utilizes Core Image framework on MacOS X. Four types of video effect plug-ins for Final Cut Pro and an independent application for slide presentation were examined. It is useful not only to create an abstract animation in arbitrary size and duration but also to make a transition effect by deformation and/or dis...
Identity SA is an interactive and generative installation that combines a swarm-based simulation ... more Identity SA is an interactive and generative installation that combines a swarm-based simulation with real time camera based interaction. The agents’ distributions are transformed into “painterly” images by employing a variety of different visualization techniques and styles, such as texture surfaces, short line segments, font glyphs, curved lines, etc. Camera based Interaction is based on a simple motion detection algorithm that affects the agents’ movements as well as their coloring. Normally, an agent’s color is solely determined by its orientation, but whenever the tracking system detects a visitor’s motion, the agent’s color is additionally affected by the corresponding pixel color in the camera frame. It acts as a visual and acoustic mirror, which distorts the continuity of the visitor’s physical existence into ephemeral patterns and flowing motions.
The recent innovation of graphics processing unit (GPU) improved the calculation performance to b... more The recent innovation of graphics processing unit (GPU) improved the calculation performance to be fast enough to realize breeding animations in real time on the personal computer. SBArt4 compiles each expression in genotype into a type of shading language, Core Image kernel language, that directly runs on GPU. Even when it renders each frame of the animation in real time, it achieves enough speed for users to evaluate the product of an abstract animation immediately. The compiled code can be exported to another application that utilizes Core Image framework on MacOS X. Four types of video effect plug-ins for Final Cut Pro and an independent application for slide presentation were examined. It is useful not only to create an abstract animation in arbitrary size and duration but also to make a transition effect by deformation and/or discoloration.
Cycles is an interactive installation that establishes an intimate relationship between the visit... more Cycles is an interactive installation that establishes an intimate relationship between the visitor's physical body and simulated organisms. It explores notions of transience and identity that draw inspiration from Buddhist philosophy. Cycles creates a situation that causes the visitor to experience his or her own body in a state of mutability and transience. Cycles merges the appearance of the visitor's hand with a visual repres - entation of a swarm simulation. By bridging the gap between the virtual and physical, a hybrid entity comes into existence whose rapidly changing body blends artificial and natural properties. This hybrid entity progresses through a life cycle that reenacts the four Buddhist sufferings.
The project MediaFlies realizes an interactive multi agent system, which remixes life and prereco... more The project MediaFlies realizes an interactive multi agent system, which remixes life and prerecorded audio and video material. Agents engage in flocking and behavior synchronization and thereby control the material's continuously changing fragmentation and rearrangement. Visitors can influence the agents' behaviors via a video tracking system and thus shift the ratio of disorder and recognizability in MediaFlies acoustic and visual feedback.
Uploads
Papers by Tatsuo Unemi