Recent efforts to connect builders to digital designs during construction have primarily focused on visual augmented reality, which requires accurate registration and specific lighting, and which could prevent a user from noticing safety hazards. Haptic ...

Wearables integrating movement sonification can support body-perception changes and related physical activity; yet, we lack design principles for such sonifications. Through two mixed-methods studies, we investigate sound pitch and movement direction ...

The use of wearable sensor technology opens up exciting avenues for both art and HCI research, providing new ways to explore the invisible link between audience and performer. To be effective, such work requires close collaboration between performers and ...

Losing Her Voice is a new opera which highlights the challenges of subtly interweaving digital technologies into established cultural forms. Audience members were encouraged to use their own mobile phones to interact with on-stage projections before, ...

Software tools for generating digital sound often present users with high-dimensional, parametric interfaces, that may not facilitate exploration of diverse sound designs. In this article, we propose to investigate artificial agents using deep ...

Through sensors carried by people and sensors embedded in the environment, personal data is being processed to try to understand activity patterns and people's internal states in the context of human-building interaction. This data is used to actuate ...

The purpose of pitch correction is to assist a musician in playing notes with accuracy and precision, without preventing expressive pitch variations. This study presents and examines a new method for automatic pitch correction: Dynamic Pitch Warping (DPW)...

There has been little research on how interactions with tabletop and Tangible User Interfaces (TUIs) by groups of users change over time. In this article, we investigate the challenges and opportunities of a tabletop tangible interface based on ...

Our surroundings are becoming infused with sensors measuring a variety of data streams about the environment, people and objects. Such data can be used to make the spaces that we inhabit responsive and interactive. Personal data in its different forms ...

The growing volume of digital music, photos and video challenges media management software and organizing schemes alike. Through 20 in situ, two hour interviews we explored the when, why and how of our participants' organizational schemes. We sought and ...

In interaction design for experience-oriented uses of technology, a central facet of aesthetics of interaction is rooted in the user's experience of herself “performing her perception.” By drawing on performance (theater) theory, phenomenology and ...

As computer technologies and their potential emerging applications spread out, new needs have been detected for computer-based applications of music; cooperative music notation editing both in orchestras and music schools is one of them. This article is ...

We present a software system, called Tunserver, which recognizes a musical tune whistled by the user, finds it in a database, and returns its name, composer, and other information. Such a service is useful for track retrieval at radio stations, music ...

Inhabited television combines collaborative virtual environments (CVEs) with broadcast television so that on-line audiences can participate in television shows within shared virtual worlds. We describe a series of experiments with inhabited television, ...