Search Results

Theaters serve as platforms that transport audiences into diverse worlds, offering a collective enjoyment of live performances and a shared cultural experience. However, theater performances have strong visual components, such as physical props and ...

The palmrest area of laptops has the potential as an additional input space, considering its consistent palm contact during keyboard interaction. We propose Palmrest+, leveraging shear force exerted on the palmrest area. We suggest two input techniques: ...

Gesture-based interactions for automotive infotainment systems pose advantages over touchscreens such as alleviating the visual field. While the focus of these advantages is on improving the driving task, it is also important that a user feels in control ...

Socially shared regulation plays a pivotal role in the success of collaborative learning. However, evaluating socially shared regulation of learning (SSRL) proves challenging due to the dynamic and infrequent cognitive and socio-emotional interactions, ...

In gesture analysis, one must segment the gesture stream into discrete units to be analyzed for meaning and alignment with accompanying speech. This requires defining what constitutes a single “gesture”. Following the influential work of Kendon (...

Following three years of working on the eTube with a collaborative interdisciplinary team, we describe the embodied and spatialized performance gestures developed in tandem with a microphone setup for interacting with musical improvising agents. Eric ...

Generating co‐speech gestures for interactive digital humans remains challenging because of the indeterministic nature of the problem. The authors observe that gestures generated from speech audio or text by existing neural methods often contain ...

Android avatar robots have a potential to be applied to various real-world scenarios. We have conducted lectures using our android in diverse settings such as conferences. Several previous studies indicated that gestures can play an important role in ...

For robots to be effective at collaborating with humans, they must be able to effectively communicate about entities in open-world tasks. Existing research on natural language generation and referring expression generation has yet to address how gesture ...

Nowadays with the continuous improvement of computer technology, human-computer interaction becomes more and more important in people's life. Among them, gesture, as an intuitive human language, has become an important way of human-computer interaction. ...

National Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence (BIGAI), China

Retrieving out-of-reach objects is a crucial task in virtual reality (VR). One of the most commonly used approaches for this ...

Orchestral conducting involves a rich vocabulary of gestures and so training conductors is challenging. We discuss how virtual reality and gesture detection could be used to aid this process. We describe our pilot interface for training conductors in ...

An innovative gesture interface called LinLED is described. Traditional interfaces often suffer from limited tracking range and significant latency when locating fingers or hands. However, LinLED presents a game-changing solution. LinLED comprises a 1D-...

Taking turns in a conversation is a delicate interplay of various signals, which we as humans can easily decipher. Embodied conversational agents (ECAs) communicating with humans should leverage this ability for smooth and enjoyable conversations. ...

When users interact with mid-air gesture-based interfaces, it is not always clear what interactions are available, or how they might be executed. Mid-air interfaces offer no tactile affordances, pushing systems to rely on other modalities (e.g. ...

Typical foreign language (L2) pronunciation training focuses mainly on individual sounds. Intonation, the patterns of pitch change across words or phrases is often neglected, despite its key role in word-level intelligibility and in the expression of ...

Wearable robotic arms (WRA) open up a unique interaction space that closely integrates the user’s body with an embodied robotic collaborator. This space affords diverse interaction styles, including body movement, hand gestures, or gaze. Yet, it is so-...

Robot teleoperation is being explored in a number of application areas, where combining human adaptive intelligence and high precision of robots can provide access to dangerous or inaccessible places, or augment human dexterity. Using virtual reality (VR)...

We are working towards a mixed reality-based human-robot collaboration interface using gaze and gesture as methods of communicating intent in a search and rescue scenario to optimize the operation. The lack of mature algorithms and control schemes for ...

Free-hand mid-air Qwerty enables entering text in virtual reality without the use of controllers. However, it is much slower and more error prone than its physical counterpart, primarily due to the absence of haptic feedback and reduced spatial ...