Export Citations
Save this search
Please login to be able to save your searches and receive alerts for new content matching your search criteria.
- research-articleNovember 2024
Expressive Animation Retiming from Impulse-Based Gestures
MIG '24: Proceedings of the 17th ACM SIGGRAPH Conference on Motion, Interaction, and GamesArticle No.: 16, Pages 1–7https://doi.org/10.1145/3677388.3696323We present a method for retiming existing 3D animations able to handle seamlessly arbitrary impulse-like user gestures, thus enabling expressive video-based control inspired from common review sessions used in animation studios. The approach works in ...
- research-articleOctober 2024
What is Affective Touch Made Of? A Soft Capacitive Sensor Array Reveals the Interplay between Shear, Normal Stress and Individuality
- Devyani McLaren,
- Jian Gao,
- Xiulun Yin,
- Rúbia Reis Guerra,
- Preeti Vyas,
- Chrys Morton,
- Xi Laura Cang,
- Yizhong Chen,
- Yiyuan Sun,
- Ying Li,
- John David Wyndham Madden,
- Karon E MacLean
UIST '24: Proceedings of the 37th Annual ACM Symposium on User Interface Software and TechnologyArticle No.: 52, Pages 1–31https://doi.org/10.1145/3654777.3676346Humans physically express emotion by modulating parameters that register on mammalian skin mechanoreceptors, but are unavailable in current touch-sensing technology. Greater sensory richness combined with data on affect-expression composition is a ...
- abstractOctober 2024
A Nail-tip Device for Gesture and Force Input
SUI '24: Proceedings of the 2024 ACM Symposium on Spatial User InteractionArticle No.: 31, Pages 1–2https://doi.org/10.1145/3677386.3688894Micro-gestures are critical to expanding the personal computing environment. A nail-mounted device enabling micro-gesture and force inputs via the tip of a fingernail is proposed. A prototype with three touch sensors and a strain gauge to support five ...
- research-articleJanuary 2025
Using gesture and speech communication modalities for safe human-drone interaction in construction
Advanced Engineering Informatics (ADEI), Volume 62, Issue PChttps://doi.org/10.1016/j.aei.2024.102827AbstractDrones are increasingly being used in the construction industry for numerous applications. However, their presence poses safety risks to construction workers who work around them but have limited control and information about these drones. To ...
- extended-abstractDecember 2024
-
- research-articleAugust 2024
Computer vision-based hybrid efficient convolution for isolated dynamic sign language recognition
- Prothoma Khan Chowdhury,
- Kabiratun Ummi Oyshe,
- Muhammad Aminur Rahaman,
- Tanoy Debnath,
- Anichur Rahman,
- Neeraj Kumar
Neural Computing and Applications (NCAA), Volume 36, Issue 32Pages 19951–19966https://doi.org/10.1007/s00521-024-10258-3AbstractIsolated dynamic sign language recognition (IDSLR) has the potential to change accessibility and inclusion by enabling speech and/or hearing-impaired people to engage more completely in a variety of spheres of life, including social interactions, ...
- ArticleJune 2024
Developing Prosthetic Hand: Innovation in Hand Movement for Paralyzed Individuals
AbstractThe impaired mobility and limited freedom of individuals paralyzed due to spinal cord injuries or neurological illnesses present significant challenges. An innovative solution is urgently needed to provide adjustable and affordable hand ...
- ArticleNovember 2024
Universal Sign Language Recognition System Using Gesture Description Generation and Large Language Model
Wireless Artificial Intelligent Computing Systems and ApplicationsPages 279–289https://doi.org/10.1007/978-3-031-71470-2_23AbstractSign language is a priceless means of communication for deaf and hard-of-hearing people to fully enable them to participate in society and interact with others. This study introduces a novel universal sign language system that uses the Gesture-...
- research-articleMarch 2024
Humanoid robot-empowered language learning based on self-determination theory
Education and Information Technologies (KLU-EAIT), Volume 29, Issue 14Pages 18927–18957https://doi.org/10.1007/s10639-024-12570-wAbstractWith the ability to provide feedback and assistance, humanoid educational robots have been proven effective in assisting students to overcome learning challenges and enhancing individual learning outcomes. However, the strength of humanoid robots ...
- research-articleMarch 2024
Guiding gaze gestures on smartwatches: Introducing fireworks
International Journal of Human-Computer Studies (IJHC), Volume 183, Issue Chttps://doi.org/10.1016/j.ijhcs.2023.103196AbstractSmartwatches enable interaction anytime and anywhere, with both digital and augmented physical objects. However, situations with busy hands can prevent user inputs. To address this limitation, we propose Fireworks, an innovative hands-free ...
Highlights- For guiding few gestures, a system-paced guidance is not necessary.
- Pursuits are more adapted than saccades for Single Straight Gaze Gestures.
- Delay and visual feedforward to activate Fireworks do not impact performances.
- ...
- ArticleNovember 2023
Multimodal Collaboration in Expository Discourse: Verbal and Nonverbal Moves Alignment
AbstractThe paper explores multimodal collaboration in expository discourse considering verbal and nonverbal moves used by the participants in turn-taking. It reports the results of an experiment which tested speech, gesture and gaze alignment as affected ...
- research-articleNovember 2023
Characterizing touchscreen actions in technology-enhanced embodied learning for mathematics instruction in K-12 setting – A systematic review (2010–2023)
AbstractTouchscreen devices have become prominent in a variety of educational contexts due to their use of hands-on and interactive learning styles, and particularly for their direct engagement, rapid orientation, and multi-touch affordances, ...
Highlights- 34 studies of touchscreen-based mathematics applications are systematically reviewed.
- research-articleOctober 2023
When Gestures and Words Synchronize: Exploring A Human Lecturer's Multimodal Interaction for the Design of Embodied Pedagogical Agents
CSCW '23 Companion: Companion Publication of the 2023 Conference on Computer Supported Cooperative Work and Social ComputingPages 39–44https://doi.org/10.1145/3584931.3607010Embodied Pedagogical Agents (EPAs) possess significant potential for using multimodal interactions to effectively convey social and educational information. While previous studies have examined the impact of EPAs on learning performance, the ...
- articleSeptember 2023
Bi-Model Engagement Emotion Recognition Based on Facial and Upper-Body Landmarks and Machine Learning Approaches
- Haifa F. Alhasson,
- Ghada M. Alsaheel,
- Noura S. Alharbi,
- Alhatoon A. Alsalamah,
- Joud M. Alhujilan,
- Shuaa S. Alharbi
International Journal of E-Services and Mobile Applications (IJESMA), Volume 15, Issue 1Pages 1–13https://doi.org/10.4018/IJESMA.330756Customer satisfaction can be measured using facial expression recognition. The current generation of artificial intelligence systems heavily depends on facial features such as eyebrows, eyes, and foreheads. This dependence introduces a limitation as ...
- ArticleJuly 2023
How Peers Communicate Without Words-An Exploratory Study of Hand Movements in Collaborative Learning Using Computer-Vision-Based Body Recognition Techniques
AbstractAccumulating research in embodied cognition highlights the essential role of human bodies in knowledge learning and development. Hand movement is one of the most applied body motions in the collaborative ideation task when students co-construct ...
- research-articleJune 2023
Investigating primary school children’s embodied expression of programming concepts
International Journal of Child-Computer Interaction (IJCCI), Volume 36, Issue Chttps://doi.org/10.1016/j.ijcci.2023.100574AbstractThe study of children’s gestures has proved useful in understanding learning and conceptual development in subjects such as mathematics but has not yet been carried out in computing education. This paper presents an analysis of the way in which ...
- research-articleMay 2023
The role of prosody and hand gestures in the perception of boundaries in speech✰
Speech Communication (SPCO), Volume 150, Issue CPages 41–65https://doi.org/10.1016/j.specom.2023.05.001Highlights- Use of extracts from spontaneous speech to investigate boundary perception.
- ...
This paper investigates the use of prosodic, gestural, and syntactic information in the perception of boundaries in extracts of spontaneous speech in British English. Experiment 1 aimed at investigating the effect of prosody on naive ...
- Work in ProgressApril 2023
Studying Children’s Object Interaction in Virtual Reality: A Manipulative Gesture Taxonomy for VR Hand Tracking
CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing SystemsArticle No.: 264, Pages 1–7https://doi.org/10.1145/3544549.3585865In this paper, we propose a taxonomy for the classification of children’s gestural input elicited from spatial puzzle play in VR hand tracking. The taxonomy builds on the existing manipulative gesture taxonomy in human-computer interaction, and offers ...
- Work in ProgressApril 2023
Exploring Gesture and Gaze Proxies to Communicate Instructor’s Nonverbal Cues in Lecture Videos
CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing SystemsArticle No.: 113, Pages 1–7https://doi.org/10.1145/3544549.3585842Teaching via lecture video has become the defacto standard for remote education, but videos make it difficult to interpret instructors’ nonverbal referencing to the content. This is problematic, as nonverbal cues are essential for students to follow and ...
- research-articleMarch 2023
Predicting information usefulness in health information identification from modal behaviors
Information Processing and Management: an International Journal (IPRM), Volume 60, Issue 2https://doi.org/10.1016/j.ipm.2022.103220Highlights- Gesture or gaze behaviors can be employed for predicting information usefulness.
Finding useful health information should be the highest priority when identifying health information. Predicting information usefulness will significantly improve the effectiveness and efficiency of health information identification, ...