short-paper

A lower limb mixed reality system for the elderly

Authors:

Luis Guilherme Silva Rodrigues,

Alexandre Fonseca Brandao,

Diego Roberto Colombo Dias,

Marcelo de Paiva Guimaraes,

Thais Sporkens Magna,

Paula Teixeira Fernandes,

Jose Remo Ferreira BregaAuthors Info & Claims

SVR '22: Proceedings of the 24th Symposium on Virtual and Augmented Reality

Pages 162 - 166

https://doi.org/10.1145/3604479.3604531

Published: 08 April 2024 Publication History

Get Access

Abstract

This work presents a mixed reality system for lower limb exercise that detects the user’s gait and synchronizes the Street View navigation in the display. It uses an accessible RGB camera with a computer vision approach to detect the body. 11 Elderly volunteers tested the system for 5 minutes each session while therapists analyzed their physical and cognitive activity. In the meantime, the system stores the motion capture data for later use. We analyzed their behaviors in 20 recorded sessions.

References

[1]

Valentin Bazarevsky, Ivan Grishchenko, Karthik Raveendran, Tyler Zhu, Fan Zhang, and Matthias Grundmann. 2020. BlazePose: On-device Real-time Body Pose tracking. https://doi.org/10.48550/ARXIV.2006.10204

Crossref

Google Scholar

[2]

Alexandre Brandao, Diego Roberto Dias, Iago Alvarenga, Glesio Paiva, Luis Trevelin, Karina Gramany-Say, and Gabriela Castellano. 2019. E-Street for Prevention of Falls of the Elderly an Urban Virtual Environment for Human–Computer Interaction from Lower Limb Movements: Emerging Trends and Challenges in Technology. Springer, Campinas, SP, Brazil, 249–256. https://doi.org/10.1007/978-3-319-93112-8_25

Crossref

Google Scholar

[3]

Gustavo Brasil, Alexandre Brandao, Diego Roberto, Nivaldo Parizotto, and Luis Trevelin. 2014. Natural User Interface Applied for Spatial Disorientation and Movement Disorder: GestureMaps. In Workshop de Realidade Virtual e Aumentada, Vol. 1. Comissão Especial de Realidade Virtual (CERV) da Sociedade Brasileira de Computação (SBC), Marilia, SP, Brazil, 72–76.

Google Scholar

[4]

Thiago Buarque de Gusmao Lafayette, Alexandre de Queiroz Burle, Arthur de Andrade Almeida, Vinicius Lima Ventura, Vitor Mendes Carvalho, Alana Elza Fontes da Gama, Joao Marcelo Xavier Natario Teixeira, and Veronica Teichrieb. 2021. The Virtual Kinect. In Symposium on Virtual and Augmented Reality (Virtual Event, Brazil) (SVR’21). Association for Computing Machinery, New York, NY, USA, 111–119. https://doi.org/10.1145/3488162.3488215

Digital Library

Google Scholar

[5]

Diego Roberto Dias, Iago Alvarenga, Marcelo Guimaraes, Luis Trevelin, Gabriela Castellano, and Alexandre Brandao. 2018. eStreet: Virtual Reality and Wearable Devices Applied to Rehabilitation. Springer, Melbourne, VIC, Australia, 775–789. https://doi.org/10.1007/978-3-319-95171-3_60

Crossref

Google Scholar

[6]

Hoshang Kolivand, Ibrahim Mardenli, and Shiva Asadianfam. 2021. Review on Augmented Reality Technology. In 2021 14th International Conference on Developments in eSystems Engineering (DeSE). IEEE, Sharjah, United Arab Emirates, 7–12. https://doi.org/10.1109/DeSE54285.2021.9719356

Crossref

Google Scholar

[7]

Camillo Lugaresi, Jiuqiang Tang, Hadon Nash, Chris McClanahan, Esha Uboweja, Michael Hays, Fan Zhang, Chuo-Ling Chang, Ming Guang Yong, Juhyun Lee, Wan-Teh Chang, Wei Hua, Manfred Georg, and Matthias Grundmann. 2019. MediaPipe: A Framework for Building Perception Pipelines. https://doi.org/10.48550/ARXIV.1906.08172

Crossref

Google Scholar

[8]

Thaís Sporkens Magna, Alexandre Fonseca Brandao, and Paula Teixeira Fernandes. 2022. Intervenção por realidade virtual e exercício físico em idosos. In Journal of Health Informatics, Vol. 12, n. 4. Brazilian Health Informatics Society, São Paulo, SP, Brazil, 77–82.

Google Scholar

[9]

Paul Milgram, Haruo Takemura, Akira Utsumi, and Fumio Kishino. 1994. Augmented reality: A class of displays on the reality-virtuality continuum. Telemanipulator and Telepresence Technologies 2351 (01 1994). https://doi.org/10.1117/12.197321

Crossref

Google Scholar

[10]

Emmanuel Tsekleves, Alyson Warland, Cherry Kilbride, Ioannis Paraskevopoulos, and Dionysios Skordoulis. 2014. The Use of the Nintendo Wii in Motor Rehabilitation for Virtual Reality Interventions: A Literature Review. Vol. 68. Springer Berlin, Heidelberg, 321–344. https://doi.org/10.1007/978-3-642-54816-1_17

Crossref

Google Scholar

Cited By

View all

Trotta TRodrigues LBrega JGuimarães MRocha LBrandão ADias D(2024)ReBase: a framework for acquiring and managing body tracking dataProceedings of the 26th Symposium on Virtual and Augmented Reality10.1145/3691573.3691578(152-160)Online publication date: 30-Sep-2024
https://dl.acm.org/doi/10.1145/3691573.3691578

Index Terms

A lower limb mixed reality system for the elderly
1. Applied computing
  1. Life and medical sciences
    1. Health care information systems
2. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Mixed / augmented reality

Recommendations

Mixed reality in virtual world teleconferencing
VR '10: Proceedings of the 2010 IEEE Virtual Reality Conference

In this paper we present a Mixed Reality (MR) teleconferencing application based on Second Life (SL) and the OpenSim virtual world. Augmented Reality (AR) techniques are used for displaying virtual avatars of remote meeting participants in real physical ...
Merging environments for shared spaces in mixed reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

In virtual reality a real walking interface limits the extent of a virtual environment to our local walkable space. As local spaces are specific to each user, sharing a virtual environment with others for collaborative work or games becomes complicated. ...
Multimodal augmented reality: the norm rather than the exception
MVAR '16: Proceedings of the 2016 workshop on Multimodal Virtual and Augmented Reality

Augmented reality (AR) is commonly seen as a technology that overlays virtual imagery onto a participant's view of the world. In line with this, most AR research is focused on what we see. In this paper, we challenge this focus on vision and make a case ...

Comments

Information & Contributors

Information

Published In

SVR '22: Proceedings of the 24th Symposium on Virtual and Augmented Reality

October 2022

175 pages

ISBN:9798400700026

DOI:10.1145/3604479

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 April 2024

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Funding Sources

Coordenação de Aperfeiçoamento de Pessoal de Nível Superiora

Conference

SVR 2022

SVR 2022: 24th Symposium on Virtual and Augmented Reality

October 24 - 27, 2022

Natal, RN, Brazil

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
18
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)2

Reflects downloads up to 20 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Trotta TRodrigues LBrega JGuimarães MRocha LBrandão ADias D(2024)ReBase: a framework for acquiring and managing body tracking dataProceedings of the 26th Symposium on Virtual and Augmented Reality10.1145/3691573.3691578(152-160)Online publication date: 30-Sep-2024
https://dl.acm.org/doi/10.1145/3691573.3691578

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

References

Cited By

Index Terms

Recommendations

Mixed reality in virtual world teleconferencing

Merging environments for shared spaces in mixed reality

Multimodal augmented reality: the norm rather than the exception

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

HTML Format

Share

Share this Publication link

Share on social media

Affiliations