Search Results (44)

As a result of a rapidly aging population and the increasing prevalence of dementia among older adults, technological solutions are increasingly being considered to facilitate caregiving. This research investigates the perspectives of 20 caregiving dyads on VGo, a telepresence social robot with features designed to support caregiving. Care recipients (CRs), aged 65 and older, diagnosed with Alzheimer’s disease and related dementias, along with their primary caregivers (CGs), evaluated the robot through an online interview study. The interviews integrated informative videos showcasing VGo’s features and functions. Insights from the interviews revealed diverse expectations, interests, and reservations. The majority of CGs and their CRs perceived the robot’s features as beneficial. In particular, the voice command capability was appreciated as an alternative to using smartphones and as a way to manage home appliances. The community feature, however, did not align well with many participants’ lifestyles, and participants had a number of suggestions to enhance the robot’s notification function. Based on the interview results, the study offers a set of design recommendations for telepresence social robots in home caregiving contexts. This investigation highlights the promise of social robots in caregiving contexts and underscores the need for further improvements to ensure they fit users’ needs. Full article

We envision a telepresence system that enhances remote work by facilitating both physical and immersive visual interactions between individuals. However, during robot teleoperation, communication often lacks realism, as users see the robot’s body rather than the remote individual. To address this, we propose a method for overlaying a digital human model onto a humanoid robot using XR visualization, enabling an immersive 3D telepresence experience. Our approach employs a learning-based method to estimate the 2D poses of the humanoid robot from head-worn stereo views, leveraging a newly collected dataset of full-body poses for humanoid robots. The stereo 2D poses and sparse inertial measurements from the remote operator are optimized to compute 3D poses over time. The digital human is localized from the perspective of a continuously moving observer, utilizing the estimated 3D pose of the humanoid robot. Our moving camera-based pose estimation method does not rely on any markers or external knowledge of the robot’s status, effectively overcoming challenges such as marker occlusion, calibration issues, and dependencies on headset tracking errors. We demonstrate the system in a remote physical training scenario, achieving real-time performance at 40 fps, which enables simultaneous immersive and physical interactions. Experimental results show that our learning-based 3D pose estimation method, which operates without prior knowledge of the robot, significantly outperforms alternative approaches requiring the robot’s global pose, particularly during rapid headset movements, achieving markerless digital human augmentation from head-worn views. Full article

Force-feedback devices enhance task performance in most robot teleoperations. However, their increased size with additional degrees of freedom can limit the robot’s applicability. To address this, an interface that visually presents force feedback is proposed, eliminating the need for bulky physical devices. Our telepresence system renders robotic hands transparent in the camera image while displaying virtual hands. The forces applied to the robot deform these virtual hands. The deformation creates an illusion that the operator’s hands are deforming, thus providing pseudo-haptic feedback. We conducted a weight comparison experiment in a virtual reality environment to evaluate force sensitivity. In addition, we conducted an object touch experiment to assess the speed of contact detection in a robot teleoperation setting. The results demonstrate that our method significantly surpasses conventional pseudo-haptic feedback in conveying force differences. Operators detected object touch 24.7% faster using virtual hand deformation compared to conditions without feedback. This matches the response times of physical force-feedback devices. This interface not only increases the operator’s force sensitivity but also matches the performance of conventional force-feedback devices without physically constraining the operator. Therefore, the interface enhances both task performance and the experience of teleoperation. Full article

We explore telerobotics as a novel form of intergroup communication. In this form, remotely operated robots facilitate embodied and situated intergroup contact between groups in conflict over long distances, potentially reducing prejudice and promoting positive social change. Based on previous conceptual frameworks and design hypotheses, we conducted a survey on the acceptance and preferences of the telerobotic medium in Israel and Palestine. We analyzed the responses using a mixed-method approach. The results shed light on differences in attitudes between the groups and design considerations for telerobots when used for intergroup contact. This study serves as a foundation for the implementation of a novel method of technology-enhanced conflict resolution in the field. Full article

Loneliness is increasingly common, especially among older adults. Technology like mobile telepresence robots can help people feel less lonely. However, such technology has challenges, and even if people use it in the short term, they may not accept it in the long term. Prior work shows that it can take up to six months for people to fully accept technology. This study focuses on exploring the nuances and fluidity of acceptance phases. This paper reports a case study of four older adult participants living with a mobile telepresence robot for seven months. In monthly interviews, we explore their progress through the acceptance phases. Results reveal the complexity and fluidity of the acceptance phases. We discuss what this means for technology acceptance. In this paper, we also make coding guidelines for interviews on acceptance phases more concrete. We take early steps in moving toward a more standard interview and coding method to improve our understanding of acceptance phases and how to help potential users progress through them. Full article

Due to damage to the network of nerves that regulate the muscles and feeling in the shoulder, arm, and forearm, brachial plexus injuries (BPIs) are known to significantly reduce the function and quality of life of affected persons. According to the World Health Organization (WHO), a considerable share of global disability-adjusted life years (DALYs) is attributable to upper limb injuries, including BPIs. Telehealth can improve access concerns for patients with BPIs, particularly in lower-middle-income nations. This study used deep reinforcement learning (DRL)-assisted telepresence robots, specifically the deep deterministic policy gradient (DDPG) algorithm, to provide in-home elbow rehabilitation with elbow flexion exercises for BPI patients. The telepresence robots were used for a six-month deployment period, and DDPG drove the DRL architecture to maximize patient-centric exercises with its robotic arm. Compared to conventional rehabilitation techniques, patients demonstrated an average increase of 4.7% in force exertion and a 5.2% improvement in range of motion (ROM) with the assistance of the telepresence robot arm. According to the findings of this study, telepresence robots are a valuable and practical method for BPI patients’ at-home rehabilitation. This technology paves the way for further research and development in telerehabilitation and can be crucial in addressing broader physical rehabilitation challenges. Full article

The COVID-19 outbreak demonstrated the viability of various remote working solutions, telepresence robots (TPRs) being one of them. High-quality video transmission is one of the cornerstones of using such solutions, as most of the information about the environment is acquired through vision. This study aims to compare the camera capabilities of four models of popular telepresence robots using compact reduced LogMAR and Snellen optometry charts as well as text displayed on a projector screen. The symbols from the images are extracted using the Google Vision OCR (Optical Character Recognition) software, and the results of the recognition are compared with the symbols on the charts. Double 3 TPR provides the best quality images of optometric charts, but the OCR results of measurements of the image on the projector do not show the clear advantage of one single model over the others. The results demonstrated by Temi 2 and Double 3 TPRs are generally better than the others, suggesting that these TPRs are more feasible to be used in teaching and learning scenarios. Full article

There is an increasingly urgent need for humans to interactively control robotic systems to perform increasingly precise remote operations, concomitant with the rapid development of space exploration, deep-sea discovery, nuclear rehabilitation and management, and robotic-assisted medical devices. The potential high value of medical telerobotic applications was also evident during the recent coronavirus pandemic and will grow in future. Robotic teleoperation satisfies the demands of the scenarios in which human access carries measurable risk, but human intelligence is required. An effective teleoperation system not only enables intuitive human-robot interaction (HRI) but ensures the robot can also be operated in a way that allows the operator to experience the “feel” of the robot working on the remote side, gaining a “sense of presence”. Extended reality (XR) technology integrates real-world information with computer-generated graphics and has the potential to enhance the effectiveness and performance of HRI by providing depth perception and enabling judgment and decision making while operating the robot in a dynamic environment. This review examines novel approaches to the development and evaluation of an XR-enhanced telerobotic platform for intuitive remote teleoperation applications in dangerous and difficult working conditions. It presents a strong review of XR-enhanced telerobotics for remote robotic applications; a particular focus of the review includes the use of integrated 2D/3D mixed reality with haptic interfaces to perform intuitive remote operations to remove humans from dangerous conditions. This review also covers primary studies proposing Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR) solutions where humans can better control or interact with real robotic platforms using these devices and systems to extend the user’s reality and provide a more intuitive interface. The objective of this article is to present recent, relevant, common, and accessible frameworks implemented in research articles published on XR-enhanced telerobotics for industrial applications. Finally, we present and classify the application context of the reviewed articles in two groups: mixed reality–enhanced robotic telemanipulation and mixed reality–enhanced robotic tele-welding. The review thus addresses all elements in the state of the art for these systems and ends with recommended research areas and targets. The application range of these systems and the resulting recommendations is readily extensible to other application areas, such as remote robotic surgery in telemedicine, where surgeons are scarce and need is high, and other potentially high-risk/high-need scenarios. Full article

Three decades ago, telepresence was presented as an idea in the context of remote work and manipulation. Since then, it has evolved into a field combining different technologies and allowing users to have more or less realistic perceptions of immersion in remote environments. This paper reviews telepresence and its recent advances. While not covering all the work conducted in telepresence, this paper provides an array of applications for which telepresence can be envisioned, providing a clear view of the differences between components and functionalities of robotic platforms conceived for telepresence and pointing to the dependence of telepresence on several technological areas. Furthermore, challenges faced by telepresence technologies are shown, with consideration of user experiences. We consider telepresence from different perspectives, focusing on specific parts, making it possible to foresee future directions of research and applications. This review will be useful for researchers working in telepresence and related fields. Full article

Cyber-physical or virtual systems or devices that are capable of autonomously interacting with human or non-human agents in real environments are referred to as social robots. The primary areas of application for biomedical technology are nursing homes, hospitals, and private homes for the purpose of providing assistance to the elderly, people with disabilities, children, and medical personnel. This review examines the current state-of-the-art of social robots used in healthcare applications, with a particular emphasis on the technical characteristics and requirements of these different types of systems. Humanoids robots, companion robots, and telepresence robots are the three primary categories of devices that are identified and discussed in this article. The research looks at commercial applications, as well as scientific literature (according to the Scopus Elsevier database), patent analysis (using the Espacenet search engine), and more (searched with Google search engine). A variety of devices are enumerated and categorized, and then our discussion and organization of their respective specifications takes place. Full article

Automation in the modern world has become a necessity for humans. Intelligent mobile robots have become necessary to perform various complex tasks in healthcare and industry environments. Mobile robots have gained attention during the pandemic; human–robot interaction has become vibrant. However, there are many challenges in obtaining human–robot interactions regarding maneuverability, controllability, stability, drive layout and autonomy. In this paper, we proposed a stability and control design for a telepresence robot called auto-MERLIN. The proposed design simulated and experimentally verified self-localization and maneuverability in a hazardous environment. A model from Rieckert and Schunck was initially considered to design the control system parameters. The system identification approach was then used to derive the mathematical relationship between the manipulated variable of robot orientation control. The theoretical model of the robot mechanics and associated control were developed. A design model was successfully implemented, analyzed mathematically, used to build the hardware and tested experimentally. Each level takes on excellent tasks for the development of auto-MERLIN. A higher level always uses the services of lower levels to carry out its functions. The proposed approach is comparatively simple, less expensive and easily deployable compared to previous methods. The experimental results showed that the robot is functionally complete in all aspects. A test drive was performed over a given path to evaluate the hardware, and the results were presented. Simulation and experimental results showed that the target path is maintained quite well. Full article

In mixed-reality (MR) telecollaboration, the local environment is remotely presented to a remote user wearing a virtual reality (VR) head-mounted display (HMD) via a video capture device. However, remote users frequently face challenges in naturally and actively manipulating their viewpoints. In this paper, we propose a telepresence system with viewpoint control, which involves a robotic arm equipped with a stereo camera in the local environment. This system enables remote users to actively and flexibly observe the local environment by moving their heads to manipulate the robotic arm. Additionally, to solve the problem of the limited field of view of the stereo camera and limited movement range of the robotic arm, we propose a 3D reconstruction method combined with a stereo video field-of-view enhancement technique to guide remote users to move within the movement range of the robotic arm and provide them with a larger range of local environment perception. Finally, a mixed-reality telecollaboration prototype was built, and two user studies were conducted to evaluate the overall system. User study A evaluated the interaction efficiency, system usability, workload, copresence, and user satisfaction of our system from the remote user’s perspective, and the results showed that our system can effectively improve the interaction efficiency while achieving a better user experience than two traditional view-sharing techniques based on 360 video and based on the local user’s first-person view. User study B evaluated our MR telecollaboration system prototype from both the remote-user side and the local-user side as a whole, providing directions and suggestions for the subsequent design and improvement of our mixed-reality telecollaboration system. Full article

Background: Over the last few decades, telepresence robots (TRs) have drawn significant attention in academic and healthcare systems due to their enormous benefits, including safety improvement, remote access and economics, reduced traffic congestion, and greater mobility. COVID-19 and advancements in the military play a vital role in developing TRs. Since then, research on the advancement of robots has been attracting much attention. Methods: In critical areas, the placement and movement of humans are not safe, and researchers have started looking at the development of robots. Robot development includes many parameters to be analyzed, and trajectory planning and optimization are among them. The main objective of this study is to present a trajectory control and optimization algorithm for a cognitive architecture named auto-MERLIN. Optimization algorithms are developed for trajectory control. Results: The derived work empirically tests the solutions and provides execution details for creating the trajectory design. We develop the trajectory algorithm for the clockwise direction and another one for the clockwise and counterclockwise directions. Conclusions: Experimental results are drawn to support the proposed algorithm. Self-localization, self-driving, and right and left turn trajectories are drawn. All of the experimental results show that the designed TR works properly, with better accuracy and only a slight jitter in the orientation. The jitter is found due to the environmental factor caught by the sensors, which can be filtered easily. The results show that the proposed approach is less complex and provides better trajectory planning accuracy. Full article

In the Internet of Things (IoT) era, telepresence robots (TRs) are increasingly a part of healthcare, academia, and industry due to their enormous benefits. IoT provides a sensor-based environment in which robots receive more precise information about their surroundings. The researchers work day and night to reduce cost, duration, and complexity in all application areas. It provides tremendous benefits, such as sustainability, welfare improvement, cost-effectiveness, user-friendliness, and adaptability. However, it faces many challenges in making critical decisions during motion, which requires a long training period and intelligent motion planning. These include obstacle avoidance during movement, intelligent control in hazardous situations, and ensuring the right measurements. Following up on these issues requires a sophisticated control design and a secure communication link. This paper proposes a control design to normalize the integration process and offer an auto-MERLIN robot with cognitive and sustainable architecture. A control design is proposed through system identification and modeling of the robot. The robot control design was evaluated, and a prototype was prepared for testing in a hazardous environment. The robot was tested by considering various parameters: driving straight ahead, turning right, self-localizing, and receiving commands from a remote location. The maneuverability, controllability, and stability results show that the proposed design is well-developed and cost-efficient, with a fast response time. The experimental results show that the proposed method significantly minimizes the obstacle collisions. The results confirm the employability and sustainability of the proposed design and demonstrate auto-MERLIN’s capabilities as a sustainable robot ready to be deployed in highly interactive scenarios. Full article

Telepresence robots have become popular during the COVID-19 era due to the quarantine measures and the requirement to interact less with other humans. Telepresence robots are helpful in different scenarios, such as healthcare, academia, or the exploration of certain unreachable territories. IoT provides a sensor-based environment wherein robots acquire more precise information about their surroundings. Remote telepresence robots are enabled with more efficient data from IoT sensors, which helps them to compute the data effectively. While navigating in a distant IoT-enabled healthcare environment, there is a possibility of delayed control signals from a teleoperator. We propose a human cooperative telecontrol robotics system in an IoT-sensed healthcare environment. The deep reinforcement learning (DRL)-based deep deterministic policy gradient (DDPG) offered improved control of the telepresence robot to provide assistance to the teleoperator during the delayed communication control signals. The proposed approach can stabilize the system in aid of the teleoperator by taking the delayed signal term out of the main controlling framework, along with the sensed IOT infrastructure. In a dynamic IoT-enabled healthcare context, our suggested approach to operating the telepresence robot can effectively manage the 30 s delayed signal. Simulations and physical experiments in a real-time healthcare environment with human teleoperators demonstrate the implementation of the proposed method. Full article