This is the preprint version of our paper on ICWL2015. A virtual reality based enhanced technolog... more This is the preprint version of our paper on ICWL2015. A virtual reality based enhanced technology for learning primary geography is proposed, which synthesizes several latest information technologies including virtual reality(VR), 3D geographical information system(GIS), 3D visualization and multimodal human-computer-interaction (HCI). The main functions of the proposed system are introduced, i.e. Buffer analysis, Overlay analysis, Space convex hull calculation, Space convex decomposition, 3D topology analysis and 3D space intersection detection. The multimodal technologies are employed in the system to enhance the immersive perception of the users.
Advanced computer technologies such as big data, Artificial Intelligence (AI), cloud computing, d... more Advanced computer technologies such as big data, Artificial Intelligence (AI), cloud computing, digital twins, and edge computing have been applied in various fields as digitalization has progressed. To study the status of the application of digital twins in the combination with AI, this paper classifies the applications and prospects of AI in digital twins by studying the research results of the current published literature. We discuss the application status of digital twins in the four areas of aerospace, intelligent manufacturing in production workshops, unmanned vehicles, and smart city transportation, and we review the current challenges and topics that need to be looked forward to in the future. It was found that the integration of digital twins and AI has significant effects in aerospace flight detection simulation, failure warning, aircraft assembly, and even unmanned flight. In the virtual simulation test of automobile autonomous driving, it can save 80% of the time and co...
This is the preprint version of our paper on ICONIP2015. The proposed platform supports the integ... more This is the preprint version of our paper on ICONIP2015. The proposed platform supports the integrated VRGIS functions including 3D spatial analysis functions, 3D visualization for spatial process and serves for 3D globe and digital city. The 3D analysis and visualization of the concerned city massive information are conducted in the platform. The amount of information that can be visualized with this platform is overwhelming, and the GIS based navigational scheme allows to have great flexibility to access the different available data sources.
This is the preprint version of our paper on EUROGRAPHICS 2015. A big city visual analysis platfo... more This is the preprint version of our paper on EUROGRAPHICS 2015. A big city visual analysis platform based on Web Virtual Reality Geographical Information System (WEBVRGIS) is presented. Extensive model editing functions and spatial analysis functions are available, including terrain analysis, spatial analysis, sunlight analysis, traffic analysis, population analysis and community analysis.
This is the preprint version of our paper on 2015 International Conference on Virtual Rehabilitat... more This is the preprint version of our paper on 2015 International Conference on Virtual Rehabilitation (ICVR2015). In this paper, we described the imagination scenarios of a touch-less interaction technology for hemiplegia, which can support either hand or foot interaction with the smartphone or head mounted device (HMD). The computer vision interaction technology is implemented in our previous work, which provides a core support for gesture interaction by accurately detecting and tracking the hand or foot gesture. The patients interact with the application using hand/foot gesture motion in the camera view.
A big city visual analysis platform based on Web Virtual Reality Geographical Information System ... more A big city visual analysis platform based on Web Virtual Reality Geographical Information System (WEBVRGIS) is presented. Extensive model editing functions and spatial analysis functions are available, including terrain analysis, spatial analysis, sunlight analysis, traffic analysis, population analysis and community analysis.
This is the preprint version of our paper on 2015 International Conference on Virtual Rehabilitat... more This is the preprint version of our paper on 2015 International Conference on Virtual Rehabilitation (ICVR2015). The purpose of this work is designing and implementing a rehabilitation software for dysphonic patients. Constant training is a key factor for this type of therapy. The patient can play the game as well as conduct the voice training simultaneously guided by therapists at clinic or exercise independently at home. The voice information can be recorded and extracted for evaluating the long-time rehabilitation progress.
This paper shows the WEBVRGIS platform overlying multiple types of data about Shenzhen over a 3d ... more This paper shows the WEBVRGIS platform overlying multiple types of data about Shenzhen over a 3d globe. The amount of information that can be visualized with this platform is overwhelming, and the GIS-based navigational scheme allows to have great flexibility to access the different available data sources. For example,visualising historical and forecasted passenger volume at stations could be very helpful when overlaid with other social data.
A balance measurement software based on Kinect2 sensor is evaluated by comparing to Wii balance b... more A balance measurement software based on Kinect2 sensor is evaluated by comparing to Wii balance board in numerical analysis level, and further improved according to the consideration of BFP (Body fat percentage) values of the user. Several person with different body types are involved into the test. The algorithm is improved by comparing the body type of the user to the ‘golden-standard’ body type. The evaluation results of the optimized algorithm preliminarily prove the reliability of the software.
This is the preprint version of our paper on JOMS. In this paper, two mHealth applications are in... more This is the preprint version of our paper on JOMS. In this paper, two mHealth applications are introduced, which can be employed as the terminals of bigdata based health service to collect information for electronic medical records (EMRs). The first one is a hybrid system for improving the user experience in the hyperbaric oxygen chamber by 3D stereoscopic virtual reality glasses and immersive perception. Several HMDs have been tested and compared. The second application is a voice interactive serious game as a likely solution for providing assistive rehabilitation tool for therapists. The recorder of the voice of patients could be analysed to evaluate the long-time rehabilitation results and further to predict the rehabilitation process.
This is the preprint version of our paper on Advances in Engineering Software. With several chara... more This is the preprint version of our paper on Advances in Engineering Software. With several characteristics, such as large scale, diverse predictability and timeliness, the city traffic data falls in the range of definition of Big Data. A Virtual Reality GIS based traffic analysis and visualization system is proposed as a promising and inspiring approach to manage and develop traffic big data. In addition to the basic GIS interaction functions, the proposed system also includes some intelligent visual analysis and forecasting functions. The passenger flow forecasting algorithm is introduced in detail.
This study presents a face-to-face simulation of social interaction based on scene roaming, real-... more This study presents a face-to-face simulation of social interaction based on scene roaming, real-time voice capture, and action capture. This paper aimed to compare the difference between social and traditional plane social communication, analyzing its advantages and shortcomings. In particular, we designed an experiment to study the performance of face-to-face simulation based on virtual reality technology, observing the adaptability of the user to the system and the accuracy of body language recognition. We developed an immersive virtual reality social application (IVRSA), which has a basic social function. As an experimental platform, IVRSA uses Unity3D as its engine, and HTC VIVE as an external input/output device, with voice communication, immersive virtual tour, and head and hand movement simulation functions. We recruited 30 volunteers for the test. The test consisted of two parts. The first part was to provide a news topic for volunteers to freely communicate in IVRSA and We...
Augmented Reality is a key technology that will facilitate a major paradigm shift in the way user... more Augmented Reality is a key technology that will facilitate a major paradigm shift in the way users interact with data and has only just recently been recognized as a viable solution for solving many critical needs [...]
Feature tracking in image collections significantly affects the efficiency and accuracy of Struct... more Feature tracking in image collections significantly affects the efficiency and accuracy of Structure from Motion (SFM). Insufficient correspondences may result in disconnected structures and incomplete components, while the redundant correspondences containing incorrect ones may yield to folded and superimposed structures. In this paper, we present a Superpixel-based feature tracking method for structure from motion. In the proposed method, we first propose to use a joint approach to detect local keypoints and compute descriptors. Second, the superpixel-based approach is used to generate labels for the input image. Third, we combine the Speed Up Robust Feature and binary test in the generated label regions to produce a set of combined descriptors for the detected keypoints. Fourth, the locality-sensitive hash (LSH)-based k nearest neighboring matching (KNN) is utilized to produce feature correspondences, and then the ratio test approach is used to remove outliers from the previous m...
This is the preprint version of our paper on ICWL2015. A virtual reality based enhanced technolog... more This is the preprint version of our paper on ICWL2015. A virtual reality based enhanced technology for learning primary geography is proposed, which synthesizes several latest information technologies including virtual reality(VR), 3D geographical information system(GIS), 3D visualization and multimodal human-computer-interaction (HCI). The main functions of the proposed system are introduced, i.e. Buffer analysis, Overlay analysis, Space convex hull calculation, Space convex decomposition, 3D topology analysis and 3D space intersection detection. The multimodal technologies are employed in the system to enhance the immersive perception of the users.
Advanced computer technologies such as big data, Artificial Intelligence (AI), cloud computing, d... more Advanced computer technologies such as big data, Artificial Intelligence (AI), cloud computing, digital twins, and edge computing have been applied in various fields as digitalization has progressed. To study the status of the application of digital twins in the combination with AI, this paper classifies the applications and prospects of AI in digital twins by studying the research results of the current published literature. We discuss the application status of digital twins in the four areas of aerospace, intelligent manufacturing in production workshops, unmanned vehicles, and smart city transportation, and we review the current challenges and topics that need to be looked forward to in the future. It was found that the integration of digital twins and AI has significant effects in aerospace flight detection simulation, failure warning, aircraft assembly, and even unmanned flight. In the virtual simulation test of automobile autonomous driving, it can save 80% of the time and co...
This is the preprint version of our paper on ICONIP2015. The proposed platform supports the integ... more This is the preprint version of our paper on ICONIP2015. The proposed platform supports the integrated VRGIS functions including 3D spatial analysis functions, 3D visualization for spatial process and serves for 3D globe and digital city. The 3D analysis and visualization of the concerned city massive information are conducted in the platform. The amount of information that can be visualized with this platform is overwhelming, and the GIS based navigational scheme allows to have great flexibility to access the different available data sources.
This is the preprint version of our paper on EUROGRAPHICS 2015. A big city visual analysis platfo... more This is the preprint version of our paper on EUROGRAPHICS 2015. A big city visual analysis platform based on Web Virtual Reality Geographical Information System (WEBVRGIS) is presented. Extensive model editing functions and spatial analysis functions are available, including terrain analysis, spatial analysis, sunlight analysis, traffic analysis, population analysis and community analysis.
This is the preprint version of our paper on 2015 International Conference on Virtual Rehabilitat... more This is the preprint version of our paper on 2015 International Conference on Virtual Rehabilitation (ICVR2015). In this paper, we described the imagination scenarios of a touch-less interaction technology for hemiplegia, which can support either hand or foot interaction with the smartphone or head mounted device (HMD). The computer vision interaction technology is implemented in our previous work, which provides a core support for gesture interaction by accurately detecting and tracking the hand or foot gesture. The patients interact with the application using hand/foot gesture motion in the camera view.
A big city visual analysis platform based on Web Virtual Reality Geographical Information System ... more A big city visual analysis platform based on Web Virtual Reality Geographical Information System (WEBVRGIS) is presented. Extensive model editing functions and spatial analysis functions are available, including terrain analysis, spatial analysis, sunlight analysis, traffic analysis, population analysis and community analysis.
This is the preprint version of our paper on 2015 International Conference on Virtual Rehabilitat... more This is the preprint version of our paper on 2015 International Conference on Virtual Rehabilitation (ICVR2015). The purpose of this work is designing and implementing a rehabilitation software for dysphonic patients. Constant training is a key factor for this type of therapy. The patient can play the game as well as conduct the voice training simultaneously guided by therapists at clinic or exercise independently at home. The voice information can be recorded and extracted for evaluating the long-time rehabilitation progress.
This paper shows the WEBVRGIS platform overlying multiple types of data about Shenzhen over a 3d ... more This paper shows the WEBVRGIS platform overlying multiple types of data about Shenzhen over a 3d globe. The amount of information that can be visualized with this platform is overwhelming, and the GIS-based navigational scheme allows to have great flexibility to access the different available data sources. For example,visualising historical and forecasted passenger volume at stations could be very helpful when overlaid with other social data.
A balance measurement software based on Kinect2 sensor is evaluated by comparing to Wii balance b... more A balance measurement software based on Kinect2 sensor is evaluated by comparing to Wii balance board in numerical analysis level, and further improved according to the consideration of BFP (Body fat percentage) values of the user. Several person with different body types are involved into the test. The algorithm is improved by comparing the body type of the user to the ‘golden-standard’ body type. The evaluation results of the optimized algorithm preliminarily prove the reliability of the software.
This is the preprint version of our paper on JOMS. In this paper, two mHealth applications are in... more This is the preprint version of our paper on JOMS. In this paper, two mHealth applications are introduced, which can be employed as the terminals of bigdata based health service to collect information for electronic medical records (EMRs). The first one is a hybrid system for improving the user experience in the hyperbaric oxygen chamber by 3D stereoscopic virtual reality glasses and immersive perception. Several HMDs have been tested and compared. The second application is a voice interactive serious game as a likely solution for providing assistive rehabilitation tool for therapists. The recorder of the voice of patients could be analysed to evaluate the long-time rehabilitation results and further to predict the rehabilitation process.
This is the preprint version of our paper on Advances in Engineering Software. With several chara... more This is the preprint version of our paper on Advances in Engineering Software. With several characteristics, such as large scale, diverse predictability and timeliness, the city traffic data falls in the range of definition of Big Data. A Virtual Reality GIS based traffic analysis and visualization system is proposed as a promising and inspiring approach to manage and develop traffic big data. In addition to the basic GIS interaction functions, the proposed system also includes some intelligent visual analysis and forecasting functions. The passenger flow forecasting algorithm is introduced in detail.
This study presents a face-to-face simulation of social interaction based on scene roaming, real-... more This study presents a face-to-face simulation of social interaction based on scene roaming, real-time voice capture, and action capture. This paper aimed to compare the difference between social and traditional plane social communication, analyzing its advantages and shortcomings. In particular, we designed an experiment to study the performance of face-to-face simulation based on virtual reality technology, observing the adaptability of the user to the system and the accuracy of body language recognition. We developed an immersive virtual reality social application (IVRSA), which has a basic social function. As an experimental platform, IVRSA uses Unity3D as its engine, and HTC VIVE as an external input/output device, with voice communication, immersive virtual tour, and head and hand movement simulation functions. We recruited 30 volunteers for the test. The test consisted of two parts. The first part was to provide a news topic for volunteers to freely communicate in IVRSA and We...
Augmented Reality is a key technology that will facilitate a major paradigm shift in the way user... more Augmented Reality is a key technology that will facilitate a major paradigm shift in the way users interact with data and has only just recently been recognized as a viable solution for solving many critical needs [...]
Feature tracking in image collections significantly affects the efficiency and accuracy of Struct... more Feature tracking in image collections significantly affects the efficiency and accuracy of Structure from Motion (SFM). Insufficient correspondences may result in disconnected structures and incomplete components, while the redundant correspondences containing incorrect ones may yield to folded and superimposed structures. In this paper, we present a Superpixel-based feature tracking method for structure from motion. In the proposed method, we first propose to use a joint approach to detect local keypoints and compute descriptors. Second, the superpixel-based approach is used to generate labels for the input image. Third, we combine the Speed Up Robust Feature and binary test in the generated label regions to produce a set of combined descriptors for the detected keypoints. Fourth, the locality-sensitive hash (LSH)-based k nearest neighboring matching (KNN) is utilized to produce feature correspondences, and then the ratio test approach is used to remove outliers from the previous m...
Uploads