I'm a postdoctoral researcher in human-computer interaction, with a background in computer science. My main research areas are computer mediated communication and collaboration in multimodal environments. A special interest lies in how haptic feedback can affect the communication and collaboration in collaborative virtual environments.
I'm also one of the researchers within the DOME (Deployment of Online Medical records and E-health services) consortium, where I focus on how patients’ access to their medical records online affect the communication between patients and physicians.
I' m also conducting pedagogical development studies related to the use of social media within the scope of higher education courses.
ABSTRACT This paper presents a study aimed at exploring the effects of different modality combina... more ABSTRACT This paper presents a study aimed at exploring the effects of different modality combinations on collaborative task performance and employed joint task-solving strategies in a shared interface. The modality combinations visual/haptic, visual/audio and visual/haptic/audio were compared in an experiment in which users solved a task together, working in pairs in adjacent rooms. The application used contained a flat surface in a 3D interface on which piles of cubes were randomly placed in a grid. The task involved scanning for empty cells and placing continuously falling cubes until all empty cells were filled. The cubes and the flat surface were designed in such a way that they could be felt and heard and thus could be recognized by different kinds of haptic and audio feedback cues. This made it possible to scan the environment and read both absolute and relative positions in the grid. A quantitative analysis of task performance and a qualitative analysis of video recordings and interview data were performed. Results showed that task completion times were significantly faster in the visual/haptic/audio condition compared with the other conditions and that there were also significantly fewer errors, result checks of one’s own actions and double checks of the partner’s actions in the visual/haptic/audio condition than in the other conditions. Qualitative results show that participants work simultaneously to a larger extent in the visual/haptic/audio condition and that less communication occurred in the visual/haptic/audio condition compared with the other conditions. We argue that more modalities improved the awareness of the environment resulting in the participants feeling more confident with their interaction in the environment in the visual/haptic/audio condition. This resulted in improved task performance. The visual/audio feedback was better suited for solving the task than the visual/haptic feedback even though haptic feedback gave a significant added value in the visual/haptic/audio condition.
2011 24th International Symposium on Computer-Based Medical Systems (CBMS), 2011
In this paper a field study of using laser-pointing during multi-disciplinary medical meetings is... more In this paper a field study of using laser-pointing during multi-disciplinary medical meetings is presented. The pointing behaviour adopted by radiologists and surgeons to communicate about and collaboratively analyse patient data such as CT images today is illustrated based on field observations of preoperative meetings. In a field test, laser-pointers were introduced in pre-operative meetings. How the dialogue and gesturing
ABSTRACT In the study presented here, two haptic and visual applications for learning geometrical... more ABSTRACT In the study presented here, two haptic and visual applications for learning geometrical concepts in group work in primary school have been designed and evaluated. The aim was to support collaborative learning among sighted and visually impaired pupils. The first application is a static flattened 3D environment that supports learning to distinguish between angles by means of a 3D haptic device providing touch feedback. The second application is a dynamic 3D environment that supports learning of spatial geometry. The scene is a room with a box containing geometrical objects, which pupils can pick up and move around. The applications were evaluated in four schools with groups of two sighted and one visually impaired pupil. The results showed the support for the visually impaired pupil and for the collaboration to be satisfying. A shared understanding of the workspace could be achieved, as long as the virtual environment did not contain movable objects. Verbal communication was crucial for the work process but haptic guiding to some extent substituted communication about direction. When it comes to joint action between visually impaired and sighted pupils a number of interesting problems were identified when the dynamic and static virtual environments were compared. These problems require further investigation. The study extends prior work in the areas of assistive technology and multimodal communication by evaluating functions for joint haptic manipulation in the unique setting of group work in primary school.
In the study presented here two software prototypes for learning about geometrical concepts in pr... more In the study presented here two software prototypes for learning about geometrical concepts in primary school were evaluated. Both prototypes have a combined haptic and visual user interface, so as to support visually impaired pupils in group work together with sighted classmates. The aim of the prototypes was to facilitate the visually impaired pupils’ inclusion in school. The overall goal of the study was to evaluate the collaboration in a shared haptic environment regarding usability, interaction, learning and inclusion in a group work process with visually impaired and sighted pupils. The prototype and the evaluation are described in more detail in Moll (2006).
An ongoing study is presented here. The purpose is to design and evaluate an experiment comparing... more An ongoing study is presented here. The purpose is to design and evaluate an experiment comparing an audio/haptic/visual and a haptic/visual VR environment supporting collaborative work among sighted and blindfolded people. We want to investigate how haptic and audio functions could improve collaboration in a shared workspace. We used a 3D VR environment that supports learning of spatial geometry. The scene is a room containing objects which you can pick up and move around by means of a touch feedback pointing device called Phantom. An experiment was performed with group work in the VR environment comparing an audio/haptic/visual interface with a haptic/visual interface of the application in a laboratory. We investigate if adding audio cues improves awareness, common ground, social presence, perceived performance and work efficiency. The aim is also to conduct a quantitative and qualitative analysis of the video-recorded collaboration in order to obtain information about whether and how the added audio information changes the work process in the groups.
Within the scope of the EU-funded project MICOLE (Multimodal Collaboration Environment for Inclus... more Within the scope of the EU-funded project MICOLE (Multimodal Collaboration Environment for Inclusion of Visually Impaired Children) an application for collaboration among visually impaired and sighted pupils in elementary school was developed. The application supported learning of geometry and relied heavily on haptic input and output. This paper will begin by describing the resulting application and how it was developed. Thereafter a discussion of future work, regarding haptic rendering of different types of X-ray images will follow. A more thorough discussion of the application and an evaluation performed with it can be found in [1].
In this paper we present an explorative study of using the microblog Twitter to support communica... more In this paper we present an explorative study of using the microblog Twitter to support communication. The study included 167 students at KTH Royal Institute of Technology taking the course Communication in engineering science during the semester 2014/2015. The students were instructed to post at least 20 tweets with a course-specific hashtag. The study was designed to evaluate the students' attitudes before and after participating in a microblog activity and to evaluate the communication. Although several studies look at microblog use in higher education (e.g., see Fox & Varadarajan, 2011; Prestridge, 2014), little is reported on detailed examinations of the communication between students and/or teachers. The method included data collection from the microblog as well as pre-and post-questionnaires. The pre-questionnaire asked for background data and students' attitudes, while the post-questionnaire repeated the questions about students attitudes about social media. The results from the questionnaires showed that the majority of the students did not changed their attitude to the use of social media. The data collection from the microblog is partly done (first 1000 tweets have been analyzed) and so far questions, user mentions, links and the frequency of used words have been considered. All of these highlight important aspects of the communication and main use of the microblog. The distribution of the tweets among teachers and students shows that the three teachers account for 15% of the published tweets, while the students account for 85%. Of the tweets sent by the students, 27% were questions and 18% were answers to others' questions. The word frequency analysis shows that most of the communication was centered around course specific aspects e.g., words about assignments. 14% of the tweets contained links to external material such as websites with related information or images from the classroom environment.
ABSTRACT In the study presented here, two haptic and visual applications for learning geometrical... more ABSTRACT In the study presented here, two haptic and visual applications for learning geometrical concepts in group work in primary school have been designed and evaluated. The aim was to support collaborative learning among sighted and visually impaired pupils. The first application is a static flattened 3D environment that supports learning to distinguish between angles by means of a 3D haptic device providing touch feedback. The second application is a dynamic 3D environment that supports learning of spatial geometry. The scene is a room with a box containing geometrical objects, which pupils can pick up and move around. The applications were evaluated in four schools with groups of two sighted and one visually impaired pupil. The results showed the support for the visually impaired pupil and for the collaboration to be satisfying. A shared understanding of the workspace could be achieved, as long as the virtual environment did not contain movable objects. Verbal communication was crucial for the work process but haptic guiding to some extent substituted communication about direction. When it comes to joint action between visually impaired and sighted pupils a number of interesting problems were identified when the dynamic and static virtual environments were compared. These problems require further investigation. The study extends prior work in the areas of assistive technology and multimodal communication by evaluating functions for joint haptic manipulation in the unique setting of group work in primary school.
Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07), 2007
In the study presented in this paper two haptic and visual prototypes for learning about geometri... more In the study presented in this paper two haptic and visual prototypes for learning about geometrical concepts in group work in primary school have been designed and evaluated. The aim was for the prototypes to support collaborative learning between sighted and visually impaired pupils. The first prototype was a 3D environment, that supported learning of spatial geometry. The second prototype
2011 24th International Symposium on Computer-Based Medical Systems (CBMS), 2011
In this paper a field study of using laser-pointing during multi-disciplinary medical meetings is... more In this paper a field study of using laser-pointing during multi-disciplinary medical meetings is presented. The pointing behaviour adopted by radiologists and surgeons to communicate about and collaboratively analyse patient data such as CT images today is illustrated based on field observations of preoperative meetings. In a field test, laser-pointers were introduced in pre-operative meetings. How the dialogue and gesturing
ABSTRACT This paper presents a study aimed at exploring the effects of different modality combina... more ABSTRACT This paper presents a study aimed at exploring the effects of different modality combinations on collaborative task performance and employed joint task-solving strategies in a shared interface. The modality combinations visual/haptic, visual/audio and visual/haptic/audio were compared in an experiment in which users solved a task together, working in pairs in adjacent rooms. The application used contained a flat surface in a 3D interface on which piles of cubes were randomly placed in a grid. The task involved scanning for empty cells and placing continuously falling cubes until all empty cells were filled. The cubes and the flat surface were designed in such a way that they could be felt and heard and thus could be recognized by different kinds of haptic and audio feedback cues. This made it possible to scan the environment and read both absolute and relative positions in the grid. A quantitative analysis of task performance and a qualitative analysis of video recordings and interview data were performed. Results showed that task completion times were significantly faster in the visual/haptic/audio condition compared with the other conditions and that there were also significantly fewer errors, result checks of one’s own actions and double checks of the partner’s actions in the visual/haptic/audio condition than in the other conditions. Qualitative results show that participants work simultaneously to a larger extent in the visual/haptic/audio condition and that less communication occurred in the visual/haptic/audio condition compared with the other conditions. We argue that more modalities improved the awareness of the environment resulting in the participants feeling more confident with their interaction in the environment in the visual/haptic/audio condition. This resulted in improved task performance. The visual/audio feedback was better suited for solving the task than the visual/haptic feedback even though haptic feedback gave a significant added value in the visual/haptic/audio condition.
In this paper a study is presented which aimed at exploring the effects of audio feedback in a ha... more In this paper a study is presented which aimed at exploring the effects of audio feedback in a haptic and visual interface supporting collaboration among sighted and people who cannot see. A between group design was used and the participants worked in pairs with one sighted and one blindfolded in each. The application used was a haptic 3D environment in
More and more county councils in Sweden are now in the process of making electronic health record... more More and more county councils in Sweden are now in the process of making electronic health records available for patient access. Studies have already been performed both in Sweden and abroad highlighting e.g. the potential in patient empowerment and the problems encountered with norms and regulations. It does not, however, seem like many of the arguments put forward are based on real-life scenarios. Through this position paper I am trying to make a case for easily accessible electronic health records. A real-life scenario, concerning myself, is described illustrating a situation in which the lack of access to electronic health records could have caused big problems both for my own health and for my safety. The described scenario is used as an argument for showing why it could be highly beneficial for patients to be in access of their own records online, especially with regards to results from regular checkups .
ABSTRACT This paper presents a study aimed at exploring the effects of different modality combina... more ABSTRACT This paper presents a study aimed at exploring the effects of different modality combinations on collaborative task performance and employed joint task-solving strategies in a shared interface. The modality combinations visual/haptic, visual/audio and visual/haptic/audio were compared in an experiment in which users solved a task together, working in pairs in adjacent rooms. The application used contained a flat surface in a 3D interface on which piles of cubes were randomly placed in a grid. The task involved scanning for empty cells and placing continuously falling cubes until all empty cells were filled. The cubes and the flat surface were designed in such a way that they could be felt and heard and thus could be recognized by different kinds of haptic and audio feedback cues. This made it possible to scan the environment and read both absolute and relative positions in the grid. A quantitative analysis of task performance and a qualitative analysis of video recordings and interview data were performed. Results showed that task completion times were significantly faster in the visual/haptic/audio condition compared with the other conditions and that there were also significantly fewer errors, result checks of one’s own actions and double checks of the partner’s actions in the visual/haptic/audio condition than in the other conditions. Qualitative results show that participants work simultaneously to a larger extent in the visual/haptic/audio condition and that less communication occurred in the visual/haptic/audio condition compared with the other conditions. We argue that more modalities improved the awareness of the environment resulting in the participants feeling more confident with their interaction in the environment in the visual/haptic/audio condition. This resulted in improved task performance. The visual/audio feedback was better suited for solving the task than the visual/haptic feedback even though haptic feedback gave a significant added value in the visual/haptic/audio condition.
2011 24th International Symposium on Computer-Based Medical Systems (CBMS), 2011
In this paper a field study of using laser-pointing during multi-disciplinary medical meetings is... more In this paper a field study of using laser-pointing during multi-disciplinary medical meetings is presented. The pointing behaviour adopted by radiologists and surgeons to communicate about and collaboratively analyse patient data such as CT images today is illustrated based on field observations of preoperative meetings. In a field test, laser-pointers were introduced in pre-operative meetings. How the dialogue and gesturing
ABSTRACT In the study presented here, two haptic and visual applications for learning geometrical... more ABSTRACT In the study presented here, two haptic and visual applications for learning geometrical concepts in group work in primary school have been designed and evaluated. The aim was to support collaborative learning among sighted and visually impaired pupils. The first application is a static flattened 3D environment that supports learning to distinguish between angles by means of a 3D haptic device providing touch feedback. The second application is a dynamic 3D environment that supports learning of spatial geometry. The scene is a room with a box containing geometrical objects, which pupils can pick up and move around. The applications were evaluated in four schools with groups of two sighted and one visually impaired pupil. The results showed the support for the visually impaired pupil and for the collaboration to be satisfying. A shared understanding of the workspace could be achieved, as long as the virtual environment did not contain movable objects. Verbal communication was crucial for the work process but haptic guiding to some extent substituted communication about direction. When it comes to joint action between visually impaired and sighted pupils a number of interesting problems were identified when the dynamic and static virtual environments were compared. These problems require further investigation. The study extends prior work in the areas of assistive technology and multimodal communication by evaluating functions for joint haptic manipulation in the unique setting of group work in primary school.
In the study presented here two software prototypes for learning about geometrical concepts in pr... more In the study presented here two software prototypes for learning about geometrical concepts in primary school were evaluated. Both prototypes have a combined haptic and visual user interface, so as to support visually impaired pupils in group work together with sighted classmates. The aim of the prototypes was to facilitate the visually impaired pupils’ inclusion in school. The overall goal of the study was to evaluate the collaboration in a shared haptic environment regarding usability, interaction, learning and inclusion in a group work process with visually impaired and sighted pupils. The prototype and the evaluation are described in more detail in Moll (2006).
An ongoing study is presented here. The purpose is to design and evaluate an experiment comparing... more An ongoing study is presented here. The purpose is to design and evaluate an experiment comparing an audio/haptic/visual and a haptic/visual VR environment supporting collaborative work among sighted and blindfolded people. We want to investigate how haptic and audio functions could improve collaboration in a shared workspace. We used a 3D VR environment that supports learning of spatial geometry. The scene is a room containing objects which you can pick up and move around by means of a touch feedback pointing device called Phantom. An experiment was performed with group work in the VR environment comparing an audio/haptic/visual interface with a haptic/visual interface of the application in a laboratory. We investigate if adding audio cues improves awareness, common ground, social presence, perceived performance and work efficiency. The aim is also to conduct a quantitative and qualitative analysis of the video-recorded collaboration in order to obtain information about whether and how the added audio information changes the work process in the groups.
Within the scope of the EU-funded project MICOLE (Multimodal Collaboration Environment for Inclus... more Within the scope of the EU-funded project MICOLE (Multimodal Collaboration Environment for Inclusion of Visually Impaired Children) an application for collaboration among visually impaired and sighted pupils in elementary school was developed. The application supported learning of geometry and relied heavily on haptic input and output. This paper will begin by describing the resulting application and how it was developed. Thereafter a discussion of future work, regarding haptic rendering of different types of X-ray images will follow. A more thorough discussion of the application and an evaluation performed with it can be found in [1].
In this paper we present an explorative study of using the microblog Twitter to support communica... more In this paper we present an explorative study of using the microblog Twitter to support communication. The study included 167 students at KTH Royal Institute of Technology taking the course Communication in engineering science during the semester 2014/2015. The students were instructed to post at least 20 tweets with a course-specific hashtag. The study was designed to evaluate the students' attitudes before and after participating in a microblog activity and to evaluate the communication. Although several studies look at microblog use in higher education (e.g., see Fox & Varadarajan, 2011; Prestridge, 2014), little is reported on detailed examinations of the communication between students and/or teachers. The method included data collection from the microblog as well as pre-and post-questionnaires. The pre-questionnaire asked for background data and students' attitudes, while the post-questionnaire repeated the questions about students attitudes about social media. The results from the questionnaires showed that the majority of the students did not changed their attitude to the use of social media. The data collection from the microblog is partly done (first 1000 tweets have been analyzed) and so far questions, user mentions, links and the frequency of used words have been considered. All of these highlight important aspects of the communication and main use of the microblog. The distribution of the tweets among teachers and students shows that the three teachers account for 15% of the published tweets, while the students account for 85%. Of the tweets sent by the students, 27% were questions and 18% were answers to others' questions. The word frequency analysis shows that most of the communication was centered around course specific aspects e.g., words about assignments. 14% of the tweets contained links to external material such as websites with related information or images from the classroom environment.
ABSTRACT In the study presented here, two haptic and visual applications for learning geometrical... more ABSTRACT In the study presented here, two haptic and visual applications for learning geometrical concepts in group work in primary school have been designed and evaluated. The aim was to support collaborative learning among sighted and visually impaired pupils. The first application is a static flattened 3D environment that supports learning to distinguish between angles by means of a 3D haptic device providing touch feedback. The second application is a dynamic 3D environment that supports learning of spatial geometry. The scene is a room with a box containing geometrical objects, which pupils can pick up and move around. The applications were evaluated in four schools with groups of two sighted and one visually impaired pupil. The results showed the support for the visually impaired pupil and for the collaboration to be satisfying. A shared understanding of the workspace could be achieved, as long as the virtual environment did not contain movable objects. Verbal communication was crucial for the work process but haptic guiding to some extent substituted communication about direction. When it comes to joint action between visually impaired and sighted pupils a number of interesting problems were identified when the dynamic and static virtual environments were compared. These problems require further investigation. The study extends prior work in the areas of assistive technology and multimodal communication by evaluating functions for joint haptic manipulation in the unique setting of group work in primary school.
Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07), 2007
In the study presented in this paper two haptic and visual prototypes for learning about geometri... more In the study presented in this paper two haptic and visual prototypes for learning about geometrical concepts in group work in primary school have been designed and evaluated. The aim was for the prototypes to support collaborative learning between sighted and visually impaired pupils. The first prototype was a 3D environment, that supported learning of spatial geometry. The second prototype
2011 24th International Symposium on Computer-Based Medical Systems (CBMS), 2011
In this paper a field study of using laser-pointing during multi-disciplinary medical meetings is... more In this paper a field study of using laser-pointing during multi-disciplinary medical meetings is presented. The pointing behaviour adopted by radiologists and surgeons to communicate about and collaboratively analyse patient data such as CT images today is illustrated based on field observations of preoperative meetings. In a field test, laser-pointers were introduced in pre-operative meetings. How the dialogue and gesturing
ABSTRACT This paper presents a study aimed at exploring the effects of different modality combina... more ABSTRACT This paper presents a study aimed at exploring the effects of different modality combinations on collaborative task performance and employed joint task-solving strategies in a shared interface. The modality combinations visual/haptic, visual/audio and visual/haptic/audio were compared in an experiment in which users solved a task together, working in pairs in adjacent rooms. The application used contained a flat surface in a 3D interface on which piles of cubes were randomly placed in a grid. The task involved scanning for empty cells and placing continuously falling cubes until all empty cells were filled. The cubes and the flat surface were designed in such a way that they could be felt and heard and thus could be recognized by different kinds of haptic and audio feedback cues. This made it possible to scan the environment and read both absolute and relative positions in the grid. A quantitative analysis of task performance and a qualitative analysis of video recordings and interview data were performed. Results showed that task completion times were significantly faster in the visual/haptic/audio condition compared with the other conditions and that there were also significantly fewer errors, result checks of one’s own actions and double checks of the partner’s actions in the visual/haptic/audio condition than in the other conditions. Qualitative results show that participants work simultaneously to a larger extent in the visual/haptic/audio condition and that less communication occurred in the visual/haptic/audio condition compared with the other conditions. We argue that more modalities improved the awareness of the environment resulting in the participants feeling more confident with their interaction in the environment in the visual/haptic/audio condition. This resulted in improved task performance. The visual/audio feedback was better suited for solving the task than the visual/haptic feedback even though haptic feedback gave a significant added value in the visual/haptic/audio condition.
In this paper a study is presented which aimed at exploring the effects of audio feedback in a ha... more In this paper a study is presented which aimed at exploring the effects of audio feedback in a haptic and visual interface supporting collaboration among sighted and people who cannot see. A between group design was used and the participants worked in pairs with one sighted and one blindfolded in each. The application used was a haptic 3D environment in
More and more county councils in Sweden are now in the process of making electronic health record... more More and more county councils in Sweden are now in the process of making electronic health records available for patient access. Studies have already been performed both in Sweden and abroad highlighting e.g. the potential in patient empowerment and the problems encountered with norms and regulations. It does not, however, seem like many of the arguments put forward are based on real-life scenarios. Through this position paper I am trying to make a case for easily accessible electronic health records. A real-life scenario, concerning myself, is described illustrating a situation in which the lack of access to electronic health records could have caused big problems both for my own health and for my safety. The described scenario is used as an argument for showing why it could be highly beneficial for patients to be in access of their own records online, especially with regards to results from regular checkups .
Uploads
Papers by Jonas Moll
Conference Presentations by Jonas Moll