Human-Computer Interaction draws on the fields of computer science, psychology, cognitive science... more Human-Computer Interaction draws on the fields of computer science, psychology, cognitive science, and organisational and social sciences in order to understand how people use and experience interactive technology. Until now, researchers have been forced to return to the individual subjects to learn about research methods and how to adapt them to the particular challenges of HCI. This is the first book to provide a single resource through which a range of commonly used research methods in HCI are introduced. Chapters are authored by internationally leading HCI researchers who use examples from their own work to illustrate how the methods apply in an HCI context. Each chapter also contains key references to help researchers find out more about each method as it has been used in HCI. Topics covered include experimental design, use of eyetracking, qualitative research methods, cognitive modelling, how to develop new methodologies and writing up your research.
The aim of this paper is to report the patterns that emerged as a result of conducting two studie... more The aim of this paper is to report the patterns that emerged as a result of conducting two studies: first, a Systematic Literature Review (SLR) that investigated Agile and User Centred Design Integration (AUCDI) challenges, strategies and success factors and included a total of 71 AUCDI experience reports, lessons learned, and success and failure AUCDI case studies. Second, an interview study that investigated challenges and practices faced by industrial AUCDI attempts. The patterns that emerged are related to various aspects of the integration process, for example, design, prioritizing User Centred Design (UCD) activities, usability testing, UCD practitioners, documentation and communication between the customer and the development team.
Agile development processes and User Centred Design (UCD) integration have been gaining increased... more Agile development processes and User Centred Design (UCD) integration have been gaining increased interest, in part due to the complementarity of the techniques, the benefits each can apply to the other, and the challenges associated with their combination. This paper describes a Systematic Literature Review (SLR) that was conducted on Agile and UCD integration. The aim of this SLR was to identify various challenging factors that restrict Agile and User Centred Design Integration (AUCDI) and explore the proposed practices to deal with them. The study included a total of 71 papers and excluded 80 papers published from the year 2000 till 2012. AUCDI challenges and their respective proposed practices and success factors were synthesized. A description and taxonomy of AUCDI challenges and its respective success factors and practices were reported. Practitioners can utilise the results in identifying potential AUCDI challenges and practices or success factors to deal with them.
This workshop re-opens the discussion of the challenges faced by academia when preparing students... more This workshop re-opens the discussion of the challenges faced by academia when preparing students to take jobs in industry. The workshop's goal is to develop a framework by which academia and industry can better communicate and resolve their differing needs and goals. The workshop will provide practical guidance for academia and industry to take forward and continue the dialogue.
HCI methods and tools are often used cross-culturally before being tested for appropriateness and... more HCI methods and tools are often used cross-culturally before being tested for appropriateness and validity. As new tools emerge, they must be cross-culturally validated to ensure that they work with all audiences, not just those in the country in which they were developed. This paper presents the validation of a technology acceptance model over nine culturally-diverse countries. The model validated is the Unified Theory of Acceptance and Use of Technology (UTAUT). The paper also explores ongoing analysis of the culture ...
International Workshop on Internationalisation of Products & Systems (IWIPS), 2005
Two studies were designed to identify cross-cultural patterns of mobile phones usage and preferen... more Two studies were designed to identify cross-cultural patterns of mobile phones usage and preferences for User Interfaces among Korean and British users.. The first study was a quantitative study (Questionnaires analysed by factor analysis), whose results demonstrated the two groups have different frustrations with and are satisfied by different aspects of mobile phone. The second study was a qualitative study (User Evaluation), which showed different values and focuses on different aspects of the User Interface.
In the past, remote user testing has offered promising results when compared to its local counter... more In the past, remote user testing has offered promising results when compared to its local counterpart. Nonetheless, the comparison studies conducted insofar have relied on small independent samples, measuring key metrics and have not focused on the qualitative objectives of user testing. The current study addresses these issues in order to reinforce the efficiency of the remote method in the key metrics but to also examine its ability to reveal qualitative data. Mainly, our data suggests that remote user testing requires more time to ...
Two studies were designed to identify cross-cultural patterns of mobile phones usage and preferen... more Two studies were designed to identify cross-cultural patterns of mobile phones usage and preferences for User Interfaces among Korean and British users.. The first study was a quantitative study (Questionnaires analysed by factor analysis), whose results demonstrated the two groups have different frustrations with and are satisfied by different aspects of mobile phone. The second study was a qualitative study (User Evaluation), which showed different values and focuses on different aspects of the User Interface.
This paper investigates how hand-held technology might be used to augment existing electronic pro... more This paper investigates how hand-held technology might be used to augment existing electronic programme guides (EPGs), to better support television planning. Using the results of a television planning diary study, we developed and evaluated design concepts to allow users to learn about potentially interesting programmes via their mobile as well as using recommendations from family and friends. We present results
Journal of the Royal Society, Interface / the Royal Society, Jan 6, 2015
Number entry is a ubiquitous activity and is often performed in safety- and mission-critical proc... more Number entry is a ubiquitous activity and is often performed in safety- and mission-critical procedures, such as healthcare, science, finance, aviation and in many other areas. We show that Monte Carlo methods can quickly and easily compare the reliability of different number entry systems. A surprising finding is that many common, widely used systems are defective, and induce unnecessary human error. We show that Monte Carlo methods enable designers to explore the implications of normal and unexpected operator behaviour, and to design systems to be more resilient to use error. We demonstrate novel designs with improved resilience, implying that the common problems identified and the errors they induce are avoidable.
Given the proliferation of devices like infusion pumps in hospitals, number entry and in particul... more Given the proliferation of devices like infusion pumps in hospitals, number entry and in particular number entry error is an emerging important concern in HCI. There are clearly design features that could greatly improve accuracy in entering numbers but the context of the task could also play an important role. In particular, the emotional state of a person is known to strongly influence their response to a difficult situation and hence the errors that they make. In this paper, we consider the impact of the emotional state of the user on the accuracy with which people enter numbers. Our experiment shows that participants who are in a more positive emotional state are more accurate. The effect is small but could be very important when considering the potentially highly-charged emotional contexts where many healthcare devices are used.
ABSTRACT Questionnaires are commonly used to measure attitudes toward systems and perceptions of ... more ABSTRACT Questionnaires are commonly used to measure attitudes toward systems and perceptions of search experiences. Whilst the face validity of such measures has been established through repeated use in information retrieval research, their reliability and wider validity are not typically examined; this threatens internal validity. The evaluation of self-report questionnaires is important not only for the internal validity of studies and, by extension, increased confidence in the results, but also for examining constructs of interest over time and across different domains and systems. In this paper, we look at a specific questionnaire, the User Engagement Scale (UES), for its robustness as a measure. We describe three empirical studies conducted in the online news domain and investigate the reliability and validity of the UES. Our results demonstrate good reliability of the UES sub-scales; however, we argue that a four-factor structure may be more appropriate than the original six-factor structure proposed in earlier work. In addition, we found evidence to suggest that the UES can differentiate between systems (in this case, online news sources) and experimental conditions (i.e., the type of media used to present online content).
Human-Computer Interaction draws on the fields of computer science, psychology, cognitive science... more Human-Computer Interaction draws on the fields of computer science, psychology, cognitive science, and organisational and social sciences in order to understand how people use and experience interactive technology. Until now, researchers have been forced to return to the individual subjects to learn about research methods and how to adapt them to the particular challenges of HCI. This is the first book to provide a single resource through which a range of commonly used research methods in HCI are introduced. Chapters are authored by internationally leading HCI researchers who use examples from their own work to illustrate how the methods apply in an HCI context. Each chapter also contains key references to help researchers find out more about each method as it has been used in HCI. Topics covered include experimental design, use of eyetracking, qualitative research methods, cognitive modelling, how to develop new methodologies and writing up your research.
The aim of this paper is to report the patterns that emerged as a result of conducting two studie... more The aim of this paper is to report the patterns that emerged as a result of conducting two studies: first, a Systematic Literature Review (SLR) that investigated Agile and User Centred Design Integration (AUCDI) challenges, strategies and success factors and included a total of 71 AUCDI experience reports, lessons learned, and success and failure AUCDI case studies. Second, an interview study that investigated challenges and practices faced by industrial AUCDI attempts. The patterns that emerged are related to various aspects of the integration process, for example, design, prioritizing User Centred Design (UCD) activities, usability testing, UCD practitioners, documentation and communication between the customer and the development team.
Agile development processes and User Centred Design (UCD) integration have been gaining increased... more Agile development processes and User Centred Design (UCD) integration have been gaining increased interest, in part due to the complementarity of the techniques, the benefits each can apply to the other, and the challenges associated with their combination. This paper describes a Systematic Literature Review (SLR) that was conducted on Agile and UCD integration. The aim of this SLR was to identify various challenging factors that restrict Agile and User Centred Design Integration (AUCDI) and explore the proposed practices to deal with them. The study included a total of 71 papers and excluded 80 papers published from the year 2000 till 2012. AUCDI challenges and their respective proposed practices and success factors were synthesized. A description and taxonomy of AUCDI challenges and its respective success factors and practices were reported. Practitioners can utilise the results in identifying potential AUCDI challenges and practices or success factors to deal with them.
This workshop re-opens the discussion of the challenges faced by academia when preparing students... more This workshop re-opens the discussion of the challenges faced by academia when preparing students to take jobs in industry. The workshop's goal is to develop a framework by which academia and industry can better communicate and resolve their differing needs and goals. The workshop will provide practical guidance for academia and industry to take forward and continue the dialogue.
HCI methods and tools are often used cross-culturally before being tested for appropriateness and... more HCI methods and tools are often used cross-culturally before being tested for appropriateness and validity. As new tools emerge, they must be cross-culturally validated to ensure that they work with all audiences, not just those in the country in which they were developed. This paper presents the validation of a technology acceptance model over nine culturally-diverse countries. The model validated is the Unified Theory of Acceptance and Use of Technology (UTAUT). The paper also explores ongoing analysis of the culture ...
International Workshop on Internationalisation of Products & Systems (IWIPS), 2005
Two studies were designed to identify cross-cultural patterns of mobile phones usage and preferen... more Two studies were designed to identify cross-cultural patterns of mobile phones usage and preferences for User Interfaces among Korean and British users.. The first study was a quantitative study (Questionnaires analysed by factor analysis), whose results demonstrated the two groups have different frustrations with and are satisfied by different aspects of mobile phone. The second study was a qualitative study (User Evaluation), which showed different values and focuses on different aspects of the User Interface.
In the past, remote user testing has offered promising results when compared to its local counter... more In the past, remote user testing has offered promising results when compared to its local counterpart. Nonetheless, the comparison studies conducted insofar have relied on small independent samples, measuring key metrics and have not focused on the qualitative objectives of user testing. The current study addresses these issues in order to reinforce the efficiency of the remote method in the key metrics but to also examine its ability to reveal qualitative data. Mainly, our data suggests that remote user testing requires more time to ...
Two studies were designed to identify cross-cultural patterns of mobile phones usage and preferen... more Two studies were designed to identify cross-cultural patterns of mobile phones usage and preferences for User Interfaces among Korean and British users.. The first study was a quantitative study (Questionnaires analysed by factor analysis), whose results demonstrated the two groups have different frustrations with and are satisfied by different aspects of mobile phone. The second study was a qualitative study (User Evaluation), which showed different values and focuses on different aspects of the User Interface.
This paper investigates how hand-held technology might be used to augment existing electronic pro... more This paper investigates how hand-held technology might be used to augment existing electronic programme guides (EPGs), to better support television planning. Using the results of a television planning diary study, we developed and evaluated design concepts to allow users to learn about potentially interesting programmes via their mobile as well as using recommendations from family and friends. We present results
Journal of the Royal Society, Interface / the Royal Society, Jan 6, 2015
Number entry is a ubiquitous activity and is often performed in safety- and mission-critical proc... more Number entry is a ubiquitous activity and is often performed in safety- and mission-critical procedures, such as healthcare, science, finance, aviation and in many other areas. We show that Monte Carlo methods can quickly and easily compare the reliability of different number entry systems. A surprising finding is that many common, widely used systems are defective, and induce unnecessary human error. We show that Monte Carlo methods enable designers to explore the implications of normal and unexpected operator behaviour, and to design systems to be more resilient to use error. We demonstrate novel designs with improved resilience, implying that the common problems identified and the errors they induce are avoidable.
Given the proliferation of devices like infusion pumps in hospitals, number entry and in particul... more Given the proliferation of devices like infusion pumps in hospitals, number entry and in particular number entry error is an emerging important concern in HCI. There are clearly design features that could greatly improve accuracy in entering numbers but the context of the task could also play an important role. In particular, the emotional state of a person is known to strongly influence their response to a difficult situation and hence the errors that they make. In this paper, we consider the impact of the emotional state of the user on the accuracy with which people enter numbers. Our experiment shows that participants who are in a more positive emotional state are more accurate. The effect is small but could be very important when considering the potentially highly-charged emotional contexts where many healthcare devices are used.
ABSTRACT Questionnaires are commonly used to measure attitudes toward systems and perceptions of ... more ABSTRACT Questionnaires are commonly used to measure attitudes toward systems and perceptions of search experiences. Whilst the face validity of such measures has been established through repeated use in information retrieval research, their reliability and wider validity are not typically examined; this threatens internal validity. The evaluation of self-report questionnaires is important not only for the internal validity of studies and, by extension, increased confidence in the results, but also for examining constructs of interest over time and across different domains and systems. In this paper, we look at a specific questionnaire, the User Engagement Scale (UES), for its robustness as a measure. We describe three empirical studies conducted in the online news domain and investigate the reliability and validity of the UES. Our results demonstrate good reliability of the UES sub-scales; however, we argue that a four-factor structure may be more appropriate than the original six-factor structure proposed in earlier work. In addition, we found evidence to suggest that the UES can differentiate between systems (in this case, online news sources) and experimental conditions (i.e., the type of media used to present online content).
In this cross-sectional study, we investigated the influence of personal BMI on body size estimat... more In this cross-sectional study, we investigated the influence of personal BMI on body size estimation in 42 women who have symptoms of anorexia (referred to henceforth as anorexia spectrum disorders, ANSD), and 100 healthy controls. Low BMI control participants over-estimate their size and high BMI controls under-estimate, a pattern which is predicted by a perceptual phenomenon called contraction bias. In addition, control participants' sensitivity to size change declines as their BMI increases as predicted by Weber's law. The responses of women with ANSD are very different. Low BMI participants who have ANSD are extremely accurate at estimating body size and are very sensitive to changes in body size in this BMI range. However, as BMI rises in the ANSD participant group, there is a rapid increase in over-estimation concurrent with a rapid decline in sensitivity to size change. We discuss the results in the context of signal detection theory.
Uploads
Books by Paul Cairns
Papers by Paul Cairns