research-article

Evaluation of a web-based telehealth system: a preliminary investigation with seniors in New Zealand

Authors:

Jaspaljeet Singh Dhillon,

Burkhard C. Wünsche,

Christof LutterothAuthors Info & Claims

CHINZ '12: Proceedings of the 13th International Conference of the NZ Chapter of the ACM's Special Interest Group on Human-Computer Interaction

Pages 17 - 24

https://doi.org/10.1145/2379256.2379260

Published: 02 July 2012 Publication History

Abstract

Home telehealth systems are gaining popularity among seniors, but they are mostly doctor centric, focused on managing diseases instead of preventing them, and do not take into account the social needs of the users. Increasing numbers of seniors going online opens up opportunities to address the shortcomings of current telehealth systems. We have developed a patient-centric, web-based telehealth system which uses Web 2.0 technologies to add social support and user defined content. In this study, we have evaluated the functionalities, usability and user interface of the functional prototype with eight seniors of age range 67 to 90 by using a multi-method approach involving individual walkthrough, system usability scale (SUS), protocol analysis and interviews. Overall, users were satisfied with the usability of the system and functionalities promoting exercises and supporting weight management were in most demand. The evaluation of our prototype demonstrates that combining telehealth functionalities with social component and user-generated content is a promising way to enable users to proactively manage and improve their health.

References

[1]

Årsand, E. and Demiris, G. 2008. User-centered methods for designing patient-centric self-help tools. Inform Health Soc Care. 33(3):158--169.

[2]

Singh, J., Wünsche, B. C. and Lutteroth, C. 2010. Framework for Healthcare4Life: a ubiquitous patient-centric telehealth system. In Proceedings of the 11th International Conference of the NZ Chapter of the ACM Special Interest Group on Human-Computer Interaction (CHINZ '10). ACM.

Digital Library

[3]

Kahana, E., Kahana, B., Lovegreen, L., Cronin, C. and Plaff, H. 2011. The Proactive Aged: New Players in the Web World. In Proceedings of the ACM WebSci'11.

[4]

Zickuhr, K. 2010. Generations Online in 2010. Pew Internet & American Life Project.

[5]

Kushniruk, A. W., Patel, V. L. and Cimino, J. J. 1997. Usability testing in medical informatics: cognitive approaches to evaluation of information systems and user interfaces, in: D. Masys (Ed.), In Proceedings of the 1997 AMIA Fall Symposium, pp. 218--222.

[6]

Dhillon, J. S., Ramos, C., Wünsche, B. C. and Lutteroth, C. 2011. Designing a web-based telehealth system for elderly people: An interview study in New Zealand. In The 24th International Symposium on Computer-Based Medical Systems (CBMS 2011), Bristol, United Kingdom, pp. 1--6.

Digital Library

[7]

Newell, A. 2008. User-Sensitive Design for Older and Disabled People, in The Engineering Handbook of Smart Technology for Aging, Disability, and Independence (eds A. (. Helal, M. Mokhtari and B. Abdulrazak), John Wiley & Sons, Inc., Hoboken, NJ, USA.

[8]

Brooke, J. 1996. SUS: A Quick and Dirty Usability Scale. In: P. W. Jordan, B. Thomas, B. A. Weerdmeester & I. L. McClelland (Eds.), Usability Evaluation in Industry. London: Taylor & Francis.

[9]

Dhillon, J. S., Wünsche, B. C. and Lutteroth, C. 2011. Leveraging web 2.0 and consumer devices for improving elderlies' health. In Proceedings of Australasian Workshop on Health Informatics and Knowledge Management (HIKM 2011), Perth, Australia, 120: pp. 17--24.

[10]

Lee, D., Helal, S., Anton, S., Deugd, S. De and Smith, A. 2011. Participatory and Persuasive Telehealth. Gerontology.

[11]

Nielsen, J. Ten Usability Heuristics. 1994 Available from: http://useit.com (accessed 12 April 2012).

[12]

Wicks P., Massagli M., Frost J., Brownstein C., Okun S., Vaughan T., Bradley R. and Heywood J. 2010. Sharing Health Data for Better Outcomes on PatientsLikeMe. Journal of Medical Internet Research.

[13]

Wicks P., Keininger D. L., Massagli M. P., Loge C. de la, Brownstein C., Isojärvi J. and Heywood J. 2012. Perceived benefits of sharing health data between people with epilepsy on an online platform. Epilepsy & Behavior, 23: pp. 16--23.

[14]

Sunwoo, J., Yuen, W., Lutteroth, C. and Wünsche, B. 2010. Mobile Games for Elderly Healthcare. In Proceedings of the 11th International Conference of the NZ Chapter of the ACM Special Interest Group on Human-Computer Interaction (CHINZ '10). ACM.

Digital Library

[15]

Dhillon, J. S., Ramos, C., Wünsche, B. C. and Lutteroth, C. 2012. Evaluation of Web 2.0 Technologies for Developing Online Telehealth Systems. In Proceedings of Australasian Workshop on Health Informatics and Knowledge Management (HIKM 2012), Melbourne, Australia, 129: pp. 21--30.

[16]

Catwell, L. and Sheikh, A. 2009. Evaluating eHealth Interventions: The Need for Continuous Systemic Evaluation, PLoS Medicine, 6: e1000126.

[17]

Tullis, T. and Albert, B. 2008. Measuring the User Experience - Collecting, Analyzing, and Presenting Usability Metrics. Elsevier, Morgan Kaufmann.

Digital Library

[18]

Kushniruk, A. W., Patel, V. L. and Cimino, J. J. 2000. Evaluation of Web-based patient information resources: application in the assessment of a patient clinical information system. Proceedings of AMIA Symposium, 443--447 p.18.

[19]

Kushniruk, A. W., Patel, V. L. and Cimino, J. J. 1997. Usability testing in medical informatics: cognitive approaches to evaluation of information systems and user interfaces. Proceedings of AMIA Annual Fall Symposium 1997;218--222 p.19.

[20]

Nielsen, J. 1996. Usability metrics: tracking interface improvements. Ieee Software, 13(6):12--13.20.

Digital Library

[21]

Nielsen, J. 1994. Usability inspection methods. In: Nielsen J, Mack RL, editors. New York, NY: John Wiley & Sons;.

Digital Library

[22]

Lines, L. and Hone, K. 2004. Eliciting User Requirements with Older Adults: Lessons from the Design of an Interactive Domestic Alarm System. Universal Access in the Information Society, 3(2) pp. 141--148,

Digital Library

[23]

Kushniruk, A. W., Patel, C., Patel, V. L. and Cimino J. J. 2001. 'Televaluation' of clinical information systems: an integrative approach to assessing Web-based systems. International Journal of Medical Informatics, 61(1):45--70.

[24]

Bangor, A., Kortum, P., Miller, J. and Bailey, B. 2009. Determining what individual sus scores mean: adding an adjective rating scale. Journal of Usability Studies, 4(3):114--123.

Digital Library

[25]

Bozkurt, S., Zayim, N., Gulkesen, K. H., Samur, M. K., Karaağaoglu, N. and Saka, O. Usability of a web-based personal nutrition management tool. Informatics for Health & Social Care, 2011, 36(4): 190--205.

[26]

Nielsen, J. and Landauer, T. K. 2000. Why you only need to test with 5 users? Jakob Nielsen's Alertbox. Available from: http://www.useit.com/alertbox/20000319.html (accessed 10 April 2012).

[27]

Nielsen, J. and Landauer, T. K. 1993. A mathematical model of the finding of usability problems, Proceedings of ACM INTERCHI'93 Conference (Amsterdam, The Netherlands, 24-29 April 1993), pp. 206--213.

Digital Library

[28]

Sauro, J. 2010. Can You Measure Task Time If Users Think Aloud During A Usability Test? Available from: http://www.measuringusability.com/blog/thinking-aloud-time.php (accessed 10 April 2012).

Cited By

Khodaveisi TSadoughi FNovin KHosseiniravandi MDehnad A(2022)Development and evaluation of a teleoncology system for breast cancer during the COVID-19 pandemicFuture Oncology10.2217/fon-2021-082218:12(1437-1448)Online publication date: Apr-2022
https://doi.org/10.2217/fon-2021-0822
Gronier GBaudet A(2021)Psychometric Evaluation of the F-SUS: Creation and Validation of the French Version of the System Usability ScaleInternational Journal of Human–Computer Interaction10.1080/10447318.2021.189882837:16(1571-1582)Online publication date: 17-Mar-2021
https://doi.org/10.1080/10447318.2021.1898828
Rehman RJang JXiong S(2018)Usability Evaluations of a Newly Developed Wearable Inertial Sensing System for Assessing Elderly Fall RiskAdvances in Physical Ergonomics & Human Factors10.1007/978-3-319-94484-5_44(423-434)Online publication date: 26-Jun-2018
https://doi.org/10.1007/978-3-319-94484-5_44
Show More Cited By

Index Terms

Evaluation of a web-based telehealth system: a preliminary investigation with seniors in New Zealand
1. Applied computing
  1. Life and medical sciences
    1. Consumer health
    2. Health informatics
2. Human-centered computing
  1. Human computer interaction (HCI)
  2. Interaction design
    1. Interaction design process and methods
      1. User centered design

Recommendations

Leveraging consumer sensing devices for telehealth
CHINZ '12: Proceedings of the 13th International Conference of the NZ Chapter of the ACM's Special Interest Group on Human-Computer Interaction

Home telehealth applications are increasingly gaining in popularity among patients due their promise to use healthcare resources more effectively and hence to lower costs. Commercial telehealth systems usually employ patient stations and vital sign ...
Evaluation of a social web-based telehealth system
OzCHI '12: Proceedings of the 24th Australian Computer-Human Interaction Conference

Increasing healthcare costs and demographic changes necessitate healthcare interventions that foster independent care. Existing telehealth systems are focused on treating diseases instead of preventing them, suffer from high initial costs, lack ...
Perspectives on user experience for a nation-wide senior telehealth program
HCI '16: Proceedings of the 30th International BCS Human Computer Interaction Conference: Fusion!

Prior evidence shows that senior people accept technology and enjoy self-monitoring. Home telehealth support increases their confidence and sense of security. The use of communication technologies plays an important role avoiding isolation and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

CHINZ '12: Proceedings of the 13th International Conference of the NZ Chapter of the ACM's Special Interest Group on Human-Computer Interaction

July 2012

110 pages

ISBN:9781450314749

DOI:10.1145/2379256

Conference Chair:
Holger Regenbrecht
University of Otago
,
Program Chairs:
Christof Lutteroth,
Mark McGuire

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

New Zealand Chapter of ACM SIGCHI

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 July 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHINZ '12

Sponsor:

CHINZ '12: 13th Annual Conference of the NZ ACM Special Interest Group on Human-Computer Interaction

July 2 - 3, 2012

Dunedin, New Zealand

Acceptance Rates

Overall Acceptance Rate 8 of 23 submissions, 35%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
311
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)1

Reflects downloads up to 10 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Khodaveisi TSadoughi FNovin KHosseiniravandi MDehnad A(2022)Development and evaluation of a teleoncology system for breast cancer during the COVID-19 pandemicFuture Oncology10.2217/fon-2021-082218:12(1437-1448)Online publication date: Apr-2022
https://doi.org/10.2217/fon-2021-0822
Gronier GBaudet A(2021)Psychometric Evaluation of the F-SUS: Creation and Validation of the French Version of the System Usability ScaleInternational Journal of Human–Computer Interaction10.1080/10447318.2021.189882837:16(1571-1582)Online publication date: 17-Mar-2021
https://doi.org/10.1080/10447318.2021.1898828
Rehman RJang JXiong S(2018)Usability Evaluations of a Newly Developed Wearable Inertial Sensing System for Assessing Elderly Fall RiskAdvances in Physical Ergonomics & Human Factors10.1007/978-3-319-94484-5_44(423-434)Online publication date: 26-Jun-2018
https://doi.org/10.1007/978-3-319-94484-5_44
Dhillon JWünsche BLutteroth C(2013)An online social-networking enabled telehealth system for seniorsProceedings of the Fourteenth Australasian User Interface Conference - Volume 13910.5555/2525493.2525499(53-62)Online publication date: 29-Jan-2013
https://dl.acm.org/doi/10.5555/2525493.2525499
Dhillon JWünsche BLutteroth C(2012)Evaluation of a social web-based telehealth systemProceedings of the 24th Australian Computer-Human Interaction Conference10.1145/2414536.2414620(550-553)Online publication date: 26-Nov-2012
https://dl.acm.org/doi/10.1145/2414536.2414620

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents