review-article

An Analysis of Age, Technology Usage, and Cognitive Characteristics Within Information Retrieval Tasks

Authors:

Vicki L. HansonAuthors Info & Claims

ACM Transactions on Accessible Computing (TACCESS), Volume 8, Issue 3

Article No.: 10, Pages 1 - 26

https://doi.org/10.1145/2856046

Published: 06 April 2016 Publication History

Abstract

This work presents two studies that aim to discover whether age can be used as a suitable metric for distinguishing performance between individuals or if other factors can provide greater insight. Information retrieval tasks are used to test the performance of these factors. First, a study is introduced that examines the effect that fluid intelligence and Internet usage has on individuals. Second, a larger study is reported on that examines a collection of Internet and cognitive factors in order to determine to what extent each of these metrics can account for disorientation in users.

This work adds to growing evidence showing that age is not a suitable metric to distinguish between individuals within the field of human-computer interaction. It shows that factors such as previous Internet experience and fluid-based cognitive abilities can be used to gain better insight into users’ reported browsing experience during information retrieval tasks.

References

[1]

J. S. Ahuja and J. Webster. 2001. Perceived disorientation: An examination of a new measure to assess web design effectiveness. Interacting with Computers 14, 1, 15--29.

[2]

B. Allen. 1992. Cognitive differences in end user searching of a CD-ROM index. In Proceedings of the 15th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM. 298--309.

Digital Library

[3]

B. Allen. 1994. Perceptual speed, learning and information retrieval performance. In Proceedings of the 17th Annual International ACM-SIGIR Conference on Research and Development in Information Retrieval. Springer, London. 71--80.

Digital Library

[4]

A. Aula. 2005. User study on older adults’ use of the Web and search engines. Universal Access in the Information Society 4, 1, 67--81.

Digital Library

[5]

A. Aula and K. Nordhausen. 2006. Modeling successful performance in Web searching. Journal of the American Society for Information Science and Technology 57, 12, 1678--1693.

Digital Library

[6]

M. H. Blackmon, M. Kitajima, and P. G. Polson. 2005. Tool for accurately predicting website navigation problems, non-problems, problem severity, and effectiveness of repairs. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM. 31--40.

Digital Library

[7]

R. B. Cattell. 1982. Meaningful Memory. Institute for Personality and Ability Testing.

[8]

R. B. Cattell. 1963. Theory of fluid and crystallized intelligence: A critical experiment. Journal of Educational Psychology 54, 1, 1.

[9]

R. B. Cattell, S. N. Feingold, and S. B. Sarason. 1941. A culture-free intelligence test: II. Evaluation of cultural influence on test performance. Journal of Educational Psychology 32, 2, 81.

[10]

J. Chin, W.-T. Fu, and T. Kannampallil. 2009. Adaptive information search: age-dependent interactions between cognitive profiles and strategies. In Proceedings of the 27th International Conference on Human Factors in Computing Systems. 1683--1692.

Digital Library

[11]

M. Crabb and V. L. Hanson. Age, technology usage, and cognitive characteristics in relation to perceived disorientation and reported website ease of use. In Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility.

Digital Library

[12]

S. J. Czaja, J. Sharit, R. Ownby, D. L. Roth, and S. Nair. 2001. Examining age differences in performance of a complex information search and retrieval task. Psychology and Aging 16, 4, 564--579.

[13]

S. J. Czaja, N. Charness, A. D. Fisk, C. Hertzog, S. N. Nair, W. A. Rogers, and J. Sharit. 2006. Factors predicting the use of technology: Findings from the center for research and education on aging and technology enhancement (create). Psychology and Aging 21, 2, 333.

[14]

S. J. Czaja, N. Charness, K. Dijkstra, A. D. Fisk, W. A. Rogers, and J. Sharit. 2006b. Computer and Technology Experience Questionnaire. Center for Research and Education on Aging and Technology Enhancement. Retrieved September 24, 2013, from http://createcenter.gatech.edu/publications_db/report&percnt;203&percnt;20ver1.3.pdf.

[15]

S. J. Czaja, J. Sharit, M. A. Hernández, S. N. Nair, and D. Loewenstein. 2010. Variability among older adults in Internet health information-seeking performance. Gerontechnology, 9, 1, 46--55.

[16]

S. J. Czaja, J. Sharit, C. C. Lee, S. N. Nair, M. A. Hernández, N. Arana, and S. H. Fu. 2013. Factors influencing use of an e-health website in a community sample of older adults. Journal of the American Medical Informatics Association, 20, 2, 277--284.

[17]

M. Dee and V. L. Hanson. 2014. A large user pool for accessibility research with representative users. In Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS’’14).

Digital Library

[18]

A. Dillon and C. Watson. 1996. User analysis in HCI—the historical lessons from individual differences research. International Journal of Human-Computer Studies 45, 6, 619--637.

Digital Library

[19]

J. Dinet, A. Chevalier, and A. Tricot. 2012. Information search activity: An overview. Revue Européenne de Psychologie Appliquée/European Review of Applied Psychology 62, 2, 49--62.

[20]

A. Dommes, A. Chevalier, and S. Lia. 2011. The role of cognitive flexibility and vocabulary abilities of younger and older users in searching for information on the web. Applied Cognitive Psychology 25, 5, 717--726.

[21]

R. B. Ekstrom, J. W. French, H. H. Harman, and D. Dermen. 1976. Manual for Kit of Factor-Referenced Cognitive Tests. Educational Testing Service, Princeton, NJ.

[22]

P. G. Fairweather. 2008. How older and younger adults differ in their approach to problem solving on a complex website. In Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 67--72.

Digital Library

[23]

D. P. E. Flanagan, S. O. Ortiz, and V. C. Alfonso. 2007. Essentials of Cross-Battery Assessment. Wiley.

[24]

D. P. Flanagan, V. C. Alfonso, and M. R. Reynolds. 2013. Broad and narrow CHC abilities measured and not measured by the Wechsler scales moving beyond within-battery factor analysis. Journal of Psychoeducational Assessment, 31, 2, 202--223.

[25]

J. W. French, R. B. Ekstrom, and L. A. Price. 1963. Manual for Kit of Reference Tests for Cognitive Factors (revised).

[26]

J. Freese, S. Rivas, and E. Hargittai. 2006. Cognitive ability and Internet use among older adults. Poetics, 34, 4, 236--249.

[27]

A. Gelman. 2008. Scaling regression inputs by dividing by two standard deviations. Statistics in Medicine, 27, 15, 2865--2873.

[28]

L. A. Granka, T. Joachims, and G. Gay. 2004. Eye-tracking analysis of user behavior in WWW search. In Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 478--479.

Digital Library

[29]

V. L. Hanson. 2009. Age and web access: the next generation. In Proceedings of the International Cross-Disciplinary Conference on Web.

Digital Library

[30]

V. L. Hanson. 2011. Technology skill and age: what will be the same 20 years from now&quest; Universal Access in the Information Society 10, 4, 443--452.

Digital Library

[31]

E. Herder and I. Juvina. 2004. Discovery of individual user navigation styles.

[32]

J. M. Hickman, W. A. Rogers, and A. D. Fisk. 2007. Training older adults to use new technology. Journals of Gerontology Series B: Psychological Sciences and Social Sciences 62 (Special Issue 1), 77--84.

[33]

R. J. Hodes and D. Lindberg. 2002. Making Your Web Site Senior Friendly. National Institute on Aging and the National Library of Medicine.

[34]

J. L. Horn. 1991. Measurement of intellectual capabilities: A review of theory. Woodcock-Johnson Technical Manual. 197--232.

[35]

J. L. Horn and R. B. Cattell. 1967. Age differences in fluid and crystallized intelligence. Acta Psychologica 26, 107--129.

[36]

J. L. Horn and R. B. Cattell. 1966. Refinement and test of the theory of fluid and crystallized general intelligences. Journal of Educational Psychology 57, 5, 253.

[37]

J. L. Horn and G. Donaldson. 1980. 10 Cognitive Development in Adulthood. Constancy and change in human development, 445.

[38]

I. Juvina and H. Oostendorp. 2006. Individual differences and behavioral metrics involved in modeling web navigation. Universal Access in the Information Society 4, 3, 258--269.

Digital Library

[39]

G. Marchionini, and B. Shneiderman. 1988. Finding facts vs. browsing knowledge in hypertext systems. Computer 21, 1, 70--80.

Digital Library

[40]

J. C. Marquié, L. Jourdan-Boddaert, and N. Huet. 2002. Do older adults underestimate their actual computer knowledge&quest; Behaviour & Information Technology 21, 4, 273--280.

[41]

K. S. McGrew. 2009. CHC theory and the human cognitive abilities project: Standing on the shoulders of the giants of psychometric intelligence research. Intelligence 37, 1, 1--10.

[42]

T. L. Mitzner, J. B. Boron, C. B. Fausset, A. E. Adams, N. Charness, and S. J. Czaja. 2010. Older adults talk technology: Technology usage and attitudes. Computers in Human Behavior 26, 6, 1710--1721.

Digital Library

[43]

S. N. Nair, S. J. Czaja, and J. Sharit. 2007. A multilevel modeling approach to examining individual differences in skill acquisition for a computer-based task. Journals of Gerontology Series B: Psychological Sciences and Social Sciences, 62 (Special Issue 1), 85--96.

[44]

V. L. O’Day and R. Jeffries. 1993. Orienteering in an information landscape: How information seekers get from here to there. In Proceedings of the INTERACT’93 and CHI’93 Conference on Human Factors in Computing Systems. ACM. 438--445.

Digital Library

[45]

Ofcom. 2013. Adults’ Media Use and Attitudes Report. stakeholders.ofcom.org.uk.

[46]

Ofcom. 2014. Adults’ Media Use and Attitudes Report. stakeholders.ofcom.org.uk.

[47]

Ofcom. 2011. UK Adults’ Media Literacy. stakeholders.ofcom.org.uk.

[48]

R. Pak and M. M. Price. 2008. Designing an information search interface for younger and older adults. Human Factors: The Journal of the Human Factors and Ergonomics Society, 50, 4, 614--628.

[49]

R. Pak, S. J. Czaja, J. Sharit, W. A. Rogers, and A. D. Fisk. 2008. The role of spatial abilities and age in performance in an auditory computer navigation task. Computers in Human Behavior, 24, 6, 3045--3051.

Digital Library

[50]

R. Pak and M. M. Price. 2008. Designing an information search interface for younger and older adults. Human Factors: The Journal of the Human Factors and Ergonomics Society, 50, 4, 614--628.

[51]

R. Pak, M. M. Price, and J. Thatcher. 2009. Age-sensitive design of online health information: comparative usability study. Journal of Medical Internet Research, 11, 4.

[52]

W. A. Rogers, A. D. Fisk, S. E. Mead, N. Walker, and E. F. Cabrera. 1996. Training older adults to use automatic teller machines. Human Factors: The Journal of the Human Factors and Ergonomics Society, 38, 3, 425--433.

[53]

W. Rogers and A. D. Fisk. 2010. Toward a psychological science of advanced technology design for older adults. Journal of Gerontology: Psychological Sciences, 65B, 645--653.

[54]

J. Sharit, M. A. Hernández, S. N. Nair, T. Kuhn, and S. J. Czaja. 2011. Health problem solving by older persons using a complex government web site: Analysis and implications for web design. Transactions on Accessible Computing (TACCESS), 3, 3.

Digital Library

[55]

J. Teevan, C. Alvarado, M. S. Ackerman, and D. R. Karger. 2004, April. The perfect search engine is not enough: A study of orienteering behavior in directed search. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM. 415--422.

Digital Library

[56]

E. L. Thorndike. 1920. The reliability and significance of tests of intelligence. Journal of Educational Psychology, 11, 5, 284.

[57]

S. Trewin et al. 2012. Understanding the role of age and fluid intelligence in information search. In Proceedings of the 14th International ACM SIGACCESS Conference. ACM, New York. 119.

Digital Library

[58]

P. van Schaik and J. Ling. 2012. An experimental analysis of experiential and cognitive variables in web navigation. Human-Computer Interaction, 27, 3, 199--234.

[59]

S. Vaucher and H. Sahraoui. 2010. Multi-level evaluation of web site navigability. In Proceedings of the 2010 12th IEEE International Symposium on Web Systems Evolution (WSE’10). 93--100.

[60]

S. J. Westerman, D. R. Davies, A. I. Glendon, R. B. Stammers, and G. Matthews. 1995. Age and cognitive ability as predictors of computerized information retrieval. Behaviour & Information Technology 14, 5, 313--326.

Cited By

Owusu SZimpa JAtta FDarling M(2024)Evaluating the Impact of AI-Personalized Learning Systems in Higher Education; Examining how They Affect Academic Performance across Different Age Groups at Kumasi Technical UniversityJournal of Artificial Intelligence, Machine Learning and Neural Network10.55529/jaimlnn.45.19.29(19-29)Online publication date: 3-Aug-2024
https://doi.org/10.55529/jaimlnn.45.19.29
Vuong TDas PRuotsalo T(2024)Associating cognitive abilities with naturalistic search behaviorJournal of the Association for Information Science and Technology10.1002/asi.24963Online publication date: 6-Nov-2024
https://doi.org/10.1002/asi.24963
Ma LXu LChen ZZhang X(2022)Factors of web-based learning competence among urban Chinese older adults: age differencesEducational Gerontology10.1080/03601277.2022.203157748:5(210-223)Online publication date: 30-Jan-2022
https://doi.org/10.1080/03601277.2022.2031577
Show More Cited By

Index Terms

An Analysis of Age, Technology Usage, and Cognitive Characteristics Within Information Retrieval Tasks
1. Human-centered computing
  1. Accessibility
    1. Accessibility design and evaluation methods
  2. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User models
      2. User studies
2. Information systems
  1. Information retrieval
    1. Users and interactive retrieval
      1. Search interfaces

Recommendations

Age, technology usage, and cognitive characteristics in relation to perceived disorientation and reported website ease of use
ASSETS '14: Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility

Comparative studies including older and younger adults are becoming more common in HCI, generally used to compare how these two different age groups will approach a task. However, it is unclear whether user "age" is the underlying factor that ...
Information retrieval models in the context of retrieval tasks

Information retrieval models are reviewed from the viewpoint of retrieval needs that cause different types of retrieval tasks. A generalized iterative query-response scheme of the retrieval process is presented. The characteristics of the system of ...
A machine learning approach for improved BM25 retrieval
CIKM '09: Proceedings of the 18th ACM conference on Information and knowledge management

Despite the widespread use of BM25, there have been few studies examining its effectiveness on a document description over single and multiple field combinations. We determine the effectiveness of BM25 on various document fields. We find that BM25 ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Accessible Computing

ACM Transactions on Accessible Computing Volume 8, Issue 3

Special Issue (Part 2) of Papers from ASSETS 2014

May 2016

105 pages

ISSN:1936-7228

EISSN:1936-7236

DOI:10.1145/2905052

Editors:
Matt Huenerfauth
Rochester Institute of Technology, USA
,
Kathleen F. McCoy
University of Delaware, USA

Issue’s Table of Contents

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 April 2016

Accepted: 01 December 2015

Revised: 01 December 2015

Received: 01 March 2015

Published in TACCESS Volume 8, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Review-article
Research
Refereed

Funding Sources

RCUK Digital Economy Research Hub

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
709
Total Downloads

Downloads (Last 12 months)52
Downloads (Last 6 weeks)4

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Owusu SZimpa JAtta FDarling M(2024)Evaluating the Impact of AI-Personalized Learning Systems in Higher Education; Examining how They Affect Academic Performance across Different Age Groups at Kumasi Technical UniversityJournal of Artificial Intelligence, Machine Learning and Neural Network10.55529/jaimlnn.45.19.29(19-29)Online publication date: 3-Aug-2024
https://doi.org/10.55529/jaimlnn.45.19.29
Vuong TDas PRuotsalo T(2024)Associating cognitive abilities with naturalistic search behaviorJournal of the Association for Information Science and Technology10.1002/asi.24963Online publication date: 6-Nov-2024
https://doi.org/10.1002/asi.24963
Ma LXu LChen ZZhang X(2022)Factors of web-based learning competence among urban Chinese older adults: age differencesEducational Gerontology10.1080/03601277.2022.203157748:5(210-223)Online publication date: 30-Jan-2022
https://doi.org/10.1080/03601277.2022.2031577
Lemoine PMense ERichardson M(2021)Social Media in Higher EducationInformation Technology Trends for a Global and Interdisciplinary Research Community10.4018/978-1-7998-4156-2.ch009(175-202)Online publication date: 2021
https://doi.org/10.4018/978-1-7998-4156-2.ch009
Lopatovska IKorshakova EBrown DLi YMin JPasiak AZheng KScholer FThomas PElsweiler DJoho HKando NSmith C(2021)User Perceptions of an Intelligent Personal Assistant's PersonalityProceedings of the 2021 Conference on Human Information Interaction and Retrieval10.1145/3406522.3446018(15-25)Online publication date: 14-Mar-2021
https://dl.acm.org/doi/10.1145/3406522.3446018
Orrensalo TNikou S(2021)Entrepreneurs’ Information Retrieval: The Role of Affective Aspects through the Media Richness Theory2021 IEEE International Conference on Technology and Entrepreneurship (ICTE)10.1109/ICTE51655.2021.9584789(1-6)Online publication date: 24-Aug-2021
https://doi.org/10.1109/ICTE51655.2021.9584789
Pradhan ALazar AFindlater L(2020)Use of Intelligent Voice Assistants by Older Adults with Low Technology UseACM Transactions on Computer-Human Interaction10.1145/337375927:4(1-27)Online publication date: 16-Sep-2020
https://dl.acm.org/doi/10.1145/3373759
Foulds OAzzopardi LHalvey MO'Brien HFreund LArapakis IHoeber OLopatovska I(2020)Reflecting upon Perceptual Speed Tests in Information RetrievalProceedings of the 2020 Conference on Human Information Interaction and Retrieval10.1145/3343413.3377982(234-242)Online publication date: 14-Mar-2020
https://dl.acm.org/doi/10.1145/3343413.3377982
Urbano IGuerreiro JNicolau H(2020)From skeuomorphism to flat design: age-related differences in performance and aesthetic perceptionsBehaviour & Information Technology10.1080/0144929X.2020.181486741:3(452-467)Online publication date: 2-Sep-2020
https://doi.org/10.1080/0144929X.2020.1814867
Gordon MGatys LGuestrin CBigham JTrister APatel KBrewster SFitzpatrick GCox AKostakos V(2019)App Usage Predicts Cognitive Ability in Older AdultsProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300398(1-12)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300398
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents