research-article

Assessing outcome and impact: towards a comprehensive evaluation approach in ICT4D

Authors:

Caroline KheneAuthors Info & Claims

ICTD '15: Proceedings of the Seventh International Conference on Information and Communication Technologies and Development

Article No.: 50, Pages 1 - 4

https://doi.org/10.1145/2737856.2737884

Published: 15 May 2015 Publication History

Abstract

It is well documented that ICTs are tools for development. However, there is still a need to comprehensively demonstrate the tangible and intangible effects that ICTs have towards development. A framework for the assessment of the outcomes and impacts of ICT4D is proposed, which provides guidelines for the critical aspects of a project that should be assessed and taken into account when conducting an outcome and impact assessment of rural ICT4D. This framework is based on a comprehensive approach to evaluation and forms part of continuous research on the rural ICT comprehensive evaluation framework (RICT-CEF). From this study five key themes have been identified based on a theoretical analysis and field observations. These themes include strategic value', 'empowerment', 'livelihoods', 'most significant change' and 'sustainability'.

References

[1]

Alsop, R., Bertelsen, M. F. and Holland, J. (2006). Empowerment in Practice: From analysis to implementation. Directions in Development. Retrieved September 24, 2013 from Washington DC, The World Bank website: http://siteresources.worldbank.org/INTEMPOWERMENT/Resources/Empowerment_in_Practice.pdf

[2]

Batchelor, S. and Norrish, P. (2006). Framework for assessment of ICT pilot projects: Beyond Monitoring and Evaluation to Applied Research. Information and Development Program. Retrieved April 04, 2012 from InfoDev website: http://www.infodev.org/infodevfiles/resource/InfodevDocuments_4.pdf.

[3]

Chambers, R. and Conway, G. R. (1991). Sustainable rural livelihoods; practical concepts for the 21^st century. (Paper 296). Retrieved October 09, 2013 from Institute of Development Studies (IDS) Discussion website: http://opendocs.ids.ac.uk/opendocs/bitstream/handle/123456789/775/Dp296.pdf?sequence=1.

[4]

Department for International Development (DFID). 1999. Sustainable Livelihood Guidance Sheet Section 2, DFID, London. {Online}.Available: http://www.livelihoods.org/info/guidance_sheets_pdfs/section2.pdf {Accessed 28 March 2013}.

[5]

Duncombe, R. (2006). Using the livelihoods framework to analyse ICT applications for poverty reduction through microenterprise. Information Technologies and International Development, 3, 3, 81--100.

[6]

Gigler, B. S. (2004). Including the excluded: can ICTs empower poor communities? Towards an alternative evaluation framework based on the capability approach. 4^th International Conference on the Capability Approach. University of Pavia, September 5--7, University of Pavia, Italy.

[7]

Gomez, R. and Pather, S. (2012). ICT Evaluation: Are we asking the right questions? Electronic Journal of Information Systems in Developing Countries, 50, 5, 1--14.

[8]

Grunfeld, H. (2007). Framework for evaluating contributions of ICT to capabilities, empowerment and sustainability in disadvantaged communities. Indian Institute of Technology (IIT), Paper presented at the CPRSouth2 (Communication Policy Research) Conference, 'Empowering rural communities through ICT policy and research', December 15--17, Madras, Chennai.

[9]

Hallikainen, P. and Chen L. (2005). A Holistic Framework on Information Systems Evaluation with a Case Analysis. The Electronic Journal Information systems Evaluation, 9, 2, 57--64.

[10]

Hamel, J. (2010). ICT4D and the human development and capabilities approach: the potentials of information and communication technology. (Report 37). Retrieved March 26, 2012 from http://mpra.ub.unimuenchen.de/25561/.

[11]

Heeks, R. and Molla, A. (2009). Impact Assessment of ICT-for-Development Projects: A Compendium of Approaches. (Working Paper, 36). Manchester Development Informatics Group, Manchester, UK: Development Informatics Group Institute for Development Policy and Management.

[12]

Hevner, A. R. and Chatterjee, S., 2010. Design Research in Information Systems: Theory and Practice. New York: Springer.

Digital Library

[13]

Hevner, A. R., March, S. T., Park, J. and Ram, S., 2004. Design Science Research in Information Systems Research. MIS Quarterly. 28(1), pp. 75--105.

Digital Library

[14]

Hilty, M. and Hercheui, D. M. (2010). ICT and Sustainable Development (Report 328). Queensland, Australia: IFIP International Federation for Information Processing.

[15]

International Development Research Centre (IDRC) (2005) Learning from IDRC-Supported Rural ICT Projects in Asia. International Development Research Centre. {Online}. Available: http://web.idrc.ca/en/ev-67344-201-1-DO_TOPIC.html.

[16]

Kozma, R. B. (2005). Monitoring and Evaluation of ICT for Education Impact: A Review. In: D. A. Wagner, B. Day, T. James, R. B Kozma, J. Miller and T. Unwin (Eds.), Monitoring and Evaluation of ICT in Education Projects. A Handbook for Developing Countries (pp. 11--18). Washington, DC: infoDev/World Bank. Retrieved March 24, 2012 from http://www.infodev.org/en/Publication.9.html.

[17]

Pade-Khene, C. and Sewry, D. (2011). Proposed Stages of a Rural ICT Comprehensive Evaluation Framework in ICT for Rural Development Projects. SAICSIT 2011, Annual Conference of the South African Institute of Computer Scientists and Information Technologists, Cape Town, South Africa, October 2011

Digital Library

[18]

Parkinson, S. and Ramirez, R. (2006). Using a sustainable livelihoods approach to assessing the impact of ICTs in development. Community Informatics, 2, 3, 116--127. Retrieved March 26, 2012 from http://cijournal.net/index.php/ciej/issue/view/15

[19]

Rabaya, K. S. (2009). Economic and Social empowerment of women through Information and Communication Technology: A case study of Palestine. The Journal of Community Informatics, 5, 3.

[20]

Souter, D. (2012). ICTS, the Internet and Sustainability: (A discussion paper, 28 May 2012). Manitoba, Canada: International Institute for Sustainable Development.

[21]

White, H., Killick, T. and Kayizzi-Mugerwa. (2001). African Poverty at the Millennium: causes, complexities and challenges. Washington, DC: World Bank Publications.

[22]

Wieman, A., Gast, L., Hagen, I. and Van Der Krogt, S. (2001). Monitoring and Evaluation at IICD: An Instrument to Assess Development Impact and Effectiveness, (Report no. 5). The Hague: International Institute for Communication and Development (IICD).

[23]

World Bank Group. (2012). ICT for Greater Development Impact-Information and Communication Technology. World Bank Group Strategy. Retrieved September 11, 2013 from http://siteresources.worldbank.org/EXTINFORMATIONANDCOMMUNICATIONANDTECHNOLOGIES/Resources/WBG_ICT_Strategy-2012.pdf.

Cited By

Yim MGomez R(2021)ICT4D evaluation: its foci, challenges, gaps, limitations, and possible approaches for improvementInformation Technology for Development10.1080/02681102.2021.195115128:2(251-274)Online publication date: 22-Jul-2021
https://doi.org/10.1080/02681102.2021.1951151
Tabassum GKulathuramaiyer NHarris RYeo A(2019)The indirect and intangible impacts of a telecentre on a rural communityTHE ELECTRONIC JOURNAL OF INFORMATION SYSTEMS IN DEVELOPING COUNTRIES10.1002/isd2.1208785:3Online publication date: 19-Mar-2019
https://doi.org/10.1002/isd2.12087
Nanavati ADias MSteinfeld AMandryk RHancock MPerry MCox A(2018)Speak UpProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173892(1-12)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173892
Show More Cited By

Index Terms

Assessing outcome and impact: towards a comprehensive evaluation approach in ICT4D
1. Social and professional topics
  1. Computing / technology policy

Recommendations

Critical Themes of Process Assessment in Rural ICT4D Projects: An Analysis of Assessment Approaches
Abstract
Information and Communication Technologies (ICTs) are often perceived as adequate support tools for development activities. However, their successful employment as development enablers requires strategic implementation. Hence, effectively ...
Moving Beyond Digital Literacy and Towards e-Governance in Rural India
ICEGOV '17: Proceedings of the Special Collection on eGovernment Innovations in India

The ongoing Digital India Programme envisions universal digital literacy. This reflexive piece considers the context of this bold declaration to universalize digital literacy in rural India. We present civil society perspective on social challenges of ...
Increasing participation in the information society by people with disabilities and their families in lower-income countries using mainstream technologies

Assistive technology (AT) has been actively researched, developed and implemented throughout higher-income countries, but is relatively absent from lower-income countries. In lower-income countries, there is very little AT for reading, writing, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICTD '15: Proceedings of the Seventh International Conference on Information and Communication Technologies and Development

May 2015

429 pages

ISBN:9781450331630

DOI:10.1145/2737856

General Chair:
Arul Chib
Nanyang Technological University
,
Program Chairs:
Matthew Kam
Google
,
Jenna Burrell
University of California, Berkeley

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

IPID: International Network for Postgraduate Students in the area of ICT4D
Internet Society: Internet Society
BRAC: BRAC
Microsoft Research: Microsoft Research
ICANN: Internet Corporation For Assigned Names and Numbers
IBM: IBM

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 May 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICTD '15

Sponsor:

IPID
Internet Society
BRAC
Microsoft Research
ICANN
IBM

ICTD '15: The Seventh International Conference on Information and Communication Technologies and Development

May 15 - 18, 2015

Singapore, Singapore

Acceptance Rates

ICTD '15 Paper Acceptance Rate 22 of 116 submissions, 19%;

Overall Acceptance Rate 22 of 116 submissions, 19%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
241
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yim MGomez R(2021)ICT4D evaluation: its foci, challenges, gaps, limitations, and possible approaches for improvementInformation Technology for Development10.1080/02681102.2021.195115128:2(251-274)Online publication date: 22-Jul-2021
https://doi.org/10.1080/02681102.2021.1951151
Tabassum GKulathuramaiyer NHarris RYeo A(2019)The indirect and intangible impacts of a telecentre on a rural communityTHE ELECTRONIC JOURNAL OF INFORMATION SYSTEMS IN DEVELOPING COUNTRIES10.1002/isd2.1208785:3Online publication date: 19-Mar-2019
https://doi.org/10.1002/isd2.12087
Nanavati ADias MSteinfeld AMandryk RHancock MPerry MCox A(2018)Speak UpProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173892(1-12)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173892
Meissner JVines JMcLaughlin JNappey TMaksimova JWright PMival OSmyth MDalsgaard P(2017)Do-It-Yourself Empowerment as Experienced by Novice Makers with DisabilitiesProceedings of the 2017 Conference on Designing Interactive Systems10.1145/3064663.3064674(1053-1065)Online publication date: 10-Jun-2017
https://dl.acm.org/doi/10.1145/3064663.3064674
Ssozi-Mugarura FRivett UBlake EToyama K(2016)Using Activity Theory to Understand Technology Use and Perception among Rural Users in UgandaProceedings of the Eighth International Conference on Information and Communication Technologies and Development10.1145/2909609.2909650(1-10)Online publication date: 3-Jun-2016
https://dl.acm.org/doi/10.1145/2909609.2909650

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents