THINKING ISSUES
Evaluating research impact in computing: a slippery slope?
Author: 
Tony ClearAuthors Info & Claims
Tony ClearAuthors Info & Claims
References
[1]
Alcorn, N., et al. "Enhancing Education Research in New Zealand: Experiences and Recommendations from the PBRF Education Peer Review Panel." New Zealand Journal of Educational Studies, 2 (2004), 275 -- 302.
[2]
Anderson, M.S. "The Complex Relations between the Academy and Industry: Views from the Literature." The Journal of Higher Education, 72, 2 (2001,: 226--247.
[3]
ARC. "National Innovation and Science Agenda engagement and impact assessment consultation paper." Australian Research Council (ARC) and the Department of Education and Training. (2016)
[4]
Benhamou, E. J. et al. "Assessing the changing US IT R&D ecosystem." Communications of the ACM, 53, 2 (2010), 76--83.
[5]
Biersteker, T.J. "Interrelationships between theory and practice in international security studies." Security Dialogue, 41, 6 (2010), 599--606.
[6]
Bornmann, L. "Measuring the societal impact of research." EMBO reports, 13, 8 (2012), 673--676.
[7]
Boston, J. "Rationale for the Performance-Based Research Fund: Personal Reflections." In Evaluating the Performance-Based Research Fund, edited by L Bakker, J Boston, L. Campbell and R. Smyth (Wellington: Institute of Policy Studies, Victoria University of Wellington, 2006), 5--32.
[8]
BSA. "The $1 Trillion Economic Impact of Software." BSA | The Software Alliance (2016).
[9]
Chubb, J. and Watermeyer, R. "Artifice or integrity in the marketization of research impact? Investigating the moral economy of (pathway to) impact statements within research funding proposals in the UK and Australia." Studies in Higher Education, (2016).
[10]
Clear, T. "Valuing Computer Science Education Research?" in Proceedings of the 6th Baltic Sea Conference on Computing Education Research, Koli Calling, edited by A. Berglund and M. Wiggberg. (Uppsala, Sweden: Uppsala University, 2007), 8--18.
[11]
Clear, A. and Clear, T. "The Fate of Computing in Research Performance Evaluation Schemes - ERA vs PBRF" in 2nd Annual Conference of Computing and Information Technology Research and Education (CITRENZ2011) incorporating the 24th Annual NACCQ Conference, edited by S. Mann and M Verhaart (Rotorua, New Zealand: CITRENZ: 2011) 51--62.
[12]
Clear, T. and Clear, A. "PBRF 2012 and the Nature of Degree Teaching" in 3rd Annual Conference of Computing and Information Technology Research and Education (CITRENZ2012) edited by M. Lopez and M. Verhaart (Christchurch, New Zealand CITRENZ, 2012,: 22--26.
[13]
Clear, T. et al. ERA 2018 Impact and Assessment Discussion Paper Feedback Response from Computing Research and Education Australasia (CoRE) and Australian Council of Deans of ICT (ACDICT). CoRE and ACDICT (Victoria Australia 2016), http://www.core.edu.au/submissions-and-endorsements. Accessed 2016 August 9.
[14]
Fincher, S. and Petre, M. Computer Science Education Research: The Field and the Endeavour. (London: Routledge Falmer, Taylor & Francis Group, 2004)
[15]
Harland, K. and O'Connor, H. "Broadening the Scope of Impact: Small Advanced Economies Initiative." (Report), March 1, 2015, http://www.smalladvancedeconomies.org/publications/. Accessed 2016 August 9.
[16]
Hicks, D. "Performance-based university research funding systems." Research Policy, 41, 2 (2012): 251--261.
[17]
Keynes, J. M. The General Theory of Employment, Interest and Money. (London: Macmillan, 1936.)
[18]
Levitt, R. Celia, C. Diepeveen, S. Chonaill, S.N. Rabinovich, L. and Tiessen, J. "Assessing the Impact of Arts and Humanities Research at the University of Cambridge." (RAND Corporation Technical Report), 2010. http://www.rand.org/content/dam/rand/pubs/technical.../RAND_TR816.pdf. Accessed 2016 May 13.
[19]
National Alliance for Broader Impacts. Broader Impacts Guiding Principles and Questions for National Science Foundation Proposals (Guidelines). 2016. http://broaderimpacts.net/. Accessed 2016 Sep 14.
[20]
NSF. Perspectives on Broader Impacts: National Science Foundation. August 2015. https://www.nsf.gov/od/iia/publications/Broader_Impacts.pdf. Accessed 2016 Sep 14.
[21]
NZTech, DIGITAL NATION NEW ZEALAND: An Analysis of the Impact of the Tech Sector and Technology on the New Zealand Economy - From Tech Sector to Digital Nation (New Zealand Technology Industry Association Report). 2016 http://www.nztech.org.nz/tag/digital-nation/. Accessed 2016 August 6.
[22]
Olssen, M. "Neoliberal competition in higher education today: research, accountability and impact." British Journal of Sociology of Education, 37, 1 (2016), 129--148.
[23]
Olssen, M. and Peters, M. A. "Neoliberalism, higher education and the knowledge economy: From the free market to knowledge capitalism." Journal of Education Policy, 20, 3 (2005), 313--345.
[24]
Penfield, T., et al. "Assessment, evaluations, and definitions of research impact: A review." Research Evaluation, (2013): rvt021.
[25]
Roberts, G. "Review of Research Assessment: Report by Sir Gareth Roberts to the UK Funding Bodies," (Joint funding bodies' Review of research assessment). (London, 2003), 1--100.
[26]
Shneiderman, B., et al. "Innovation trajectories for information visualizations: Comparing treemaps, cone trees, and hyperbolic trees." Information Visualization 11, 2 (2012): 87--105.
[27]
Simon, "Emergence of computing education as a research discipline." Doctoral Dissertation in Department of Computer Science (Aalto University, Helsinki, 2015), 220.
[28]
von_Tunzelmann, N. and Mbula, E. "Changes in Research Assessment Practices in Other Countries Since 1999: Final Report, Joint funding bodies' Review of research assessment." (London, 2003), 46.
- THINKING ISSUES
Evaluating research impact in computing: a slippery slope?
Recommendations
Thinking otherwise: Ethics, technology and other subjects
Ethics is ordinarily understood as being concerned with questions of responsibility for and in the face of an other. This other is more often than not conceived of as another human being and, as such, necessarily excludes others --- most notably animals ...
The Philosopher's Corner: The Value of Feyerabend's Anarchic Thinking for Information Systems Research
Further consideration of Feyerabend's ideas has potential value for information systems research. He continues in a long and commendable tradition of the scientist as a subversive and rebel - a tradition including Galileo, Franklin, Darwin, and Einstein ...
Some of the philosophical issues underpinning research in information systems: from positivism to critical realism
SAICSIT '04: Proceedings of the 2004 annual research conference of the South African institute of computer scientists and information technologists on IT research in developing countriesIn response to the South African Journal of Computing's editorial of June 2003, this paper reviews some of the philosophical issues underpinning academic research in Information Systems (IS). This is a reflective or theoretical paper, which considers a ...
Comments
Information & Contributors
Information
Published In
December 2016
100 pages
ISSN:2153-2184
EISSN:2153-2192
DOI:10.1145/3018995
- Editors:
- Mark Bailey,
- Laurie Smith King
Copyright © 2016 Copyright is held by the owner/author(s).
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 21 November 2016
Published in INROADS Volume 7, Issue 4
Check for updates
Qualifiers
- Column
- Popular
- Refereed
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 103Total Downloads
- Downloads (Last 12 months)5
- Downloads (Last 6 weeks)0
Reflects downloads up to 30 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderDigital Edition
View this article in digital edition.
Digital EditionMagazine Site
View this article on the magazine site (external)
Magazine Site