Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3442188.3445871acmconferencesArticle/Chapter ViewAbstractPublication PagesfacctConference Proceedingsconference-collections
research-article

Fifty Shades of Grey: In Praise of a Nuanced Approach Towards Trustworthy Design

Published: 01 March 2021 Publication History

Abstract

Environmental data science is uniquely placed to respond to essentially complex and fantastically worthy challenges related to arresting planetary destruction. Trust is needed for facilitating collaboration between scientists who may share datasets and algorithms, and for crafting appropriate science-based policies. Achieving this trust is particularly challenging because of the numerous complexities, multi-scale variables, interdependencies and multi-level uncertainties inherent in environmental data science. Virtual Labs---easily accessible online environments provisioning access to datasets, analysis and visualisations---are socio-technical systems which, if carefully designed, might address these challenges and promote trust in a variety of ways. In addition to various system properties that can be utilised in support of effective collaboration, certain features which are commonly seen to benefit trust---transparency and provenance in particular---appear applicable to promoting trust in and through Virtual Labs. Attempting to realise these features in their design reveals, however, that their implementation is more nuanced and complex than it would appear. Using the lens of affordances, we argue for the need to carefully articulate these features, with consideration of multiple stakeholder needs on balance, so that these Virtual Labs do in fact promote trust. We argue that these features not be conceived as widgets that can be imported into a given context to promote trust; rather, whether they promote trust is a function of how systematically designers consider various (potentially conflicting) stakeholder trust needs.

References

[1]
Matthew Arnold, Rachel K. E. Bellamy, Michael Hind, Stephanie Houde, Sameep Mehta, Aleksandra Mojsilovic, Ravi Nair, Karthikeyan Natesan Ramamurthy, Alexandra Olteanu, David Piorkowski, Darrell Reimer, John T. Richards, Jason Tsay, and Kush R. Varshney. 2019. FactSheets: Increasing trust in AI services through supplier's declarations of conformity. IBM J. Res. Dev. 63, 4/5 (2019), 6:1-6:13. https://doi.org/10.1147/JRD.2019.2942288
[2]
Maryam Ashoori and Justin D. Weisz. 2019. In AI We Trust? Factors That Influence Trustworthiness of AI-infused Decision-Making Processes. (2019). arXiv:1912.02675
[3]
Klaus B. Bærentsen and Johan Trettvik. 2002. An Activity Theory Approach to Affordance. In Proceedings of the Second Nordic Conference on Human-Computer Interaction (Aarhus, Denmark) (NordiCHI '02). Association for Computing Machinery, New York, NY, USA, 51--60. https://doi.org/10.1145/572020.572028
[4]
Iain Barclay, Alun D. Preece, Ian J. Taylor, and Dinesh C. Verma. 2019. Towards Traceability in Data Ecosystems using a Bill of Materials Model. (2019). arXiv:1904.04253
[5]
Jakob E. Bardram and Steven Houben. 2018. Collaborative Affordances of Medical Records. Comput. Supported Coop. Work 27, 1 (2018), 1--36. https://doi.org/10.1007/s10606-017-9298-5
[6]
Michelle Barker, Silvia Delgado Olabarriaga, Nancy Wilkins-Diehr, Sandra Gesing, Daniel S. Katz, Shayan Shahand, Scott Henwood, Tristan Glatard, Keith Jeffery, Brian Corrie, Andrew Treloar, Helen Glaves, Lesley Wyborn, Neil P. Chue Hong, and Alessandro Costa. 2019. The Global Impact of Science Gateways, Virtual Research Environments and Virtual Laboratories. Future Generation Computer Systems 95 (2019), 240--248. https://doi.org/10.1016/j.future.2018.12.026
[7]
Michele L. Barnes, Emmanuel Mbaru, and Nyawira Muthiga. 2019. Information access and knowledge exchange in co-managed coral reef fisheries. Biological Conservation 238 (2019). https://doi.org/10.1016/j.biocon.2019.108198
[8]
Jo Bates, Yu-Wei Lin, and Paula Goodale. 2016. Data journeys: Capturing the socio-material constitution of data objects and flows. Big Data & Society 3, 2 (2016). https://doi.org/10.1177/2053951716654502
[9]
Neil Beagrie. 2006. Digital Curation for Science, Digital Libraries, and Individuals. International Journal of Digital Curation 1 (2006), 3--16. https://doi.org/10.2218/ijdc.v1i1.2
[10]
Sean Bechhofer, Iain Buchan, David De Roure, Paolo Missier, John Ainsworth, Jiten Bhagat, Philip Couch, Don Cruickshank, Mark Delderfield, Ian Dunlop, Matthew Gamble, Danius Michaelides, Stuart Owen, David Newman, Shoaib Sufi, and Carole Goble. 2013. Why linked data is not enough for scientists. Future Generation Computer Systems 29, 2 (2013), 599--611. https://doi.org/10.1016/j.future.2011.08.004
[11]
Emily M. Bender and Batya Friedman. 2018. Data Statements for Natural Language Processing: Toward Mitigating System Bias and Enabling Better Science. Transactions of the Association for Computational Linguistics 6 (2018), 587--604. https://doi.org/10.1162/tacl_a_00041
[12]
Mike Berners-Lee. 2019. There Is No Planet B: A Handbook for the Make or Break Years. Cambridge University Press, New York.
[13]
Umang Bhatt, Alice Xiang, Shubham Sharma, Adrian Weller, Ankur Taly, Yunhan Jia, Joydeep Ghosh, Ruchir Puri, José M. F. Moura, and Peter Eckersley. 2020. Explainable Machine Learning in Deployment. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (Barcelona, Spain) (FAT* '20). Association for Computing Machinery, New York, NY, USA, 648--657. https://doi.org/10.1145/3351095.3375624
[14]
Gordon S. Blair, Keith Beven, Rob Lamb, Richard Bassett, Kris Cauwenberghs, Barry Hankin, Graham Dean, Neil Hunter, Liz Edwards, Vatsala Nundloll, Faiza Samreen, Will Simm, and Ross Towe. 2019. Models of Everywhere Revisited: A Technological Perspective. Environmental Modelling & Software 122 (2019), 104521. https://doi.org/10.1016/j.envsoft.2019.104521
[15]
Gordon S. Blair, Amber Leeson, John Watkins, Emma Eastoe, Susan Jarvis, and Paul J. Young. 2019. Data Science of the Natural Environment: A Research Roadmap. Front. Environ. Sci. 7, 121 (2019), 1--14. https://doi.org/10.3389/fenvs.2019.00121
[16]
Jan J. Boersema. 2009. Environmental Sciences, Sustainability, and Quality. In Principles of Environmental Sciences, Jan J. Boersema and Lucas Reijnders (Eds.). Springer Netherlands, Dordrecht, 3--14. https://doi.org/10.1007/978-1-4020-9158-2_1
[17]
Christine L. Borgman. 2015. Big Data, Little Data, No Data: Scholarship in the Networked World. The MIT Press, Cambridge, MA.
[18]
danah boyd. 2010. Social Network Sites as Networked Publics: Affordances, Dynamics, and Implications. In Networked Self: Identity, Community, and Culture on Social Network Sites, Zizi Papacharissi (Ed.). Routledge, New York, Chapter 2, 39--58.
[19]
Erin Bradner. 2001. Social Affordances of Computer-Mediated Communication Technology: Understanding Adoption. In CHI '01 Extended Abstracts on Human Factors in Computing Systems (Seattle, Washington) (CHI EA '01). Association for Computing Machinery, New York, NY, USA, 67--68. https://doi.org/10.1145/634067.634111
[20]
Erin Bradner, Wendy A. Kellogg, and Thomas Erickson. 1999. The Adoption and Use of "BABBLE": A Field Study of Chat in the Workplace. In Proceedings of the Sixth European Conference on Computer Supported Cooperative Work (Copenghagen, Denmark). Kluwer Academic Publishers, USA, 139--158. https://doi.org/10.1007/978-94-011-4441-4_8
[21]
Monika Büscher, Preben Mogensen, and Dan Shapiro. 2001. Spaces of practice. In Proceedings of the Seventh European Conference on Computer Supported Cooperative Work, 16-20 September 2001, Bonn, Germany, Wolfgang Prinz, Matthias Jarke, Yvonne Rogers, Kjeld Schmidt, and Volker Wulf (Eds.). Kluwer, 139--158. https://doi.org/10.1007/0-306-48019-0_8
[22]
V. Cahill, E. Gray, J.M. Seigneur, C.Jensen, Y. Chen, B. Shand, N. Dimmock, A. Twigg, J. Bacon, C. English, W. Wagealla, S. Terzis, P. Nixon, G. Serugendo, C. Bryce, M. Carbone, K. Krukow, and M. Nielsen. 2003. Using trust for secure collaboration in uncertain environments. IEEE Pervasive Computing 2, 3 (2003), 52--61. https://doi.org/10.1109/MPRV.2003.1228527
[23]
Muffy Calder, Simon Dobson, Michael Fisher, and Julie McCann. 2018. Making Sense of the World: Framing Models for Trustworthy Sensor-Driven Systems. Computers 7, 4 (Nov 2018), 62. https://doi.org/10.3390/computers7040062
[24]
Sarah Callaghan, Steve Donegan, Sam Pepler, Mark Thorley, Nathan Cunningham, Peter Kirsch, Linda Ault, Patrick Bell, Rod Bowie, Adam Leadbetter, Roy Lowry, Gwen Moncoiffe, Kate Harrison, Ben Smith-Haddon, Anita Weatherby, and Dan Wright. 2012. Making Data a First Class Scientific Output: Data Citation and Publication by NERC's Environmental Data Centres. International Journal of Digital Curation 7, 1 (2012), 107--113. https://doi.org/10.2218/ijdc.v7i1.218
[25]
Leonardo Candela, Donatella Castelli, and Pasquale Pagano. 2013. Virtual Research Environments: An Overview and a Research Agenda. Data Science Journal 12 (2013), 75--81. https://doi.org/10.2481/dsj.GRDI-013
[26]
James Cheney, Laura Chiticariu, and Wang-Chiew Tan. 2009. Provenance in Databases: Why, How, and Where. Found. Trends Databases 1, 4 (April 2009), 379--474. https://doi.org/10.1561/1900000006
[27]
Elizabeth F. Churchill. 2012. From Data Divination to Data-Aware Design. Interactions 19, 5 (2012), 10--13. https://doi.org/10.1145/2334184.2334188
[28]
David Clark. 2014. The Role of Trust in Cyberspace. In Trust, Computing, and Society, Richard H. Harper (Ed.). Cambridge University Press, Cambridge, Chapter 2, 17--37. https://doi.org/10.1017/CBO9781139828567
[29]
Piotr Cofta. 2007. Confidence, Trust and Identity. BT Technology Journal 25, 2 (2007), 173--178. https://doi.org/10.1007/s10550-007-0042-4
[30]
Susan B Davidson, Sanjeev Khanna, Sudeepa Roy, Julia Stoyanovich, Val Tannen, and Yi Chen. 2011. On Provenance and Privacy. In Proceedings of the 14th International Conference on Database Theory (Uppsala, Sweden) (ICDT '11). Association for Computing Machinery, New York, NY, USA, 3--10. https://doi.org/10.1145/1938551.1938554
[31]
Simon de Lusignan, Siaw-Teng Liaw, Paul Krause, Vasa Curcin, M Vicente, Georgios Michalakidis, Lars Agreus, Peter Leysen, Nicola Shaw, and K Mendis. 2011. Key Concepts to Assess the Readiness of Data for International Research: Data Quality, Lineage and Provenance, Extraction and Processing Errors, Traceability, and Curation. Contribution of the IMIA Primary Health Care Informatics Working Group. Yearbook of medical informatics 6 (2011), 112--120. https://doi.org/10.1055/s-0038-1638748
[32]
David De Roure, Carole Goble, Sergejs Aleksejevs, Sean Bechhofer, Jiten Bhagat, Don Cruickshank, Paul Fisher, Duncan Hull, Danius Michaelides, David Newman, Rob Procter, Yuwei Lin, and Meik Poschen. 2010. Towards Open Science: The MyExperiment Approach. Concurr. Comput.: Pract. Exper. 22, 17 (2010), 2335--2353. https://doi.org/10.1002/cpe.1601
[33]
Graham Dean, Victoria Janes Bassett, Ross Paul Towe, Vatsala Nundloll, Jessica Davies, and Gordon Shaw Blair. 2017. An Interdisciplinary approach to Finding and Using Data for Complex Environmental Modelling Problems: A Soil System Example. EnviroInfo2017 (2017). http://www.research.lancs.ac.uk/portal/en/publications/an-interdisciplinary-approach-to-finding-and-using-data-for-complex-environmental-modelling-problems(c7bc7483-662b-4817-bd0b-5520fb970948).html
[34]
Alan Dix. 2007. Designing for Appropriation. In Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but Not as We Know It - Volume 2 (BCS-HCI '07). BCS Learning Development Ltd., Swindon, GBR, 27--30. https://doi.org/doi/10.5555/1531407.1531415
[35]
Finale Doshi-Velez and Been Kim. 2017. Towards A Rigorous Science of Interpretable Machine Learning. arXiv:1702.08608
[36]
Paul Dourish, W. Keith Edwards, Anthony LaMarca, and Michael Salisbury. 1999. Presto: An Experimental Architecture for Fluid Interactive Document Spaces. ACM Trans. Comput.-Hum. Interact. 6, 2 (June 1999), 133--161. https://doi.org/10.1145/319091.319099
[37]
Natasha Dwyer, Anirban Basu, and Stephen Marsh. 2013. Reflections on Measuring the Trust Empowerment Potential of a Digital Environment. In Trust Management VII (IFIP Advances in Information and Communication Technology, Vol. 401), M. Carmen Fernández Gago, Fabio Martinelli, Siani Pearson, and Isaac Agudo (Eds.). Springer, 127--135. https://doi.org/10.1007/978-3-642-38323-6_9
[38]
Steve M. Easterbrook. 2010. Climate change: a grand software challenge. In Proceedings of the Workshop on Future of Software Engineering Research, FoSER 2010, at the 18th ACM SIGSOFT International Symposium on Foundations of Software Engineering, 2010, Santa Fe, NM, USA, November 7-11, 2010, Gruia-Catalin Roman and Kevin J. Sullivan (Eds.). ACM, 99--104. https://doi.org/10.1145/1882362.1882383
[39]
Steve M. Easterbrook. 2014. From Computational Thinking to Systems Thinking: A conceptual toolkit for sustainability computing. In ICT for Sustainability 2014 (ICT4S-14), Stockholm, Sweden, August 25, 2014. Atlantis Press. https://doi.org/10.2991/ict4s-14.2014.28
[40]
Paul N. Edwards. 2010. A Vast Machine: Computer Models, Climate Data, and the Politics of Global Warming. The MIT Press, Cambridge, MA.
[41]
Paul N. Edwards, Matthew S. Mayernik, Archer L. Batcheller, Geoffrey C. Bowker, and Christine L. Borgman. 2011. Science friction: Data, metadata, and collaboration. Social Studies of Science 41, 5 (2011), 667--690. https://doi.org/10.1177/0306312711413314
[42]
Madeleine Clare Elish and danah boyd. 2018. Situating methods in the magic of Big Data and AI. Communication Monographs 85, 1 (2018), 57--80. https://doi.org/10.1080/03637751.2017.1375130
[43]
Yehia Elkhatib, Gordon S. Blair, and Bholanathsingh Surajbali. 2013. Experiences of using a hybrid cloud to construct an environmental virtual observatory. In Proceedings of the 3rd International Workshop on Cloud Data and Platforms, CloudDP@EuroSys 2013, Prague, Czech Republic, April 14-17, 2013, Paulo Ferreira, Zbigniew Jerzak, and Peter R. Pietzuch (Eds.). ACM, 13--18. https://doi.org/10.1145/2460756.2460759
[44]
Yehia Elkhatib, Alastair L. Gemmell, Claudia Vitolo, Mark E. Wilkinson, Eleanor B. Mackay, Barbara J. Percy, Gordon S. Blair, and Robert J. Gurney. 2019. Widening the Circle of Engagement Around Environmental Issues using Cloud-based Tools. In 39th IEEE International Conference on Distributed Computing Systems, ICDCS 2019, Dallas, TX, USA, July 7-10, 2019. IEEE, 1404--1415. https://doi.org/10.1109/ICDCS.2019.00140
[45]
Thomas Erickson and Wendy A. Kellogg. 2000. Social Translucence: An Approach to Designing Systems That Support Social Processes. ACM Trans. Comput.-Hum. Interact. 7, 1 (March 2000), 59--83. https://doi.org/10.1145/344949.345004
[46]
Thomas Erickson, David N. Smith, Wendy A. Kellogg, Mark Laff, John T. Richards, and Erin Bradner. 1999. Socially Translucent Systems: Social Proxies, Persistent Conversation, and the Design of "Babble". In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Pittsburgh, Pennsylvania, USA) (CHI '99). Association for Computing Machinery, New York, NY, USA, 72--79. https://doi.org/10.1145/302979.302997
[47]
Sandra K. Evans, Katy E. Pearce, Jessica Vitak, and Jeffrey W. Treem. 2016. Explicating Affordances: a Conceptual Framework for Understanding Affordances in Communication Research. Journal of Computer-Mediated Communication 22, 1 (2016), 35--52. https://doi.org/10.1111/jcc4.12180
[48]
Anne-Laure Fayard and John Weeks. 2014. Affordances for Practice. Inf. Organ. 24, 4 (Oct. 2014), 236--249. https://doi.org/10.1016/j.infoandorg.2014.10.001
[49]
Ashley Fulmer and Kurt Dirks. 2018. Multilevel trust: A theoretical and practical imperative. Journal of Trust Research 8, 2 (2018), 137--141. https://doi.org/10.1080/21515581.2018.1531657
[50]
Matthew Gamble and Carole Goble. 2011. Quality, Trust, and Utility of Scientific Data on the Web: Towards a Joint Model. In Proceedings of the 3rd International Web Science Conference. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/2527031.2527048
[51]
William W. Gaver. 1991. Technology Affordances. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (New Orleans, Louisiana, USA) (CHI 91). Association for Computing Machinery, New York, NY, USA, 79--84. https://doi.org/10.1145/108844.108856
[52]
Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daumé III, and Kate Crawford. 2018. Datasheets for Datasets. arXiv:1803.09010
[53]
James J. Gibson. 1977. The Theory of Affordances. In Perceiving, Acting, Knowing: Toward an Ecological Psychology, Robert Shaw and John Bransford (Eds.). Lawrence Erlbaum, Hillsdale, NJ, Chapter 3, 67--82.
[54]
James J. Gibson. 1979. The Ecological Approach to Visual Perception. Houghton Mifflin, Boston, MA.
[55]
Anthony Giddens. 1984. The Constitution of Society: Outline of the Theory of Structuration. University of California Press, Berkeley, CA.
[56]
Sarah Giest. 2017. Big Data for Policymaking: Fad or Fasttrack? Policy Sciences 50, 3 (2017), 367--382. https://doi.org/10.1007/s11077-017-9293-1
[57]
Yolanda Gil, Ewa Deelman, Mark Ellisman, Thomas Fahringer, Geoffrey Fox, Dennis Gannon, Carole Goble, Miron Livny, Luc Moreau, and Jim Myers. 2007. Examining the Challenges of Scientific Workflows. Computer 40, 12 (Dec. 2007), 24--32. https://doi.org/10.1109/MC.2007.421
[58]
Lisa Gitelman (Ed.). [n.d.]. The MIT Press, Cambridge, MA.
[59]
Alyssa Glass, Deborah L. McGuinness, and Michael Wolverton. 2008. Toward Establishing Trust in Adaptive Agents. In Proceedings of the 13th International Conference on Intelligent User Interfaces (Gran Canaria, Spain) (IUI '08). Association for Computing Machinery, New York, NY, USA, 227--236. https://doi.org/10.1145/1378773.1378804
[60]
Evgeny P. Gordov, Igor Okladnikov, Anna Ryazanova, Alexander Titov, and Yulia Gordova. 2018. A virtual thematic research environment for analysis of climate change and its consequences for Northern Eurasia: the current state of the art and perspectives. IOP Conference Series: Earth and Environmental Science 211 (dec 2018). https://doi.org/10.1088/1755-1315/211/1/012079
[61]
Sheila Greene, Penny J. Johnes, John P. Bloomfield, Sim M. Reaney, Russell S. Lawley, Yehia Elkhatib, Jim Freer, Nick Odoni, Christopher J. A. Macleod, and Barbara J. Percy. 2015. A geospatial framework to support integrated biogeochemical modelling in the United Kingdom. Environmental Modelling and Software 68 (2015), 219--232. https://doi.org/10.1016/j.envsoft.2015.02.012
[62]
Trisha Greenhalgh and Rob Stones. 2010. Theorising big IT programmes in healthcare: Strong structuration theory meets actor-network theory. Social Science Medicine 70, 9 (2010), 1285--1294. https://doi.org/10.1016/j.socscimed.2009.12.034
[63]
Willow Hallgren, Linda Beaumont, Andrew Bowness, Lynda Chambers, Erin Graham, Hamish Holewa, Shawn Laffan, Brendan Mackey, Henry Nix, Jeff Price, Jeremy Vanderwal, Rachel Warren, and Gerhard Weis. 2016. The Biodiversity and Climate Change Virtual Laboratory: Where ecology meets big data. Environmental Modelling Software 76 (2016), 182--186. https://doi.org/10.1016/j.envsoft.2015.10.025
[64]
Paula A. Harrison, Robert W. Dunford, Ian P. Holman, and Mark Rounsevell. 2016. Climate change impact modelling needs to include cross-sectoral interactions. Nature Climate Change 6 (2016), 885--890. Issue 9. https://doi.org/10.1038/nclimate3039
[65]
Rex Hartson. 2003. Cognitive, physical, sensory, and functional affordances in interaction design. Behaviour & Information Technology 22, 5 (2003), 315--338. https://doi.org/10.1080/01449290310001592587
[66]
Peter A. Henrys and Susan G. Jarvis. 2019. Integration of ground survey and remote sensing derived data: Producing robust indicators of habitat extent and condition. Ecology and Evolution 9, 14 (2019), 8104--8112. https://doi.org/10.1002/ece3.5376
[67]
Morten Hertzum. 1999. Six Roles of Documents in Professionals' Work. In Proceedings of the Sixth European Conference on Computer Supported Cooperative Work (Copenghagen, Denmark). Kluwer Academic Publishers, USA, 41--60. https://doi.org/10.1007/978-94-011-4441-4_3
[68]
Michael Hind, Stephanie Houde, Jacquelyn Martino, Aleksandra Mojsilovic, David Piorkowski, John Richards, and Kush R. Varshney. 2020. Experiences with Improving the Transparency of AI Models and Services. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA '20). Association for Computing Machinery, New York, NY, USA, 1--8. https://doi.org/10.1145/3334480.3383051
[69]
Michał R. Hoffman, Luis-Daniel Ibáñez, Huw Fryer, and Elena Simperl. 2018. Smart Papers: Dynamic Publications on the Blockchain. In The Semantic Web, Aldo Gangemi, Roberto Navigli, Maria-Esther Vidal, Pascal Hitzler, Raphaël Troncy, Laura Hollink, Anna Tordai, and Mehwish Alam (Eds.). Springer International Publishing, Cham, 304--318. https://doi.org/10.1007/978-3-319-93417-4_20
[70]
Sarah Holland, Ahmed Hosny, Sarah Newman, Joshua Joseph, and Kasia Chmielinski. 2018. The Dataset Nutrition Label: A Framework To Drive Higher Data Quality Standards. arXiv:1805.03677
[71]
Michael Hollaway, Graham Dean, Gordon Blair, Mike Brown, Pete Henrys, and John Watkins. 2020. Tackling the Challenges of 21st Open Science and Beyond: A Data Science Lab Approach. Patterns (2020). https://doi.org/10.1016/j.patter.2020.100103
[72]
Jennifer M. Holzer, Cristian Mihai Adamescu, Constantin Cazacu, Ricardo Díaz-Delgado, Jan Dick, Pablo F. Méndez, Luis Santamaría, and Daniel E. Orenstein. 2019. Evaluating transdisciplinary science to open research-implementation spaces in European social-ecological systems. Biological Conservation 238 (2019), 108228. https://doi.org/10.1016/j.biocon.2019.108228
[73]
Ian Hutchby. 2001. Technologies, Texts and Affordances. Sociology 35, 2 (2001), 441--456. https://doi.org/10.1177/S0038038501000219
[74]
Anna Sigridur Islind, Ulrika Lundh Snis, Tomas Lindroth, Johan Lundin, Katerina Cerna, and Gunnar Steineck. 2019. The Virtual Clinic: Two-Sided Affordances in Consultation Practice. Comput. Supported Coop. Work 28, 3-4 (June 2019), 435--468. https://doi.org/10.1007/s10606-019-09350-3
[75]
Corey Jackson, Kevin Crowston, Carsten Østerlund, and Mahboobeh Harandi. 2018. Folksonomies to Support Coordination and Coordination of Folksonomies. Comput. Supported Coop. Work 27, 3-6 (Dec. 2018), 647--678. https://doi.org/10.1007/s10606-018-9327-z
[76]
Udo Kannengiesser and John S Gero. 2012. A Process Framework of Affordances in Design. Design Issues 28, 1 (2012), 50--62. https://doi.org/10.1162/DESI_a_00123
[77]
Victor Kaptelinin and Bonnie Nardi. 2012. Affordances in HCI: Toward a Mediated Action Perspective. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI '12). Association for Computing Machinery, New York, NY, USA, 967--976. https://doi.org/10.1145/2207676.2208541
[78]
Jakko Kemper and Daan Kolkman. 2019. Transparent to whom? No algorithmic accountability without a critical audience. Information, Communication & Society 22, 14 (2019), 2081--2096. https://doi.org/10.1080/1369118X.2018.1477967
[79]
Kimia Kiani, George Cui, Andrea Bunt, Joanna McGrenere, and Parmit K. Chilana. 2019. Beyond "One-Size-Fits-All": Understanding the Diversity in How Software Newcomers Discover and Make Use of Help Resources. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3290605.3300570
[80]
Iacovos Kirlappos, Martina Angela Sasse, and Nigel Harvey. 2012. Why Trust Seals Don't Work: A Study of User Perceptions and Behavior. In Trust and Trustworthy Computing - 5th International Conference, TRUST 2012, Vienna, Austria, June 13-15, 2012. Proceedings (Lecture Notes in Computer Science, Vol. 7344), Stefan Katzenbeisser, Edgar R. Weippl, L. Jean Camp, Melanie Volkamer, Mike K. Reiter, and Xinwen Zhang (Eds.). Springer, 308--324. https://doi.org/10.1007/978-3-642-30921-2_18
[81]
Bran Knowles. 2016. Emerging Trust Implications of Data-Rich Systems. IEEE Pervasive Computing 15, 4 (Oct. 2016), 76--84. https://doi.org/10.1109/MPRV.2016.68
[82]
Bran Knowles, Mike Harding, Lynne Blair, Nigel Davies, James Hannon, Mark Rouncefield, and John Walden. 2014. Trustworthy by Design. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work Social Computing (Baltimore, Maryland, USA) (CSCW '14). Association for Computing Machinery, New York, NY, USA, 1060--1071. https://doi.org/10.1145/2531602.2531699
[83]
Bran Knowles and John T. Richards. 2021. The Sanction of Authority: Promoting Public Trust in AI. In Proceedings of the Conference on Fairness, Accountability, and Transparency (FAccT '21). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3442188.3445890
[84]
Bran Knowles, Mark Rouncefield, Mike Harding, Nigel Davies, Lynne Blair, James Hannon, John Walden, and DingWang.2015. Models and Patterns of Trust. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work Social Computing (Vancouver, BC, Canada) (CSCW '15). Association for Computing Machinery, New York, NY, USA, 328--338. https://doi.org/10.1145/2675133.2675154
[85]
Guiou Kobayashi, Mariana Claudia Broens, Maria Eunice Quilici Gonzalez, and Jose Artur Quilici-Gonzalez. 2015. The internet of things and its impact on social relationships involving mutual trust. In 2015 IEEE International Symposium on Technology and Society (ISTAS). 1--6. https://doi.org/10.1109/ISTAS.2015.7439416
[86]
Károly Zoltán Kovács, Drew Hemment, Mel Woods, Naomi K. van der Velden, Angelika Xaver, Rianne H. Gi Esen, Victoria J. Burton, Natalie L. Garrett, Luca Zappa, Deborah Long, Endre Dobos, and Rastislav Skalsky. 2019. Citizen observatory based soil moisture monitoring - The GROW example. Hungarian Geographical Bulletin 68, 2 (1 Jan. 2019), 119--139. https://doi.org/10.15201/hungeobull.68.2.2
[87]
Frens Kroeger. 2017. FACEWORK: creating trust in systems, institutions, and organisations. Cambridge Journal of Economics 41, 2 (1 3 2017), 487--514. https://doi.org/10.1093/cje/bew038
[88]
Frens Kroeger. 2019. Unlocking the treasure trove: How can Luhmann's theory of trust enrich trust research? Journal of Trust Research 9, 1 (2019), 110--124. https://doi.org/10.1080/21515581.2018.1552592
[89]
Anna Krzywoszynska. 2019. Making knowledge and meaning in communities of practice: What role may science play? The case of sustainable soil management in England. Soil Use and Management 35, 1 (2019), 160--168. https://doi.org/10.1111/sum.12487
[90]
Dong Joon Lee and Besiki Stvilia. 2017. Practices of research data curation in institutional repositories: A qualitative view from repository staff. PLOS ONE 12, 3 (03 2017), 1--44. https://doi.org/10.1371/journal.pone.0173987
[91]
John D. Lee and Katrina A. See. 2004. Trust in Automation: Designing for Appropriate Reliance. Human Factors 46, 1 (2004), 50--80. https://doi.org/10.1518/hfes.46.1.50_30392
[92]
Min Kyung Lee. 2018. Understanding perception of algorithmic decisions: Fairness, trust, and emotion in response to algorithmic management. Big Data & Society 5, 1 (2018), 2053951718756684. https://doi.org/10.1177/2053951718756684
[93]
Paul M. Leonardi. 2011. When Flexible Routines Meet Flexible Technologies: Affordance, Constraint, and the Imbrication of Human and Material Agencies. MIS Quarterly 35, 1 (2011), 147--167. http://www.jstor.org/stable/23043493
[94]
J. David Lewis and Andrew Weigert. 1985. Trust as a Social Reality. Social Forces 63, 4 (06 1985), 967--985. https://doi.org/10.1093/sf/63.4.967
[95]
Brian Y. Lim and Anind K. Dey. 2013. Evaluating Intelligibility Usage and Usefulness in a Context-Aware Application. In Human-Computer Interaction. Towards Intelligent and Implicit Interaction - 15th International Conference, HCI International 2013, Las Vegas, NV, USA, July 21-26, 2013, Proceedings, Part V (Lecture Notes in Computer Science, Vol. 8008), Masaaki Kurosu (Ed.). Springer, 92--101. https://doi.org/10.1007/978-3-642-39342-6_11
[96]
Philip Lord, Alison Macdonald, Liz Lyon, and David Giaretta. 2004. From Data Deluge to Data Curation. In Proceedings of the UK E-Science All Hands Meeting. 371--375.
[97]
Chloe Lucas, Peat Leith, and Aidan Davison. 2015. How climate change research undermines trust in everyday life: a review. WIREs Climate Change 6, 1 (2015), 79--91. https://doi.org/10.1002/wcc.320
[98]
Niklas Luhmann. 2017. Trust and Power. Polity Press, Cambridge.
[99]
Tatiana Lukoianova and Victoria Rubin. 2014. Veracity Roadmap: Is Big Data Objective, Truthful and Credible? Advances in Classification Research Online 24, 1 (2014), 4--15. https://doi.org/10.7152/acro.v24i1.14671
[100]
John Lyle and Andrew Martin. 2010. Trusted Computing and Provenance: Better Together. In Proceedings of the 2nd Conference on Theory and Practice of Provenance (San Jose, California) (TAPP'10). USENIX Association, USA. http://www.cs.ox.ac.uk/files/5278/tapp10-cameraready.pdf
[101]
Stuart Macdonald and Luis Martinez-Uribe. 2010. Collaboration to Data Curation: Harnessing Institutional Expertise. New Review of Academic Librarianship 16, sup1 (2010), 4--16. https://doi.org/10.1080/13614533.2010.505823
[102]
Stephen Marsh, Tosan Atele-Williams, Anirban Basu, Natasha Dwyer, Peter R. Lewis, Hector Miller-Bakewell, and Jeremy Pitt. 2020. Thinking about Trust: People, Process, and Place. Patterns 1, 3 (2020). https://doi.org/10.1016/j.patter.2020.100039
[103]
Katherine Mattor, Michele Betsill, Ch'aska Huayhuaca, Heidi Huber-Stearns, Theresa Jedd, Faith Sternlieb, Patrick Bixler, Matthew Luizza, and Antony Cheng. 2014. Transdisciplinary research on environmental governance: A view from the inside. Environmental Science Policy 42 (10 2014), 90--100. https://doi.org/10.1016/j.envsci.2014.06.002
[104]
Roger C. Mayer, James H. Davis, and F. David Schoorman.1995. An Integrative Model of Organizational Trust. The Academy of Management Review 20, 3 (1995), 709--734. http://www.jstor.org/stable/258792
[105]
Ramia Mazé and Johan Redström. 2005. Form and the computational object. Digital Creativity 16, 1 (2005), 7--18. https://doi.org/10.1080/14626260500147736
[106]
Joanna McGrenere and Wayne Ho. 2000. Affordances: Clarifying and Evolving a Concept. In Proceedings of the Graphics Interface 2000 Conference, May 15-17, 2000, Montréal, Québec, Canada. 179--186. https://doi.org/10.20380/GI2000.24
[107]
D. Harrison McKnight, Vivek Choudhury, and Charles Kacmar. 2002. Developing and Validating Trust Measures for e-Commerce: An Integrative Typology. Information Systems Research 13, 3 (2002), 334--359. https://doi.org/10.1287/isre.13.3.334.81
[108]
Carsten Meyer, Patrick Weigelt, and Holger Kreft. 2016. Multidimensional biases, gaps and uncertainties in global plant occurrence information. Ecology Letters 19, 8 (2016), 992--1006. https://doi.org/10.1111/ele.12624
[109]
Margaret Mitchell, Simone Wu, Andrew Zaldivar, Parker Barnes, Lucy Vasserman, Ben Hutchinson, Elena Spitzer, Inioluwa Deborah Raji, and Timnit Gebru. 2019. Model Cards for Model Reporting. In Proceedings of the Conference on Fairness, Accountability, and Transparency (Atlanta, GA, USA) (FAT* 19). Association for Computing Machinery, New York, NY, USA, 220--229. https://doi.org/10.1145/3287560.3287596
[110]
Brent Mittelstadt, Chris Russell, and Sandra Wachter. 2019. Explaining Explanations in AI. In Proceedings of the Conference on Fairness, Accountability, and Transparency (Atlanta, GA, USA) (FAT* '19). Association for Computing Machinery, New York, NY, USA, 279--288. https://doi.org/10.1145/3287560.3287574
[111]
Guido Möllering. 2001. The Nature of Trust: From Georg Simmel to a Theory of Expectation, Interpretation and Suspension. Sociology 35, 2 (2001), 403--420. https://doi.org/10.1177/S0038038501000190
[112]
Donald A. Norman. 1999. Affordance, Conventions, and Design. Interactions 6, 3 (1999), 38--43. https://doi.org/10.1145/301153.301168
[113]
Donald A Norman. 2002. The Design of Everyday Things. Basic Books, New York.
[114]
Vatsala Nundloll, Barry Porter, Gordon Blair, Bridget Emmett, Davey Jones, Dave Chadwick, Ben Winterbourn, Philip Beattie, Graham Dean, Rory Shaw, Wayne Shelley, Mike Brown, and Izhar Ullah. 2019. The Design and Deployment of an End-To-End IoT Infrastructure for the Natural Environment. Future Internet 11, 6 (2019). https://doi.org/10.3390/fi11060129
[115]
Kieron O'Hara. 2019. Data Trusts: Ethics, Architecture and Governance for Trustworthy Data Stewardship. Project Report 10.5258/SOTON/WSI-WP001. https://doi.org/
[116]
Martin Oliver. 2005. The Problem with Affordance. E-Learning and Digital Media 2, 4 (2005), 402--413. https://doi.org/10.2304/elea.2005.2.4.402
[117]
Onora O'Neill. 2002. A Question of Trust: The BBC Reith Lectures. Cambridge University Press, Cambridge.
[118]
Onora O'Neill. 2018. Linking Trust to Trustworthiness. International Journal of Philosophical Studies 26, 2 (2018), 293--300. https://doi.org/10.1080/09672559.2018.1454637
[119]
Naomi Oreskes. 2019. Why Trust Science? Princeton University Press, Princeton, NJ. https://doi.org/10.2307/j.ctvfjczxx
[120]
Wanda J. Orlikowski. 2000. Using Technology and Constituting Structures: A Practice Lens for Studying Technology in Organizations. Organization Science 11, 4 (2000), 404--428. https://doi.org/10.1287/orsc.11.4.404.14600
[121]
Samir Passi and Steven J. Jackson. 2018. Trust in Data Science: Collaboration, Translation, and Accountability in Corporate Data Science Projects. Proc. ACM Hum.-Comput. Interact. 2, CSCW (2018). https://doi.org/10.1145/3274405
[122]
Oliver Pescott, Thomas Humphrey, and Kevin Walker. 2018. A short guide to using British and Irish plant occurrence data for research. (07 2018). https://doi.org/10.13140/RG.2.2.33746.86720
[123]
Wolter Pieters. 2011. Explanation and Trust: What to Tell the User in Security and AI? Ethics and Inf. Technol. 13, 1 (March 2011), 53--64. https://doi.org/10.1007/s10676-010-9253-3
[124]
Theodore M. Porter. 1995. Trust in numbers the pursuit of objectivity in science and public life. Princeton University Press, Princeton, NJ.
[125]
Forough Poursabzi-Sangdeh, Daniel G. Goldstein, Jake M. Hofman, Jennifer Wortman Vaughan, and Hanna M. Wallach. 2018. Manipulating and Measuring Model Interpretability. (2018). arXiv:1802.07810
[126]
Emilee Rader, Kelley Cotter, and Janghee Cho. 2018. Explanations as Mechanisms for Supporting Algorithmic Transparency. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3173574.3173677
[127]
Madhu Reddy, Paul Dourish, and Wanda Pratt. 2001. Coordinating Heterogeneous Work: Information and Representation in Medical Care. European Conference on Computer Supported Cooperative Work (ECSCW'01) (2001), 239--258. https://doi.org/10.1007/0-306-48019-0_13
[128]
Derek Reilly and Bonnie MacKay. 2013. Annotating Ecology: Looking to Biological Fieldwork for Mobile Spatial Annotation Workflows. In Proceedings of the 15th International Conference on Human-Computer Interaction with Mobile Devices and Services (Munich, Germany) (MobileHCI '13). Association for Computing Machinery, New York, NY, USA, 35--44. https://doi.org/10.1145/2493190.2493245
[129]
John Richards, David Piorkowski, Michael Hind, Stephanie Houde, and Aleksandra Mojsilović. 2020. A Methodology for Creating AI FactSheets. arXiv:2006.13796
[130]
Gernot Rieder and Judith Simon. 2016. Datatrust: Or, the political quest for numerical evidence and the epistemologies of Big Data. Big Data & Society 3, 1 (2016), 2053951716649398. https://doi.org/10.1177/2053951716649398
[131]
Jens Riegelsberger, M. Angela Sasse, and John D. McCarthy. 2005. The Mechanics of Trust: A Framework for Research and Design. Int. J. Hum.-Comput. Stud. 62, 3 (March 2005), 381--422. https://doi.org/10.1016/j.ijhcs.2005.01.001
[132]
Jeremy Rose and Rens Scheepers. 2001. Structuration Theory and Information System Development - Frameworks for Practice. In 9th European Conference on Information Systems (ECIS 2001). Association for Information Systems, 217--231. https://aisel.aisnet.org/ecis2001/80
[133]
Denise M. Rousseau, Sim B. Sitkin, Ronald S. Burt, and Colin Camerer. 1998. Not So Different After All: A Cross-Discipline View Of Trust. Academy of Management Review 23, 3 (1998), 393--404. https://doi.org/10.5465/amr.1998.926617
[134]
Johannes Sänger, Christian Richthammer, Sabri Hassan, and Günther Pernul. 2014. Trust and Big Data: A Roadmap for Research. In Proceedings of the 2014 International Semiconductor Laser Conference (ISLC '14). IEEE Computer Society, USA, 278--282. https://doi.org/10.1109/DEXA.2014.63
[135]
Andrew Schrock. 2015. Communicative Affordances of Mobile Media: Portability, Availability, Locatability, and Multimediality. International Journal of Communication 9 (2015), 1229--1246. https://ijoc.org/index.php/ijoc/article/view/3288
[136]
Anna Sexton, Elizabeth Shepherd, Oliver Duke-Williams, and Alexandra Eveleigh. 2005. A Balance of Trust in the Use of Government Administrative Data. Archival Science 17, 4 (2005), 305 - 330. https://doi.org/10.1007/s10502-017-9281-4
[137]
Donghee Shin, Bu Zhong, and Frank A. Biocca. 2020. Beyond user experience: What constitutes algorithmic experiences? International Journal of Information Management 52 (2020). https://doi.org/10.1016/j.ijinfomgt.2019.102061
[138]
Clarisse Sieckenius de Souza, Raquel Oliveira Prates, and Tom Carey. 2000. Missing and declining affordances: are these appropriate concepts? Journal of the Brazilian Computer Society 7 (00 2000), 26 - 34. http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0104-65002000000200004&nrm=iso
[139]
Raphael Spiekermann, Ben Jolly, Alexander Herzig, Tom Burleigh, and David Medyckyj-Scott. 2019. Implementations of fine-grained automated data provenance to support transparent environmental modelling. Environmental Modelling Software 118 (2019), 134--145. https://doi.org/10.1016/j.envsoft.2019.04.009
[140]
Alex Stevens. 2011. Telling Policy Stories: An Ethnographic Study of the Use of Evidence in Policy-making in the UK. Journal of Social Policy 40, 2 (2011), 237--255. https://doi.org/10.1017/S0047279410000723
[141]
Lauren Thornton, Victoria Neumann, Gordon Blair, Nigel Davies, and John Watkins.2019. Trusted Brokers?: Identifying the Challenges Facing Data Centres. Data for Policy. https://doi.org/10.5281/zenodo.2798468
[142]
Ehsan Toreini, Mhairi Aitken, Kovila Coopamootoo, Karen Elliott, Carlos Gonzalez Zelaya, and Aad van Moorsel. 2020. The Relationship between Trust in AI and Trustworthy Machine Learning Technologies. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (Barcelona, Spain) (FAT* '20). Association for Computing Machinery, New York, NY, USA, 272--283. https://doi.org/10.1145/3351095.3372834
[143]
Gerard Torenvliet. 2003. We can't afford it!: the devaluation of a usability term. Interactions 10, 4 (2003), 12--17. https://doi.org/10.1145/838830.838857
[144]
Ross Towe, Graham Dean, Liz Edwards, Vatsala Nundloll, Gordon Blair, Rob Lamb, Barry Hankin, and Susan Manson. 2020. Rethinking data-driven decision support in flood risk management for a big data age. Journal of Flood Risk Management (2020). https://doi.org/10.1111/jfr3.12652
[145]
Dhaval Vyas, Cristina M. Chisalita, and Alan Dix. 2017. Organizational Affordances: A Structuration Theory Approach to Affordances. Interacting with Computers 29, 2 (2017), 117--131. https://doi.org/10.1093/iwc/iww008
[146]
Dhaval Vyas, Cristina M. Chisalita, and Gerrit C. van der Veer. 2006. Affordance in Interaction. In Proceedings of the 13th Eurpoean Conference on Cognitive Ergonomics: Trust and Control in Complex Socio-Technical Systems (Zurich, Switzer land) (ECCE '06). Association for Computing Machinery, New York, NY, USA, 92--99. https://doi.org/10.1145/1274892.1274907
[147]
Dhaval Vyas and Gerrit C. van der Veer. 2006. Experience as Meaning: Some Underlying Concepts and Implications for Design. In Proceedings of the 13th Eurpoean Conference on Cognitive Ergonomics: Trust and Control in Complex Socio-Technical Systems (Zurich, Switzerland) (ECCE '06). Association for Computing Machinery, New York, NY, USA, 81--91. https://doi.org/10.1145/1274892.1274906
[148]
Jillian Wallis, Christine Borgman, Matthew Mayernik, Alberto Pepe, R. Anitha Nithya, and Mark Hansen. 2007. Know Thy Sensor: Trust, Data Quality, and Data Integrity in Scientific Digital Libraries, Vol. 4675. 380--391. https://doi.org/10.1007/978-3-540-74851-9_32
[149]
Danding Wang, Qian Yang, Ashraf Abdul, and Brian Y. Lim. 2019. Designing Theory-Driven User-Centric Explainable AI. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland UK) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--15. https://doi.org/10.1145/3290605.3300831
[150]
Nicholas M. Weber, Carole L. Palmer, and Tiffany C. Chao. 2012. Current Trends and Future Directions in Data Curation Research and Education. Journal of Web Librarianship 6, 4 (2012), 305--320. https://doi.org/10.1080/19322909.2012.730358
[151]
MarankeWieringa.2020.WhattoAccountforWhenAccountingforAlgorithms: A Systematic Literature Review on Algorithmic Accountability. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (Barcelona, Spain) (FAT* '20). Association for Computing Machinery, New York, NY, USA, 1--18. https://doi.org/10.1145/3351095.3372833
[152]
Mark Wilkinson, Eleanor Mackay, Paul F. Quinn, Marc Stutter, Keith Beven, Christopher J.A. Macleod, M. G. Macklin, Yehia Elkhatib, Barbara J. Percy, Claudia Vitolo, and Philip Haygarth. 2015. A cloud based tool for knowledge exchange on local scale flood risk. Journal of Environmental Management 161 (2015), 38--50. https://doi.org/10.1016/j.jenvman.2015.06.009
[153]
Emily Winter, Maria Angela Ferrario, and Gordon Blair. 2020. Agility in Transdisciplinary Research: Lessons Learnt from a Research Sprint on Digital Technologies and Flood Risk Management. International Conferences of ICT for Sustainability (ICT4S) (2020). https://eprints.lancs.ac.uk/id/eprint/144673/1/ICT4S_FINAL_21_MAY.pdf
[154]
Ming Yin, Jennifer Wortman Vaughan, and Hanna Wallach. 2019. Understanding the Effect of Accuracy on Trust in Machine Learning Models. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--12. https://doi.org/10.1145/3290605.3300509
[155]
Meg Young, Luke Rodriguez, Emily Keller, Feiyang Sun, Boyang Sa, Jan Whittington, and Bill Howe. 2019. Beyond Open vs. Closed: Balancing Individual Privacy and Public Accountability in Data Sharing. In Proceedings of the Conference on Fairness, Accountability, and Transparency (Atlanta, GA, USA) (FAT* '19). Association for Computing Machinery, New York, NY, USA, 191--200. https://doi.org/10.1145/3287560.3287577
[156]
Jun Zhao, Oscar Corcho, Paolo Missier, Khalid Belhajjame, David Newmann, David de Roure, and Carole A. Goble. 2011. eScience. Springer Berlin Heidelberg, Berlin, Heidelberg, 701--736. https://doi.org/10.1007/978-3-540-92913-0_17
[157]
Jun Zhao, Jose Manuel Gomez-Perez, Khalid Belhajjame, Graham Klyne, Esteban Garcia-Cuesta, Aleix Garrido, Kristina Hettne, Marco Roos, David De Roure, and Carole A. Goble. 2012. Why workflows break --- Understanding and combating decay in Taverna workflows. In 2012 IEEE 8th International Conference on E-Science. 1--9. https://doi.org/10.1109/eScience.2012.6404482
[158]
Anneke Zuiderwijk. 2017. Analysing Open Data in Virtual Research Environments: New Collaboration Opportunities to Improve Policy Making. Int. J. Electron. Gov. Res.13, 4(Oct.2017), 76--92. https://doi.org/10.4018/IJEGR.2017100105

Cited By

View all
  • (2024)*READ**THIS*!! Spam as a threat for open scienceNew Media & Society10.1177/14614448241248655Online publication date: 12-May-2024
  • (2023)Towards transparent and trustworthy prediction of student learning achievement by including instructors as co-designers: a case studyEducation and Information Technologies10.1007/s10639-023-11954-829:3(3075-3096)Online publication date: 17-Jun-2023
  • (2022)Designing Trustworthy User Interfaces for the Voluntary Carbon Market: A Randomized Online ExperimentProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533462(71-84)Online publication date: 13-Jun-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
FAccT '21: Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency
March 2021
899 pages
ISBN:9781450383097
DOI:10.1145/3442188
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 March 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Affordances
  2. Environmental Data Science
  3. Trust
  4. Virtual Research Environments

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

  • EPSRC

Conference

FAccT '21
Sponsor:

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)53
  • Downloads (Last 6 weeks)6
Reflects downloads up to 01 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)*READ**THIS*!! Spam as a threat for open scienceNew Media & Society10.1177/14614448241248655Online publication date: 12-May-2024
  • (2023)Towards transparent and trustworthy prediction of student learning achievement by including instructors as co-designers: a case studyEducation and Information Technologies10.1007/s10639-023-11954-829:3(3075-3096)Online publication date: 17-Jun-2023
  • (2022)Designing Trustworthy User Interfaces for the Voluntary Carbon Market: A Randomized Online ExperimentProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533462(71-84)Online publication date: 13-Jun-2022
  • (2022)Understanding and Being Understood: User Strategies for Identifying and Recovering From Mistranslations in Machine Translation-Mediated ChatProceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency10.1145/3531146.3534638(2223-2238)Online publication date: 21-Jun-2022
  • (2022)The Alchemy of Trust: The Creative Act of Designing Trustworthy Socio-Technical SystemsProceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency10.1145/3531146.3533196(1387-1398)Online publication date: 21-Jun-2022
  • (2022)Designing for Responsible Trust in AI Systems: A Communication PerspectiveProceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency10.1145/3531146.3533182(1257-1268)Online publication date: 21-Jun-2022
  • (2022)Exploring Perceptions of Cross-Sectoral Data Sharing with People with Parkinson’sProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501984(1-14)Online publication date: 29-Apr-2022
  • (2022)Accountable AI for Healthcare IoT Systems2022 IEEE 4th International Conference on Trust, Privacy and Security in Intelligent Systems, and Applications (TPS-ISA)10.1109/TPS-ISA56441.2022.00013(20-28)Online publication date: Dec-2022
  • (2022)Providing assurance and scrutability on shared data and machine learning models with verifiable credentialsConcurrency and Computation: Practice and Experience10.1002/cpe.699735:18Online publication date: 5-Apr-2022

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media