Cited By
View all- Zheng ZNing KZhong QChen JChen WGuo LWang WWang Y(2025)Towards an understanding of large language models in software engineering tasksEmpirical Software Engineering10.1007/s10664-024-10602-030:2Online publication date: 1-Mar-2025
Applying Human Values Theory to Software Engineering Practice: Lessons and Implications
Pages 973 - 990
Abstract
The study of human values in software engineering (SE) is increasingly recognised as a fundamental human-centric issue of SE decision making. However, values studies in SE still face a number of issues, including the difficulty of eliciting values in a systematic and structured way, the challenges of measuring and tracking values over time, and the lack of practice-based understanding of values among software practitioners. This paper aims to help address these issues by: 1) outlining a research framework that supports a systematic approach to values elicitation, analysis, and understanding; 2) introducing tools and techniques that help elicit and measure values during SE decision making processes in a systematic way; and 3) applying such tools to a month-long research sprint co-designed with an industry partner and conducted with 27 software practitioners. The case study builds on lessons from an earlier pilot (12 participants) and combines in-situ observations with the use of two values-informed tools: the Values Q-Sort (V-QS), and the Values-Retro. The V-QS adapts instruments from values research to the SE context, the Values-Retro adapts existing SE techniques to values theory. We distil implications for research and practice in ten lessons learned.
References
[1]
J. Grundy, H. Khalajzadeh, and J. Mcintosh, “Towards human-centric model-driven software engineering,” Proc. 15th Int. Conf. Eval. Novel Approaches Softw. Eng., 2020, pp. 229–238.
[2]
J. Whittle, M. A. Ferrario, W. Simm, and W. Hussain, “A case for human values in software engineering,” IEEE Softw., vol. 38, no. 3, pp. 106–113, Jan.-Feb. 2021.
[3]
J. Grundy, “Human-centric software engineering for next generation cloud-and edge-based smart living applications,” in Proc. 20th IEEE/ACM Int. Symp. Cluster, Cloud Internet Comput., 2020, pp. 1–10.
[4]
J. Whittle, “Human values in software: A new paradigm for requirements engineering?,” in Proc. IEEE 27th Int. Requirements Eng. Conf., 2019, pp. 4–4.
[5]
K. Czarnecki, “Requirements engineering in the age of societal-scale cyber-physical systems: The case of automated driving,” in Proc. IEEE 26th Int. Requirements Eng. Conf., 2018, pp. 3–4.
[6]
M. A. Ferrario, W. Simm, S. Forshaw, A. Gradinar, M. T. Smith, and I. Smith, “Values-first se: Research principles in practice,” in Proc. IEEE/ACM 38th Int. Conf. Softw. Eng. Companion, 2016, pp. 553–562.
[7]
K. Shilton, J. A. Koepfler, and K. R. Fleischmann, “How to see values in social computing: Methods for studying values dimensions,” in Proc. 17th ACM Conf. Comput. Supported Cooperative Work Soc. Comput., 2014, pp. 426–435.
[8]
K. W. Miller and D. K. Larson, “Agile software development: Human values and culture,” IEEE Technol. Soc. Mag., vol. 24, no. 4, pp. 36–42, 2005.
[9]
W. Hussainet al., “Human values in software engineering: Contrasting case studies of practice,” IEEE Trans. Softw. Eng., to be published.
[10]
E. Winter, S. Forshaw, and M. A. Ferrario, “Measuring human values in software engineering,” in Proc. 12th ACM/IEEE Int. Symp. Empir. Softw. Eng. Meas., 2018, pp. 1–4.
[11]
E. Winter, S. Forshaw, L. Hunt, and M. A. Ferrario, “Towards a systematic study of values in SE: Tools for industry and education,” in Proc. 2019 IEEE/ACM 41st Int. Conf. Softw. Eng.: New Ideas Emerg. Results, 2019, pp. 61–64.
[12]
E. Winter, S. Forshaw, L. Hunt, and M. A. Ferrario, “Advancing the study of human values in software engineering,” in Proc. IEEE/ACM 12th Int. Workshop Cooperative Hum. Aspects Softw. Eng., 2019, pp. 19–26.
[13]
G. R. Maio, “Mental representations of social values,” Adv. Exp. Soc. Psychol., vol. 42, pp. 1–43, 2010.
[14]
S. H. Schwartz, “Universals in the content and structure of values: Theoretical advances and empirical tests in 20 countries,” Adv. Exp. Soc. Psychol., vol. 25, pp. 1–65, 1992.
[15]
P. H. Hanel, L. F. Litzellachner, and G. R. Maio, “An empirical comparison of human value models,” Front. Psychol., vol. 9, 2018, Art. no.
[16]
D. Gotterbarn, “Software engineering ethics,” Encyclopedia of Software Engineering. Hoboken, NJ, USA: John Wiley & Sons, Ltd, 2002.
[17]
J. Van den Hoven, G.-J. Lokhorst, and I. Van de Poel, “Engineering and the problem of moral overload,” Sci. Eng. Ethics, vol. 18, no. 1, pp. 143–155, 2012.
[18]
J. Van den Hoven, “Human capabilities and technology,” in The Capability Approach Technology and Design, Berlin, Germany: Springer, 2012, pp. 27–36.
[19]
B. Friedman, “Value-sensitive design,” Interactions, vol. 3, no. 6, pp. 16–23, 1996.
[20]
B. Friedman, D. G. Hendry, and A. Borning, “A survey of value sensitive design methods,” Found. Trends Hum.- Comput. Interact., vol. 11, no. 2, pp. 63–125, 2017.
[21]
B. Friedman and D. G. Hendry, Value Sensitive Design: Shaping Technology With Moral Imagination, Cambridge, MA, USA: MIT Press, 2019.
[22]
C. A. Le Dantec, E. S. Poole, and S. P. Wyche, “Values as lived experience: Evolving value sensitive design in support of value discovery,” in Proc. SIGCHI Conf. Hum. Factors Comput. Syst., 2009, pp. 1141–1150.
[23]
B. Knowles, L. Blair, S. Walker, P. Coulton, L. Thomas, and L. Mullagh, “Patterns of persuasion for sustainability,” in Proc. Conf. Designing Interactive Syst., 2014, pp. 1035–1044.
[24]
J. Whittle, “Is your software valueless?,” IEEE Softw., vol. 36, no. 3, pp. 112–115, May./Jun. 2019.
[25]
M. Harbers, C. Detweiler, and M. A. Neerincx, “Embedding stakeholder values in the requirements engineering process,” in Proc. Int. Work. Conf. Requirements Eng.: Found. Softw. Qual., 2015, pp. 318–332.
[26]
D. Mougouei, H. Perera, W. Hussain, R. Shams, and J. Whittle, “Operationalizing human values in software: A research roadmap,” in Proc. 26th ACM Joint Meeting Eur. Softw. Eng. Conf. Symp. Found. Softw. Eng., 2018, pp. 780–784.
[27]
S. Thew and A. Sutcliffe, “Investigating the role of ‘soft issues’ in the re process,” in Proc. 16th IEEE Int. Requirements Eng. Conf., 2008, pp. 63–66.
[28]
S. Thew and A. Sutcliffe, “Value-based requirements engineering: Method and experience,” Requirements Eng., vol. 23, no. 4, pp. 443–464, 2018.
[29]
H. Pereraet al., “A study on the prevalence of human values in software engineering publications,” in Proc. ACM/IEEE 42nd Int. Conf. Softw. Eng., 2020, pp. 409–420.
[30]
A. Sutcliffe, P. Sawyer, W. Liu, and N. Bencomo, “Investigating the potential impact of values on requirements and software engineering,” 2021,.
[31]
S. Galhotra, Y. Brun, and A. Meliou, “Fairness testing: Testing software for discrimination,” in Proc. 11th Joint Meeting Found. Softw. Eng., 2017, pp. 498–510.
[32]
S. Russell, D. Dewey, and M. Tegmark, “Research priorities for robust and beneficial artificial intelligence,” Ai Mag., vol. 36, no. 4, pp. 105–114, 2015.
[33]
S. H. Schwartzet al., “Refining the theory of basic individual values.” J. Pers. Soc. Psychol., vol. 103, no. 4, 2012, Art. no.
[34]
A.-S. Cheng and K. R. Fleischmann, “Developing a meta-inventory of human values,” Proc. Amer. Soc. Inf. Sci. Technol., vol. 47, no. 1, pp. 1–10, 2010.
[35]
S. H. Schwartz, “An overview of the schwartz theory of basic values,” Online Readings Psychol. Culture, vol. 2, no. 1, pp. 2307–919, 2012.
[36]
S. H. Koch, R. Proynova, B. Paech, and T. Wetter, “How to approximate users’ values while preserving privacy: Experiences with using attitudes towards work tasks as proxies for personal value elicitation,” Ethics Inf. Technol., vol. 15, no. 1, pp. 45–61, 2013.
[37]
T. Partala and S. Kujala, “Exploring the role of ten universal values in using products and services,” Interacting Comput., vol. 28, no. 3, pp. 311–331, 2016.
[38]
P. G. Kirchschlaeger, Digital Transformation and Ethics, Baden-Baden, Germany: Nomos Verlagsgesellschaft mbH & Co KG, 2021.
[39]
S. Easterbrook, J. Singer, M.-A. Storey, and D. Damian, “Selecting empirical methods for SE research” in Guide to Advanced Empirical Software Engineering, Berlin, Germany: Springer, 2008, pp. 285–311.
[40]
A. S. Lee, “A scientific methodology for MIS case studies,” MIS Quart., vol. 13, no. 1, pp. 33–50, 1989.
[41]
P. Runeson and M. Höst, “Guidelines for conducting and reporting case study research in software engineering,” Empir. Softw. Eng., vol. 14, no. 2, 2009, Art. no.
[42]
R. K. Yin, Case Study Research and Applications: Design and Methods, Newbury Park, CA, USA: Sage Pub., 2017.
[43]
C. Pierce, Philosophical Writings of Pierce, J. Buchler ed., New York, NY, USA: Dover, 1955, pp. 5–20.
[44]
S. Watts and P. Stenner, “Doing q methodology: Theory, method and interpretation,” Qualitative Res. Psycohol., vol. 2, no. 1, pp. 67–91, 2005.
[45]
G. Terry, N. Hayfield, V. Clarke, and V. Braun, “Thematic analysis,” in The Sage Handbook of Qualitative Research in Psychology, Newbury Park, CA, USA: SAGE, 2017, pp. 17–37.
[46]
ACM, ACM code of ethics and professional conduct, 2018. [Online]. Available: https://www.acm.org/code-of-ethics
[47]
R. E. Anderson, D. G. Johnson, D. Gotterbarn, and J. Perrolle, “Using the new acm code of ethics in decision making,” Commun. ACM, vol. 36, no. 2, pp. 98–107, 1993.
[48]
G. R. Maio and J. M. Olson, “Values as truisms: Evidence and implications.” J. Pers. Soc. Psychol., vol. 74, no. 2, 1998, Art. no.
[49]
K. S. Rubin, Essential Scrum: A. Practical Guide to the Most Popular Agile Process, Reading, MA, USA: Addison-Wesley, 2012.
[50]
M. A. Ferrario, W. Simm, P. Newman, S. Forshaw, and J. Whittle, “Software engineering for’social good’: Integrating action research, participatory design, and agile development,” in Proc. Companion Proc. 36th Int. Conf. Softw. Eng., 2014, pp. 520–523.
[51]
E. M. Bender, T. Gebru, A. McMillan-Major, and S. Shmitchell, “On the dangers of stochastic parrots: Can language models be too big?,” in Proc. ACM Conf. Fairness, Accountability, Transparency, 2021, pp. 610–623.
[52]
G. R. Maio, V. M. Esses, K. H. Arnold, and J. M. Olson, The Function-Structure Model of Attitudes: Incorporating the Need for Affect, Hove, U.K.: Psychology Press Ltd, 2004.
[53]
D. Hassabiset al., “Asilomar AI principles,” Aug. 2017. [Online]. Available: https://futureoflife.org/2017/08/11/ai-principles/
[54]
P. H. Hanel, K. C. Vione, U. Hahn, and G. R. Maio, “Value instantiations: The missing link between values and behavior?,” in Values and Behavior, Berlin, Germany: Springer, 2017, pp. 175–190.
[55]
P. H. Hanelet al., “Cross-cultural differences and similarities in human value instantiation,” Front. Psychol., vol. 9, 2018, Art. no.
[56]
C. Miller and R. Coldicott, Ken-q analysis, 2019. [Online]. Available: https://www.doteveryone.org.uk/report/workersview/
[57]
J. W. Creswell and J. D. Creswell, Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. Newbury Park, CA, USA: Sage, 2017.
[58]
L. Stark and A. L. Hoffman, “Data is the new what? Popular metaphors & professional ethics in emerging data culture,” J. Cultural Anal., vol. 4, no. 1, pp. 1–22, 2019.
[59]
S. Vakil, “Ethics, identity, and political vision: Toward a justice-centered approach to equity in computer science education,” Harvard Educ. Rev., vol. 88, no. 1, pp. 26–52, 2018.
[60]
M. A. Ferrarioet al., The Denver Manifesto, chi2017, May, 2017, [Online]. Available: http://www.valuesincomputing.org/background/chi2017-values-in-computing-workshop/the-denver-manifesto/
[61]
M. A. Ferrario, W. Simm, J. Whittle, C. Frauenberger, G. Fitzpatrick, and P. Purgathofer, “Values in computing,” in Proc. CHI Conf. Extended Abstr. Hum. Factors Comput. Syst., 2017, pp. 660–667.
[62]
C. Becker, G. Engels, A. Feenberg, M. A. Ferrario, and G. Fitzpatrick, “Values in computing (dagstuhl seminar 19291),” in Dagstuhl Rep., vol. 9, no. 7, pp. 40–77, 2019.
Recommendations
Measuring human values in software engineering
ESEM '18: Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and MeasurementBackground: Human values, such as prestige, social justice, and financial success, influence software production decision-making processes. While their subjectivity makes some values difficult to measure, their impact on software motivates our research. ...
Human Values in Software Engineering: Contrasting Case Studies of Practice
The growing diffusion of software in society and its influence on people demands from its creators that their work carefully considers human values such as transparency, social responsibility, and equality. But how do software practitioners address human ...
Human values in software development artefacts: A case study on issue discussions in three Android applications
Abstract Context:Human values such as inclusion, privacy, and accessibility need to be considered during software development to attract and maintain users. However, little effort has been made to study human values consideration in ...
Comments
Information & Contributors
Information
Published In
This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see https://creativecommons.org/licenses/by/4.0/.
Publisher
IEEE Press
Publication History
Published: 01 March 2023
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 27 Jan 2025
Other Metrics
Citations
Cited By
View all- Zheng ZNing KZhong QChen JChen WGuo LWang WWang Y(2025)Towards an understanding of large language models in software engineering tasksEmpirical Software Engineering10.1007/s10664-024-10602-030:2Online publication date: 1-Mar-2025