Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
Springer Nature Link
Log in

Channeling the Voice of the Crowd: Applying Structured Queries in User Feedback Collection

  • Conference paper
  • First Online:
Requirements Engineering: Foundation for Software Quality (REFSQ 2024)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14588))

  • 861 Accesses

Abstract

[Context/Motivation] Crowd-based Requirements Engineering (CrowdRE) promises to overcome limitations of traditional requirements engineering by actively involving a larger number of users. A common theme in CrowdRE research is the development and deployment of online platforms where users can autonomously provide their feedback about software. [Problems] Current platforms only provide minimal guidance regarding the topics mentioned in the feedback. Therefore, it is difficult to map the feedback to existing requirements and identify gaps. [Principal ideas] To address the problems, we present a systematic process for collecting feedback through a variety of structured questions and an online platform which supports the process. We evaluate the process and the platform in the large-scale interdisciplinary research project SMART-AGE. [Contribution] To our best knowledge, this is the first platform that gathers feedback from a large number of users simultaneously through structured queries. Our contributions include a tailored list of questions for feedback collection, an analysis of how the question characteristics influence the answers and an evaluation of the user acceptance. Our findings indicate that both the quality and quantity of feedback are high, with variations based on the characteristics of the questions. Additionally, our platform is well accepted by its users.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 74.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    The questions of the SUS questionnaire (purpose = Evaluation, app = smartFEEDBACK) can can be found in the repository.

References

  1. Abeti, L., Ciancarini, P., Moretti, R.: Wiki-based requirements management for business process reengineering. ICSE, 14–24 (2009)

    Google Scholar 

  2. Brooke, J.: SUS: a “quick and dirty” usability scale. usability evaluation in industry, 207–212 (2020)

    Google Scholar 

  3. Easterbrook, S., Singer, J., Storey, M.-A., Damian, D.: Selecting empirical methods for software engineering research. In: Shull, F., Singer, J., Sjøberg, D.I.K. (eds.) Guide to Advanced Empirical Software Engineering. pp. 285–311. Springer, London (2008). https://doi.org/10.1007/978-1-84800-044-5_11

  4. Fernandes, J., Duarte, D., Ribeiro, C., Farinha, C., Pereira, J.M., Da Silva, M.M.: IThink: a game-based approach towards improving collaboration and participation in requirement elicitation. Procedia Comput. Sci. 15, 66–77 (2012)

    Article  Google Scholar 

  5. Groen, E.C., et al.: The Crowd In Requirements Engineering: The Landscape And Challenges. IEEE Softw. 34, 44–52 (2017). https://doi.org/10.1109/MS.2017.33

    Article  Google Scholar 

  6. Kifetew, F.M., Perini, A., Susi, A., Siena, A., Muñante, D., Morales-Ramirez, I.: Automating user-feedback driven requirements prioritization. Inf. Softw. Technol. 138, 106635 (2021). https://doi.org/10.1016/j.infsof.2021.106635

    Article  Google Scholar 

  7. Kolpondinos, M.Z., Glinz, M.: GARUSO: a gamification approach for involving stakeholders outside organizational reach in requirements engineering. Requirements Eng. 25, 185–212 (2020)

    Article  Google Scholar 

  8. Kujala, S.: Effective user involvement in product development by improving the analysis of user needs. Behav. Inf. Technol. 27, 457–473 (2008). https://doi.org/10.1080/01449290601111051

    Article  Google Scholar 

  9. Kukreja, N., Boehm, B.: Integrating collaborative requirements negotiation and prioritization processes: a match made in heaven. In: ACM International Conference Proceeding Series, pp. 141–145 (2013)

    Google Scholar 

  10. Lai, H., Peng, R., Sun, D., Liu, J.: A lightweight forum-based distributed requirement elicitation process for open source community. Int. J. Adv. Comput. Technol. 4, 138–145 (2012)

    Google Scholar 

  11. Laporti, V., Borges, M.R.S., Braganholo, V.: Athena: a collaborative approach to requirements elicitation. Comput. Ind. 60, 367–380 (2009)

    Article  Google Scholar 

  12. Lohmann, S., Dietzold, S., Heim, P., Heino, N.: A web platform for social requirements engineering. Lect. Notes Inform. (LNI), P-150, 309–315 (2009)

    Google Scholar 

  13. Menkveld, A., Brinkkemper, S., Dalpiaz, F.: User story writing in crowd requirements engineering: the case of a web application for sports tournament planning, RE 19, 174–179 (2019)

    Google Scholar 

  14. Nuseibeh, B., Easterbrook, S.: Requirements engineering: a roadmap. ICSE 2000(1), 35–46 (2000)

    Google Scholar 

  15. Radeck, L.: Appendix (Repository). https://github.com/lradeck/appendix

  16. Radeck, L., Paech, B.: Integrating implicit feedback into crowd requirements engineering – a research preview. In: REFSQ. ACM (2023)

    Google Scholar 

  17. Radeck, L., et al.: Understanding IT-related well-being, aging and health needs of older adults with crowd-requirements engineering. In: REWBAH, pp. 57–64. IEEE (2022)

    Google Scholar 

  18. Renzel, D., Behrendt, M., Klamma, R., Jarke, M.: Requirements bazaar: social requirements engineering for community-driven innovation. RE 5, 326–327 (2013)

    Google Scholar 

  19. Roque, N.A., Boot, W.R.: A new tool for assessing mobile device proficiency in older adults: the mobile device proficiency questionnaire. J. Appl. Gerontol. 37, 131–156 (2018). https://doi.org/10.1177/0733464816642582

    Article  Google Scholar 

  20. Santos, R., Groen, E.C., Villela, K.: A taxonomy for user feedback classifications. In: CEUR Workshop Proceedings, vol. 2376 (2019)

    Google Scholar 

  21. Sauro, J., Lewis, J.r.: quantifying the user experience (2012)

    Google Scholar 

  22. Sharma, R., Sureka, A.: CRUISE: a platform for crowdsourcing requirements elicitation and evolution. In: ICCC, pp. 1–7 (2018)

    Google Scholar 

  23. Snijders, R., Dalpiaz, F., Brinkkemper, S., Hosseini, M., Ali, R., Özüm, A.: REfine: a gamified platform for participatory requirements engineering. CrowdRE, 1–6 (2015)

    Google Scholar 

  24. Vogel, P., Grotherr, C., Semmann, M.: Leveraging the internal crowd for continuous requirements engineering - lessons learned from a design science research project. In: ECIS 2019 (2020)

    Google Scholar 

  25. Wouters, J., Janssen, R., Van Hulst, B., Van Veenhuizen, J.: CrowdRE in a governmental setting: lessons from two case studies. RE (2021)

    Google Scholar 

  26. Wouters, J., Menkveld, A., Brinkkemper, S., Dalpiaz, F.: Crowd-based requirements elicitation via pull feedback: method and case studies. RE (2022)

    Google Scholar 

  27. Yang, D., Wu, D., Koolmanojwong, S., Brown, A.W., Boehm, B.W.: WikiWinWin: a Wiki based system for collaborative requirements negotiation. In: ICSS, pp. 1–10 (2008)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute for Computer Science, Heidelberg University, 69120, Heidelberg, Germany

    Leon Radeck & Barbara Paech

Authors
  1. Leon Radeck
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Barbara Paech
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Leon Radeck .

Editor information

Editors and Affiliations

  1. Blekinge Institute of Technology, Karlskrona, Sweden

    Daniel Mendez

  2. NOVA University Lisbon, Lisbon, Portugal

    Ana Moreira

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Radeck, L., Paech, B. (2024). Channeling the Voice of the Crowd: Applying Structured Queries in User Feedback Collection. In: Mendez, D., Moreira, A. (eds) Requirements Engineering: Foundation for Software Quality. REFSQ 2024. Lecture Notes in Computer Science, vol 14588. Springer, Cham. https://doi.org/10.1007/978-3-031-57327-9_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-57327-9_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-57326-2

  • Online ISBN: 978-3-031-57327-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation