Abstract
Context: Chatbots emerged in the decade of 60 and are currently a popular type of application that provides the experience of talking to a human-like robot. However, the similarity of their behaviour to a human is also what makes the elicitation and documentation of conversational-related requirements a hard task, due to the subjective nature of conversations. Currently there are no standards or guidelines to register and test subjective requirements, present in human conversations. Methods: We proposed a metamodel for documentation of conversational requirements and conducted the validation through a 2-step questionnaire. We then analysed the feedback received and applied improvements in the model instances. Results: Based on metamodel we propose the conversational integrated map, an artifact that correlates the subjective requirements with their associated KPIs. Validation was conducted through a simulation with 4 practitioners in a 2-step questionnaire. Artifact format choice revealed a preference for mainly textual and table models. Scalability and necessary time to complete were points of divergence between answers. Conclusion: Proposed artifact was well accepted and could provide pre-made models available for edition for ease of use. Future steps of this study include the elaboration of a guide of best practices on chatbot documentation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Amna, A.R., Poels, G.: Systematic literature mapping of user story research. IEEE Access 10, 51723–51746 (2022). https://doi.org/10.1109/ACCESS.2022.3173745
Belen Saglam, R., Nurse, J.R.C., Hodges, D.: Privacy concerns in chatbot interactions: when to trust and when to worry. In: Stephanidis, C., Antona, M., Ntoa, S. (eds.) HCII 2021. CCIS, vol. 1420, pp. 391–399. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-78642-7_53
Börsting, I., Hesenius, M.: Towards a systematic approach for chatbot development in digital work environments. Digit. Supply Chains Hum. Factor 79–94 (2021)
Çalışkan, E.B.: Briefing with artificial intelligence for requirement elicitation: three cases with ChatGPT for exploration of possibilities. Architectus 75(3) (2023)
Cameron, G., et al.: Back to the future: lessons from knowledge engineering methodologies for chatbot design and development. In: British HCI Conference 2018. BCS Learning & Development Ltd. (2018)
Castle-Green, T., Reeves, S., Fischer, J.E., Koleva, B.: Decision trees as sociotechnical objects in chatbot design. In: Torres, M.I., Schlögl, S., Clark, L., Porcheron, M. (eds.) Proceedings of the 2nd Conference on Conversational User Interfaces, CUI 2020, Bilbao, Spain, 22–24 July 2020, pp. 27:1–27:3. ACM (2020). https://doi.org/10.1145/3405755.3406133
Colby, K.M.: Artificial Paranoia: A Computer Simulation of Paranoid Processes. Pergamon Press (1975)
Dragicevic, S., Celar, S., Novak, L.: Use of method for elicitation, documentation, and validation of software user requirements (MEDoV) in agile software development projects. In: Al-Dabass, D., Ameti, V., Skenderi, F., Halili, F. (eds.) Sixth International Conference on Computational Intelligence, Communication Systems and Networks, CICSyN 2014, Tetova, Macedonia, 27–29 May 2014, pp. 65–70. IEEE (2014). https://doi.org/10.1109/CICSYN.2014.27
Dwitama, F., Rusli, A.: User stories collection via interactive chatbot to support requirements gathering. TELKOMNIKA (Telecommun. Comput. Electron. Control) 18(2), 890 (2020). https://doi.org/10.12928/telkomnika.v18i2.14866
Gonçalves, L., Canedo, E.D., Silva, G.: Documentation artifacts for conversation-related requirements specification in chatbots: a systematic review and a meta-model proposal. In: da Silva, L.F., Portugal, R.L.Q. (eds.) Anais do WER24 - Workshop em Engenharia de Requisitos, Buenos Aires, Argentina, 7–9 August 2024. LFS (Universidad de Belgrano, Argentina) (2024)
Izadi, S., Forouzanfar, M.: Error correction and adaptation in conversational AI: a review of techniques and applications in chatbots. AI 5(2), 803–841 (2024). https://doi.org/10.3390/ai5020041, https://www.mdpi.com/2673-2688/5/2/41
Johari, N.M., Nohuddin, P.N.E., Baharin, A.H.A., Yakob, N.A., Ebadi, M.J.: Features requirement elicitation process for designing a chatbot application. IET Netw. (2022). https://doi.org/10.1049/ntw2.12071
Kitchenham, B.A., Pfleeger, S.L.: Principles of survey research: part 3: constructing a survey instrument. SIGSOFT Softw. Eng. Notes 27(2), 20–24 (2002). https://doi.org/10.1145/511152.511155
Nemoto, T., Beglar, D.: Likert-scale questionnaires. In: JALT 2013 Conference Proceedings. pp. 1–8 (2014)
Nguyen, Q.L.: Non-functional requirements analysis modeling for software product lines. In: ICSE Workshop on Modeling in Software Engineering, MiSE 2009, Vancouver, BC, Canada, 17–18 May 2009, pp. 56–61. IEEE Computer Society (2009). https://doi.org/10.1109/MISE.2009.5069898
Rajender Kumar Surana, C.S., Shriya, Gupta, D.B., Shankar, S.P.: Intelligent chatbot for requirements elicitation and classification. In: 2019 4th International Conference on Recent Trends on Electronics, Information, Communication & Technology (RTEICT), pp. 866–870 (2019). https://doi.org/10.1109/RTEICT46194.2019.9016907
Rasheed, A., Zafar, B., Shehryar, T., Aslam, N.A., Sajid, M., Ali, N., Dar, S.H., Khalid, S.: Requirement engineering challenges in agile software development. Math. Probl. Eng. 2021(1), 6696695 (2021). https://doi.org/10.1155/2021/6696695
Schon, E., Thomaschewski, J., Escalona, M.J.: Agile requirements engineering: a systematic literature review. Comput. Stand. Interfaces 49, 79–91 (2017). https://doi.org/10.1016/J.CSI.2016.08.011
Silva, G.R.S., Canedo, E.D.: Requirements engineering challenges and techniques in building chatbots. In: Rocha, A.P., Steels, L., van den Herik, H.J. (eds.) Proceedings of the 14th International Conference on Agents and Artificial Intelligence, ICAART 2022, Volume 1, Online Streaming, 3–5 February 2022, pp. 180–187. SCITEPRESS (2022). https://doi.org/10.5220/0010801800003116
Silva, G.R.S., Canedo, E.D.: Unveiling quality in chatbot conversations: quantitative analysis of chatbot requirements. In: Canedo, E.D., et al. (eds.) Proceedings of the XXII Brazilian Symposium on Software Quality, SBQS 2023, Brasilia, Brazil, 7–10 November 2023, pp. 148–157. ACM (2023). https://doi.org/10.1145/3629479.3629481
Silva, G.R.S., Canedo, E.D.: Towards user-centric guidelines for chatbot conversational design. Int. J. Hum. Comput. Interact. 40(2), 98–120 (2024). https://doi.org/10.1080/10447318.2022.2118244
Silva, G.R.S., Rodrigues, G.N., Canedo, E.D.: A modeling strategy for the verification of context-oriented chatbot conversational flows via model checking. J. Univers. Comput. Sci. 29(7), 805–835 (2023). https://doi.org/10.3897/JUCS.91311
Weizenbaum, J.: ELIZA - a computer program for the study of natural language communication between man and machine (reprint). Commun. ACM 26(1), 23–28 (1983). https://doi.org/10.1145/357980.357991
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Gonçalves, L.P., Canedo, E.D., Santos, G. (2024). A Meta-model for Documenting Conversational Requirements in Chatbots. In: Bertolino, A., Pascoal Faria, J., Lago, P., Semini, L. (eds) Quality of Information and Communications Technology. QUATIC 2024. Communications in Computer and Information Science, vol 2178. Springer, Cham. https://doi.org/10.1007/978-3-031-70245-7_5
Download citation
DOI: https://doi.org/10.1007/978-3-031-70245-7_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-70244-0
Online ISBN: 978-3-031-70245-7
eBook Packages: Computer ScienceComputer Science (R0)