Deriving knowledge representation guidelines by analyzing knowledge engineer behavior
Pages 304 - 315
Abstract
Knowledge engineering research has focused on proposing knowledge acquisition techniques, developing and evaluating knowledge representation schemes and engineering tools, and testing and debugging knowledge-based systems. Few formal studies have been conducted on understanding the behaviors and roles of knowledge engineers. Applying the theory of mental models, this paper describes a think aloud verbal protocol study to determine an empirical basis for understanding: (1) how knowledge engineers extract domain knowledge from textual sources; and (2) the cognitive mechanisms by which they engage various knowledge representation schemes to represent that knowledge acquired. The results suggest that knowledge representation is not simply a translation of acquired knowledge to a knowledge representation. Instead, it is an iterative process of selective querying of acquired knowledge, and continuous refinement of a model leveraging, not only on acquired knowledge from domain experts, but also from the knowledge engineer. From the findings of empirical studies, a set of guidelines is derived to support the training and development of better knowledge representation schemes, representation processes, and knowledge engineering tools.
References
[1]
Adelson, B. and Soloway, E., The role of domain experience in software design. IEEE Transactions on Software Engineering. v11. 1351-1360.
[2]
Alavi, M. and Leidner, D.E., Review: knowledge management and knowledge management systems: conceptual foundations and research issues. MIS Quarterly. v25. 107-136.
[3]
Bajaj, A., Batra, D., Hevner, A., Parsons, J. and Siau, K., Information technology and systems-I systems analysis and design: should we be researching what we teach?. Communications of the Association for Information Systems. v15. 478-493.
[4]
Bekker, P.A., Merckens, A. and Wansbeek, T.J., Identification, Equivalent Models, and Computer Algebra. 1994. Academic Press.
[5]
Brewster, C. and O'Hara, K., Knowledge representation with ontologies: the present and future. IEEE Intelligent Systems. v19. 72-81.
[6]
Brooks, R., Towards a theory of the comprehension of computer programs. International Journal of Man-Machine Studies. v39. 237-267.
[7]
Brymer, R.A., Hospitality Management: An Introduction to the Industry. 1995. Kendall/Hunt Publishing Company, Dubuque, Iowa.
[8]
Implementation and use of expert systems in organizations: perceptions of knowledge engineers. Journal of Management Information Systems. v8. 97-116.
[9]
Byrd, T.A., Cossick, K.L. and Zmud, R.W., A synthesis of research on requirements analysis and knowledge acquisition. MIS Quarterly. v16. 117-138.
[10]
Cardoso, J., The semantic web vision: where are we?. IEEE Intelligent Systems. v22. 84-88.
[11]
Chen, Y.-J., Development of a method for ontology-based empirical knowledge representation and reasoning. Decision Support Systems. v50. 1-20.
[12]
Cecil Eng Huang Chua, Veda C. Storey, Roger H. L. Chiang. Knowledge representation: a conceptual modeling approach. Journal of Database Management 23 (1) (January/March 2012) 1-30.
[13]
Cohen, A., European car rental, gas hike shifts buyers' gears. Business Travel News. v17. 12
[14]
Davis, R., Schrobe, H. and Szolovits, P., What is a knowledge representation?. AI Magazine. v14. 17-33.
[15]
Du, T.C., Li, F. and King, I., Managing knowledge on the web-extracting ontology from HTML web. Decision Support Systems. v47. 319-331.
[16]
Ericsson, K.A. and Simon, H.A., Protocol Analysis: Verbal Reports as Data. 1993. MIT Press.
[17]
Garnham, A., Mental Models as Representations of Discourse and Text. 1987. Ellis Horwood Ltd., West Sussex, UK.
[18]
Garnham, A., Mental Models and the Interpretation of Anaphora. 2001. Psychology Press, East Sussex, UK.
[19]
Translation approach to portable ontology specifications. Knowledge Acquisition. v5. 199-220.
[20]
He, W., Erdelez, S., Wang, F.-K. and Shyu, C.-R., The effects of conceptual description and search practice on users' mental models and information seeking in a case-based reasoning retrieval system. Information Processing and Management. v44. 294-309.
[21]
Heflin, J., Hendler, J. and Luke, S., SHOE: A Knowledge Representation Language for Internet Applications. 1999. University of Maryland at College Park.
[22]
Advances in knowledge acquisition and representation. International Journal on Artificial Intelligence Tools. v15. 867-874.
[23]
Iverson, K.M., Introduction to Hospitality Management. 1989. Van Nostrand Reinhold.
[24]
Johnson-Laird, P.N., Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness. 1983. Cambridge University Press, Cambridge, UK.
[25]
Johnson-Laird, P.N., Legrenzi, P. and Girotto, V., How we detect logical inconsistencies. Current Directions in Psychological Science. v13. 41-45.
[26]
Karahasanovi, A., Hinkel, U.N., Sjoberg, D.I.K. and Thomas, R., Comparing of feedback-collection and think-aloud methods in program comprehension studies. Behaviour & Information Technology. v28. 139-164.
[27]
Kaza, S. and Chen, H., Evaluating ontology mapping techniques: an experiment in public safety information sharing. Decision Support Systems. v45. 714-728.
[28]
Kothari, C.R. and Russomanno, D.J., Enhancing OWL ontologies with relation semantics. International Journal of Software Engineering. v18. 327-356.
[29]
Krahmer, E. and Ummelen, N., Thinking about thinking aloud: a comparison of two verbal protocols for usability testing. IEEE Transactions on Professional Communication. v47. 105-117.
[30]
Kuzel, A.J., Sampling in qualitative inquiry. In: Crabtree, B.F., Miller, W.L. (Eds.), Doing Qualitative Research, Sage Publications, Newbury Park, CA. pp. 31-44.
[31]
Landis, J.R. and Koch, G.G., The measurement of observer agreement for categorical data. Biometrics. v22. 79-94.
[32]
Lassila, O., Web metadata: a matter of semantics. IEEE Internet Computing. v2. 30-37.
[33]
Leone, N., Pfeifer, G., Faber, W., Eiter, T., Gottlob, G., Perri, S. and Scarcello, F., The DLV system for knowledge representation and reasoning. ACM Transactions on Computational Logic. v7. 499-562.
[34]
Lyytinen, K., Different perspectives on information systems: problems and solutions. ACM Computing Surveys. v19. 5-46.
[35]
Miles, M.B. and Huberman, A.M., Qualitative Data Analysis: An Expanded Sourcebook. 1994. Sage Publications.
[36]
Mykytyn Jr., P.P., Mykytyn, K. and Raja, M.K., Roles of the knowledge engineers and their relationship to systems analyst. Information Resources Management Journal. v11. 14-26.
[37]
Neale, I.M., Modelling expertise for KBS development. Journal of the Operational Research Society. v41. 447-458.
[38]
Nguyen, L. and Swatman, P.A., Complementary Use of Ad Hoc and Post Hoc Design Rationale for Creating and Organizing Process Knowledge. In: 33rd Hawaii International Conference on System Sciences,
[39]
Payne, S.J., Users' mental models: the very ideas. In: Carroll, J.M. (Ed.), HCI Models, Theories, and Frameworks: Toward a Multidisciplinary Science Morgan-Kaufman, San Francisco,
[40]
Peugeot, C., Conceptual Model and Mental Model. In: 3rd European Conference on Information Systems, Athens, Greece,
[41]
Pinto, H.S., Gomez-Perez, A. and Martins, J.P., Some Issues on Ontology Integration. In: IJCAI-99 Workshop on Ontologies and Problem-Solving Methods: Lessons Learned and Future Trends, pp. 7.1-7.12.
[42]
Purao, S., Rossi, M. and Bush, A., Towards an understanding of the use of problem and design spaces during object-oriented system development. Information and Organization. v12. 249-281.
[43]
Recker, J., Rosemann, M. and Krogstie, J., Ontology- versus pattern-based evaluation of process modeling language: a comparison. Communications of the Association for Information Systems. v20. 774-799.
[44]
Schreiber, G., Akkermans, H. and Anjewierden, A., Knowledge Engineering and Management: The Commonkads Methodology. 1999. MIT Press, Cambridge, MA.
[45]
Shadbolt, N., O'Hara, K. and Crow, L., The experimental evaluation of knowledge acquisition techniques and methods: history, problems and new directions. International Journal of Human Computer Studies. v51. 729-755.
[46]
Shanks, G., Tansley, E., Nuredini, J., Tobin, D. and Weber, R., Representing part-whole relations in conceptual modeling: an empirical evaluation. MIS Quarterly. v32. 553-573.
[47]
Smith, M.K., Welty, C. and McGuinness, D.L., OWL Web Ontology Language Guide. 2004.
[48]
Soloway, E. and Ehrlich, K., Empirical studies of programming knowledge. ACM Transactions on Software Engineering. v10. 595-609.
[49]
Sowa, J.F., Conceptual Structures: Information Processing in Mind and Machine. 1984. Addison-Wesley Publishing Company.
[50]
Sowa, J.F., Knowledge Representation: Logical, Philosophical, and Computational Foundations. 2000. Brooks Cole Publishing Co.
[51]
Stephens, L.M. and Huhns, M.N., Consensus ontologies: reconciling the semantics of web pages and agents. IEEE Internet Computing. v5. 92-94.
[52]
Studer, R., Benjamins, V.R. and Fensel, D., Knowledge engineering: principles and methods. Data and Knowledge Engineering. v25. 161-197.
[53]
Todd, P.A. and Benbasat, I., Process tracing methods in decision support systems: exploring the black box. MIS Quarterly. v11. 493-512.
[54]
Turban, E. and Aronson, J.E., Decision Support Systems and Intelligent Systems. 2011. sixth ed. Pearson Education, Upper Saddle River, NJ.
[55]
Uschold, M., Healy, M., Williamson, K., Clark, P. and Woods, S., Ontology Reuse and Application. In: International Conference on Formal Ontology and Information Systems, pp. 179-192.
[56]
Valente, A., Russ, T., MacGregor, R. and Swartout, W., Building and (re)using an ontology of air campaign planning. IEEE Intelligent Systems. v14. 27-36.
[57]
Valusek, J.R. and Fryback, D.G., Information requirements determination: obstacles within, among, and between participants. In: Galliers, R. (Ed.), Information Analysis: Selected Readings, Addison-Wesley. pp. 139-151.
[58]
von Mayrhauser, A.A. and Vans, A.M., Identification of dynamic comprehension processes during large scale maintenance. IEEE Transactions on Software Engineering. v22. 424-437.
[59]
Wand, Y. and Weber, R., On the deep structure of information systems. Information Systems Journal. v5. 203-223.
[60]
Welty, C.A., Intelligent Assistance for Navigating the Web. In: Florida AI Research Symposium,
[61]
Yoon, Y., Guimaraes, T. and O'Neal, Q., Exploring the factors associated with expert system success. MIS Quarterly. v19. 83-106.
[62]
Zhang, Y., The influence of mental models on undergraduate students' searching behavior on the web. Information Processing & Management. v44. 1330-1345.
Index Terms
- Deriving knowledge representation guidelines by analyzing knowledge engineer behavior
Index terms have been assigned to the content through auto-classification.
Recommendations
Automated Knowledge Acquisition for Strategic Knowledge
Strategic knowledge is used by an agent to decide what action to perform next, where actions have consequences external to the agent. This article presents a computer-mediated method for acquiring strategic knowledge. The general knowledge acquisition ...
The Knowledge Acquisition and Representation Language, KARL
The Knowledge Acquisition and Representation Language (KARL) combines a description of a knowledge-based system at the conceptual level (a so-called model of expertise) with a description at a formal and executable level. Thus, KARL allows the precise ...
CoolGust: knowledge representation learning with commonsense knowledge guidelines and constraints
AbstractRepresentation learning serves as a crucial link between knowledge graphs and neural models. Knowledge graphs are typical symbolic models and require representation learning to obtain vector representations of entities and relationships. Existing ...
Comments
Information & Contributors
Information
Published In
Copyright © Elsevier B.V. © 2012.
Publisher
Elsevier Science Publishers B. V.
Netherlands
Publication History
Published: 01 December 2012
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 10 Aug 2024
Other Metrics
Citations
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in