Credibility assessment: a collaborative evaluation environment for credibility assessment of modeling and simulation applications

Credibility assessment of modeling and simulation (M&S) applications is becoming increasingly more important as M&S applications are used more and more for complex system design evaluation, M&S-based acquisition, problem solving, military training, and critical decision making. M&S credibility assessment is a very complex process, involves the measurement and evaluation of hundreds of qualitative and quantitative elements, mandates subject matter expert evaluation, and requires the integration of disparate measurements and evaluations. Planning and managing such measurements and evaluations require a unifying methodology and should not be performed in an <i>ad hoc</i> manner. We have developed such a methodology, which can be used for credibility assessment of any kind of M&S application. To provide computer-aided assistance in applying our methodology and to enable collaborative evaluations by geographically dispersed people, we have developed a Web-based client/server software system. This tutorial introduces our software system, which can be used at <https://www.orcacomputer.com/ee> or <http://www.EvaluationEnvironment.com>.