Included Primary Studies of "Metrics to Estimate Model Comprehension Quality A Systematic Map and Literature Review"

Conceptual models are an effective and unparalleled means to communicate complicated information with a broad variety of stakeholders in a short period of time. However in practice, conceptual models often vary in clarity, employed features, communicated content, and overall quality. This potentially impacts model comprehension to a point where models are factually useless. To counter this, guidelines to create “good” conceptual models have been suggested. However, these guidelines are often abstract, hard to operationalize in different modeling languages, partly overlap, or even contradict on another. In addition, no comparative study of proposed guidelines exists so far. This is issue is exacerbated as no established metrics to measure model comprehension or to estimate model comprehension for a given conceptual model exist. In this paper, we present the results of a literature survey investigating 109 publications in the field and discuss metrics to measure model comprehension, their quantification, and their empirical substantiation. Results show that albeit a number of concrete, quantifiable metrics to measure and guidelines to achieve model comprehension have been proposed, concrete evaluative recommendations are largely missing. Moreover, some suggested guidelines are contradictory and few metrics exist that allow instantiating common frameworks for model quality in a specific way. This document contains the references to all 109 included primary studies identified by out search. @font-face {font-family:PMingLiU; panose-1:2 2 5 0 0 0 0 0 0 0; mso-font-alt:新細明體; mso-font-charset:136; mso-generic-font-family:roman; mso-font-pitch:variable; mso-font-signature:-1610611969 684719354 22 0 1048577 0;}@font-face {font-family:"Cambria Math"; panose-1:2 4 5 3 5 4 6 3 2 4; mso-font-charset:0; mso-generic-font-family:roman; mso-font-pitch:variable; mso-font-signature:-536870145 1107305727 0 0 415 0;}@font-face {font-family:Calibri; panose-1:2 15 5 2 2 2 4 3 2 4; mso-font-charset:0; mso-generic-font-family:swiss; mso-font-pitch:variable; mso-font-signature:-536859905 -1073732485 9 0 511 0;}@font-face {font-family:"Linux Libertine"; panose-1:2 11 6 4 2 2 2 2 2 4; mso-font-alt:"Times New Roman"; mso-font-charset:0; mso-generic-font-family:auto; mso-font-pitch:variable; mso-font-signature:-536868097 1375790587 33554464 0 447 0;}@font-face {font-family:"\@PMingLiU"; panose-1:2 1 6 1 0 1 1 1 1 1; mso-font-charset:136; mso-generic-font-family:roman; mso-font-pitch:variable; mso-font-signature:-1610611969 684719354 22 0 1048577 0;}p.MsoNormal, li.MsoNormal, div.MsoNormal {mso-style-unhide:no; mso-style-qformat:yes; mso-style-parent:""; margin:0in; text-align:justify; text-justify:inter-ideograph; line-height:110%; mso-pagination:widow-orphan; font-size:9.0pt; mso-bidi-font-size:11.0pt; font-family:"Linux Libertine"; mso-fareast-font-family:Calibri; mso-fareast-theme-font:minor-latin; mso-bidi-font-family:"Times New Roman"; mso-bidi-theme-font:minor-bidi;}p.Abstract, li.Abstract, div.Abstract {mso-style-name:Abstract; mso-style-unhide:no; mso-style-qformat:yes; mso-style-parent:""; margin-top:1.0pt; margin-right:0in; margin-bottom:6.0pt; margin-left:0in; text-align:justify; text-justify:inter-ideograph; line-height:110%; mso-pagination:widow-orphan; font-size:9.0pt; mso-bidi-font-size:11.0pt; font-family:"Linux Libertine"; mso-fareast-font-family:Calibri; mso-fareast-theme-font:minor-latin; mso-bidi-font-family:"Times New Roman"; mso-bidi-theme-font:minor-bidi;}.MsoChpDefault {mso-style-type:export-only; mso-default-props:yes; font-size:10.0pt; mso-ansi-font-size:10.0pt; mso-bidi-font-size:10.0pt; font-family:"Calibri",sans-serif; mso-ascii-font-family:Calibri; mso-fareast-font-family:PMingLiU; mso-hansi-font-family:Calibri; mso-bidi-font-family:Arial; mso-ansi-language:IT; mso-fareast-language:IT;}div.WordSection1 {page:WordSection1;}