An evidence-based decision assistance model for predicting training outcome in juvenile guide dogs

Working dog organisations, such as Guide Dogs, need to regularly assess the behaviour of the dogs they train. In this study we developed a questionnaire-style behaviour assessment completed by training supervisors of juvenile guide dogs aged 5, 8 and 12 months old (n = 1,401), and evaluated aspects of its reliability and validity. Specifically, internal reliability, temporal consistency, construct validity, predictive criterion validity (comparing against later training outcome) and concurrent criterion validity (comparing against a standardised behaviour test) were evaluated. Thirty-nine questions were sourced either from previously published literature or created to meet requirements identified via Guide Dogs staff surveys and staff feedback. Internal reliability analyses revealed seven reliable and interpretable trait scales named according to the questions within them as: Adaptability; Body Sensitivity; Distractibility; Excitability; General Anxiety; Trainability and Stair Anxiety. Intra-individual temporal consistency of the scale scores between 5–8, 8–12 and 5–12 months was high. All scales excepting Body Sensitivity showed some degree of concurrent criterion validity. Predictive criterion validity was supported for all seven scales, since associations were found with training outcome, at at-least one age. Thresholds of z-scores on the scales were identified that were able to distinguish later training outcome by identifying 8.4% of all dogs withdrawn for behaviour and 8.5% of all qualified dogs, with 84% and 85% specificity. The questionnaire assessment was reliable and could detect traits that are consistent within individuals over time, despite juvenile dogs undergoing development during the study period. By applying thresholds to scores produced from the questionnaire this assessment could prove to be a highly valuable decision-making tool for Guide Dogs. This is the first questionnaire-style assessment of juvenile dogs that has shown value in predicting the training outcome of individual working dogs.工作犬机构（如导盲犬组织）需定期对其所训练的犬只行为进行评估。本研究开发了一套问卷式行为评估工具，由5月龄、8月龄及12月龄幼年导盲犬的训练督导完成填写，共纳入1401份有效样本，并对该工具的信度与效度多维度进行了评估。具体而言，本研究评估了该工具的内部一致性信度、时间稳定性、结构效度、预测效标效度（与后续训练结果进行对比）以及同时效标效度（与标准化行为测试进行对比）。本评估工具共包含39个条目，其中部分条目引自已发表的文献，其余条目则根据导盲犬组织员工调研及反馈所明确的需求全新编制。内部一致性信度分析结果显示，该工具可提取出7个可靠且可解释的特质维度量表，各量表根据所含条目分别命名为：适应性（Adaptability）、身体敏感性（Body Sensitivity）、分心易感性（Distractibility）、兴奋性（Excitability）、广泛性焦虑（General Anxiety）、可训练性（Trainability）以及楼梯焦虑（Stair Anxiety）。各量表得分在5~8月龄、8~12月龄以及5~12月龄三个时间段内的个体内时间稳定性均较高。除身体敏感性量表外，其余所有量表均表现出一定程度的同时效标效度。七个量表均表现出显著的预测效标效度，即在至少一个月龄阶段，其得分与后续训练结果存在显著关联。研究确定了各量表z分数的临界值，该临界值可有效区分后续训练结果：可识别出8.4%因行为问题被淘汰的犬只以及8.5%的合格受训犬，对应的特异度分别为84%与85%。尽管本研究期间幼年导盲犬尚处于发育阶段，但该问卷式评估工具仍具备良好的信度，且能够检测出个体在不同时间点保持稳定的行为特质。通过将该临界值应用于问卷得分，本评估工具可成为导盲犬组织极具价值的决策辅助工具。本研究开发的针对幼年工作犬的问卷式行为评估工具，是首个被证实可有效预测个体工作犬训练结果的同类评估工具。