Neumann and Heredotou’s rubric Evaluating children’s videos: Assessing the psychometric properties of the rubric using the SELMA intervention

The growing use of digital tools in Early Childhood Education and Care (ECEC) highlights the need for the pedagogical assessment of these resources. Although evaluating the educational quality of children’s videos is essential to ensure a positive impact on children’s learning and development, little attention has been given to the systematic evaluation of such videos and only a few assessment tools exist. One study addressed this need by introducing a 17-item rubric to evaluate children’s YouTube videos, the Neumann and Heredotou’s rubric. This rubric consists of four theoretically driven categories: age appropriateness, content quality, design features, and learning objectives. The present study aims to examine the potential use of the rubric in ECEC by assessing its inter-rater reliability and validity. Two independent raters scored 35 pedagogical videos from an SEL intervention by the Neumann and Heredotou’s rubric. The results showed substantial inter-rater reliability (κw=.75). The consistently high scores on the pedagogical videos support the validity of the rubric in identifying high educational quality videos for young children. The findings support the utility of the rubric in the educational assessment of children’s video resources in ECEC and suggest that educators can benefit from using the rubric to ensure high pedagogical standards in children’s videos that are used in everyday practices.