Supporting data for "Chinese Multimodal Reading Comprehension in a Hypertext Environment: Measurement and its Antecedents"

This study focuses on the measurement of students’ multimodal reading performance, as well as exploring the reader factors and textual factors that influence students’ multimodal reading performance. To measure multimodal reading performance and the impact of students’ cognitive skills, a quantitative research design was employed. To assess the influence of textual factors—specifically, the role of different modalities and image-text relationships in multimodal reading—a qualitative research design was utilized.The quantitative research dataset contains variables such as multimodal reading performance, word decoding, linguistic comprehension, image comprehension, inference, and prior knowledge. From the participants, who were fourth-grade students in Hong Kong, a total of 282 responses were collected, out of which 251 were valid.The qualitative study data consists of 25 audio recordings from semi-structured interviews with 40 fourth-grade students. The interviews aimed to understand the roles of images and text, as well as the image-text relationships, in the students’ multimodal reading comprehension. The questions involved are as follows: (1) Do you prefer to read text, pictures, or a combination of text and pictures? Why? (2) How do the text and/or pictures help your understanding of the reading material? (3) How do you integrate text and pictures? (4) How does the integration of text and pictures help you understand the reading material? (5) There are three image-text relationships here (illustration, elaboration, and extension); which one do you find easiest to understand? Which is the most challenging? Why?

本研究聚焦于测量学生多模态阅读能力，并探讨影响学生多模态阅读能力的读者因素及文本因素。为测量多模态阅读能力及学生认知技能的影响，采用了定量研究设计。为评估文本因素的影响——特别是不同模态及图文关系在多模态阅读中的作用——采用了定性研究设计。定量研究数据集包含多模态阅读能力、词汇解码、语言理解、图像理解、推理和先验知识等变量。从香港四年级学生中收集了282份有效回复，其中251份为有效数据。定性研究数据由40名四年级学生的半结构化访谈中的25段音频记录组成。访谈旨在理解图像和文本在学生多模态阅读理解中的作用，以及图文关系。涉及的问题如下：（1）你更倾向于阅读文本、图片，还是文本与图片的结合？为什么？（2）文本和/或图片如何帮助你理解阅读材料？（3）你是如何整合文本和图片的？（4）文本与图片的整合如何帮助你理解阅读材料？（5）这里有三种图文关系（插图、详述和扩展）；你认为哪一种最容易理解？哪一种最具挑战性？为什么？” }