A Cognitive Window to Validity Argument Mode of L2 Writing Assessment: Integrated Positive and Negative Cognitive Pauses

Purpose: This article asserts that traditional writing assessment has limitations in capturing the complex processes involved in validation argument. After discussing the problematic aspects of traditional writing assessment, this cross-sectional study focuses on measuring the validity argument model by testing the correlations between L2 writing assessment and cognitive pauses. Background: It suggests that incorporating a simultaneous measure of positive and negative cognitive pauses could enhance the validity of writing assessment by observing the intricate pausing processes during L2 writing assessment. Methods: The study utilizes a dataset of keystroke logs collected from a sample of secondary school students aged 16 to 18 (N=174). Results: The findings indicate that positive and negative cognitive pauses can effectively monitor and record the simultaneous processes of L2 writing assessment. The article concludes by recommending the adoption of a common set of theoretically informed validity argument modes, instead of relying solely on qualitative assessments. Conclusion: It suggests estimating how the parameters of these positive and negative pauses vary with the assessment outcomes. These findings carry significant implications, as they contribute to the development of interventions related to negative pauses and the promotion of positive pauses. They also emphasize the importance of supporting valid and reliable writing assessment through a robust validity argument mode.