Digital and Online Competencies 2022

This research aims to analyze an online self-evaluation tool to help students independently assess their digital and online competencies (DOCs). Applying the R&D method produced two products to achieve this research objective: a DOCs instrument and a DOCs application. The reliability and validity test results for the DOCs instrument indicate that its quality (Cronbach’s Alpha Based on Standardized Items = 0.937, df = 28) promotes a high level of reliability for measuring student DOCs. In addition, the quality of the DOCs application, based on its user-friendly and usability (UX) instrument, was determined using the UX-DOCs instrument. The results suggest that students are comfortable using the DOCs application (Cronbach's alpha value = 0.982, N = 21). Hence, the research concludes that this DOCs application can help students independently self-evaluate their digital and online competencies.

Overall, this study demonstrates that the research has produced a DOCs instrument with a high level of validity, as evidenced by the statistical analysis results. Furthermore, the most important result is that this research has succeeded in redesigning the Likert scale processing method for use in DOCs applications with a high level of statistical reliability. The DOCs survey design process was carried out using a mathematical algorithm in the first phase of 2020 research. In addition, this research has successfully built a DOCs application. This app accommodates users’ self-evaluation of their digital and online competencies. The application is also designed to maintain the sustainability of the self-evaluation process for students. Given the statistical analysis results related to the usability and user-friendliness of the application, it is evident that the DOCs application has an excellent level of user-friendliness and usability. Therefore, this study recommends that further research be conducted on a broader range of respondents to get a more thorough level of trust from potential users when using the DOCs application.

本研究旨在分析一款在线自我评估工具，以帮助学生自主评估其数字与在线能力（Digital and Online Competencies，简称DOCs）。本研究采用研发方法，产出两项成果以达成研究目标：一是DOCs评估量表，二是DOCs应用程序。针对DOCs评估量表的信效度检验结果显示，其质量指标（基于标准化题项的克朗巴哈α系数=0.937，自由度df=28）具备较高的学生数字与在线能力测量信度。此外，本研究基于用户体验（User Experience，简称UX）评估工具，通过UX-DOCs量表确定了DOCs应用程序的质量。结果表明，学生使用该DOCs应用程序的体验良好（克朗巴哈α系数=0.982，样本量N=21）。据此，本研究得出结论：本款DOCs应用程序可帮助学生自主开展数字与在线能力的自我评估。

总体而言，本研究通过统计分析结果证实，本研究已开发出具备较高效度的DOCs评估量表。此外，本研究最重要的成果在于，成功重新设计了李克特量表（Likert scale）处理方法，使其可应用于具备高统计信度的DOCs应用程序中。本研究于2020年第一阶段研究中，通过数学算法完成了DOCs调查问卷的设计流程。此外，本研究成功搭建了DOCs应用程序，该应用可支持用户对自身数字与在线能力开展自我评估，同时旨在保障学生自我评估流程的可持续性。结合该应用的可用性与用户友好性相关统计分析结果可知，本DOCs应用程序具备极佳的用户友好性与可用性。因此，本研究建议后续研究可扩大受访者范围，以提升潜在用户在使用DOCs应用程序时的信任程度，获得更全面的评估结果。