Artifact for "Does Task Complexity Moderate the Benefits of Liveness? - A Controlled Experiment"

This artifact includes the setup, data, and analysis for the experiment described in the article "Does Task Complexity Moderate the Benefits of Liveness? - A Controlled Experiment" published in the journal "The Art, Science, and Engineering of Programming" Volume 9. The artifact has the following structure: experiment-setup experiment-environment.zip: Archive including the fully configured Squeak/Smalltalk environment experiment-protocol.pdf: Full protocol for conducting the experiment system: Includes the base system used for the experiment without any seeded faults tasks task-descriptions.txt: The task descriptions of steps to reproduce and symptoms for the tasks used in the experiment patches: Patch files for all generated tasks infrastructure: Contains source code of the tools used for controlling tasks in the development environment questionnaire survey.dfglive.2023-01-06.xml: Questionnaire configuration for a SoSci survey server, includes demographics, experience, and skill questionnaire results data export-NN.zip: Each archive contains the raw data from one run starTrackData-NN: Contains the detailed event log experimentState.json: Contains the measurements and the final state for each task (completed, notStarted, etc.) skillTestResult-NN.json: Contains the score reached in the skill test task-X-NN.cs: The submitted patch for task X questionnaire data_dfglive-analysis.ods: Demographics and experience questionnaire results (gender column is redacted due to potential deanonymization) results of skill test are only available in graded form in the participant export files analysis analysis-r: Main analysis scripts main.R, main-contrast-based.R: Two versions of the main and moderation effect analysis using two different processes live-tools-usage-time.R: Main and moderation effect analysis on tool usage demographics.R: Analysis of demographics and rendering of charts analysis-tool-usage-correlation: Includes scripts to extract tool usage frequencies from the event logs. Assumes that export-NN.zip files are in the parent folder.本附属制品包含发表于期刊《编程的艺术、科学与工程》（The Art, Science, and Engineering of Programming）第9卷的论文《任务复杂度是否调节交互实时性的收益？——一项对照实验》所述实验的搭建流程、数据集与分析代码。 本附属制品的结构如下： 1. experiment-setup：实验搭建相关目录 - experiment-environment.zip：包含完整配置完成的Squeak/Smalltalk开发环境的归档文件 - experiment-protocol.pdf：实验完整实施方案文档 2. system：不含预设故障的实验基础系统目录 3. tasks：实验任务相关目录 - task-descriptions.txt：实验所用任务的复现步骤与症状描述文档 - patches：存储所有生成任务对应补丁文件的目录 4. infrastructure：包含开发环境中用于管控实验任务的工具源代码的目录 5. questionnaire：调查问卷相关目录 - survey.dfglive.2023-01-06.xml：适配SoSci调查服务器的问卷配置文件，包含人口统计学信息、从业经验与技能水平相关问卷内容 6. results：实验结果总目录 - data：实验原始数据子目录 - export-NN.zip：每个归档文件均对应单次实验运行的原始数据 - starTrackData-NN：存储详细实验事件日志的目录 - experimentState.json：包含每项任务的测量数据与最终状态（已完成、未开始等）的配置文件 - skillTestResult-NN.json：包含技能测试得分情况的文件 - task-X-NN.cs：任务X的提交补丁文件 - questionnaire：问卷结果子目录 - data_dfglive-analysis.ods：包含人口统计学信息与从业经验问卷结果的文档（因存在去匿名化风险，性别列已隐去） - 注：技能测试结果仅以分级形式在参与者导出文件中提供 7. analysis：数据分析脚本目录 - analysis-r：主分析脚本目录 - main.R、main-contrast-based.R：两种不同分析流程下的主效应与调节效应分析脚本 - live-tools-usage-time.R：针对工具使用时长的主效应与调节效应分析脚本 - demographics.R：用于人口统计学信息分析与图表绘制的脚本 - analysis-tool-usage-correlation：包含从事件日志中提取工具使用频率的脚本目录，需确保export-NN.zip文件位于父级目录中