TrollLabs Open Dataset

The TrollLabs Open dataset is the result of running a prototyping hackathon with the aim of elucidating the capabilities and performance of generative AI, specifically ChatGPT, in the early stages of engineering design by comparing its performance to experienced engineering students in a hackathon setting. The dataset comprises 116 prototype entries and 433 edges(connection) that allows for comparative analysis of design practices, decisions and performance between one team instructed solely by generative AI, and five teams consisting of experienced engineering design students. Complementary, the dataset contains a copy of the chat between ChatGPT and the team tasked with executing its suggestions containing 41 prompts and answers. It contains the initial prompt used to instruct the AI, the objective and rules of the hackathon and the performance of teams, showing the ChatGPT team finishing 2nd among a total of six teams. The online prototype capture platform Pro2booth was used to collect comprehensive information about prototypes created and teams overall design processes. The data is particularly relevant to design researchers, engineering and design students, educators, and industry professionals seeking to find strategies for implementing or to implement generative AI tools in their design processes.