Prompt to Perfection: The Impact of Online Tutorials on AI Prompt Literacy and Student Satisfaction with AI Outputs

The study aimed to discover: How proficient are students in writing prompts and evaluating GAI outputs?
Can an online tutorial improve prompt literacy when using GAI tools?
Do students use different GAI tools for different tasks?
How satisfied are students with GAI tools for performing different types of tasks?
Are there examples of students good and bad practice when creating prompts which can be used to inform an improved online tutorial around prompt literacy?

1078 students completed an expression of interest, noting their level of study, subject and how confident they feel using GAI tools. From this 90 students were randomly selected to take part in a user experience study. They were given 19 different tasks and asked to use a GAI tool(s) to achieve the task e.g. fixing a broken code, writing an email, creating a revision quiz, summarising a journal article etc. Half of the students completed an online tutorial on creating effective prompts and half did not. Students then rated how satisfied they were with the chosen GAI for each task.