ChatGPT Making our Minds Dull? The Cognitive Impact of Using ChatGPT in the Writing Process

How does using Artificial Intelligence in writing affect cognition? Drawing on the writing-tolearn literature, using ChatGPT in the writing process was hypothesised to benefit learning performance. In a laboratory experiment, N = 35 psychology students wrote a text using cognitive prompts on elaboration, either with or without the assistance of ChatGPT. Learning performance was measured with a knowledge test before and after the task, together with several covariables. Contrary to the hypothesis, participants writing their text without ChatGPT experienced a significantly larger gain in knowledge (p = .018). Among the participants using ChatGPT, motivation (p = .009) and interest (p = .017) emerged as significant moderators, indicating that only students with low motivation or interest are at a disadvantage when using ChatGPT. Despite the potential of ChatGPT as a writing and learning assistant, the use of ChatGPT without training for appropriate deployment may not benefit or even harm learning during the writing process. Hence, AI should be implemented in education diligently.