Style, Sentiment, and Quality of Undergraduate Writing in the AI Era: A Cross-Sectional and Longitudinal Analysis of 4,820 Authentic Empirical Reports
Listed in
This article is not in any list yet, why not save it to one of your lists.Abstract
As generative artificial intelligence (GenAI) becomes widespread in education, its influence on students’ academic practice raises concern. We conducted pre-registered analyses of 4,820 empirical reports written by 2,000 psychology undergraduates (2016-2025). Following ChatGPT’s 2022 release, prevalence of ChatGPT-associated lexical markers (e.g., delve) surged until 2024, then declined in 2025, possibly due to students masking GenAI traces. Writing style (indexed by lexical diversity/density/sophistication, nominalisation, readability) became increasingly formal post-ChatGPT, diverging from predicted/historical trends. Consistent with GenAI’s positivity bias, sentiment also became more positive, independent of topic or result’s statistical significance, raising questions about its potential impact on students’ critical engagement. Despite the stylistic changes, writing quality (indexed by grades and feedback) showed no discernible shifts. Exploratory analysis asked GPT models to rewrite pre-ChatGPT reports, and these GPT-rewritten texts resembled post-ChatGPT reports more in style and sentiment. Finally, no students disclosed AI use despite clear guidelines, highlighting the ineffectiveness of voluntary disclosure.