03/07/2026
ChatGPT and student learning: a meta-analysis
https://www.facebook.com/share/17n1JQJb91/?mibextid=wwXIfr
ChatGPT and Student Learning: What 51 Studies Actually Show!
I've been saying for a while that pedagogy determines whether AI helps or hurts.
Wang and Fan (2025) just gave me 51 studies worth of evidence to back that up.
Their meta-analysis covers studies from November 2022 to February 2025. The headline: ChatGPT has a large positive effect on learning performance (g = 0.867). But the effect on higher-order thinking drops to roughly half (g = 0.457).
ChatGPT helps students score better. It's considerably less effective at helping them think more critically.
The duration findings are especially useful. Four to eight weeks of structured use produced the strongest gains. Anything under one week barely moved the needle because, as the authors note, students "lacked the questioning skills needed to use it effectively."
Beyond eight weeks, a decline set in, which they attribute to over-reliance. Shaw and Nave (2026) call that cognitive surrender, and it keeps appearing across studies.
The role ChatGPT plays also matters.
As an intelligent tutor providing personalized feedback and prompting reflection, the effect on higher-order thinking was large.
As a simple tool for resource retrieval, the effect dropped by half. Fan et al. (2025) documented something similar with metacognitive laziness: the product improved but the cognitive process didn't.
Wang and Fan are direct about something most studies skip: ChatGPT lacks emotional intelligence. It delivers content efficiently but can't spark the kind of interaction that builds genuine curiosity.
Kosmyna et al. (2025) showed reduced neural engagement when students relied on ChatGPT for writing. Hard to ignore that connection.
The tool works. The question is whether we'll design the pedagogy around it well enough to matter.
Link in the first comment!
References
Fan, Y., Tang, L., Le, H., Shen, K., Tan, S., Zhao, Y., Shen, Y., Li, X., & Gašević, D. (2025). Beware of metacognitive laziness: Effects of generative artificial intelligence on learning motivation, processes, and performance. British Journal of Educational Technology, 56(2), 489–530.
Kosmyna, N., Hauptmann, E., Yuan, Y. T., Situ, J., Liao, X.-H., Beresnitzky, A. V., Braunstein, I., & Maes, P. (2025). Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant for essay writing tasks. MIT Media Lab.
Shaw, S. D., & Nave, G. (2026). Thinking fast, slow, and artificial: How AI is reshaping human reasoning and the rise of cognitive surrender. Working paper, The Wharton School, University of Pennsylvania.
Wang, J., & Fan, W. (2025). The effect of ChatGPT on students' learning performance, learning perception, and higher-order thinking: Insights from a meta-analysis. Humanities and Social Sciences Communications, 12, 621.