Improving Schools, Inc

Improving Schools, Inc

Share

We foster educational equity through coaching leaders & teachers in public schools across the US.

03/07/2026

ChatGPT and student learning: a meta-analysis

https://www.facebook.com/share/17n1JQJb91/?mibextid=wwXIfr

ChatGPT and Student Learning: What 51 Studies Actually Show!

I've been saying for a while that pedagogy determines whether AI helps or hurts.

Wang and Fan (2025) just gave me 51 studies worth of evidence to back that up.

Their meta-analysis covers studies from November 2022 to February 2025. The headline: ChatGPT has a large positive effect on learning performance (g = 0.867). But the effect on higher-order thinking drops to roughly half (g = 0.457).

ChatGPT helps students score better. It's considerably less effective at helping them think more critically.

The duration findings are especially useful. Four to eight weeks of structured use produced the strongest gains. Anything under one week barely moved the needle because, as the authors note, students "lacked the questioning skills needed to use it effectively."

Beyond eight weeks, a decline set in, which they attribute to over-reliance. Shaw and Nave (2026) call that cognitive surrender, and it keeps appearing across studies.

The role ChatGPT plays also matters.

As an intelligent tutor providing personalized feedback and prompting reflection, the effect on higher-order thinking was large.

As a simple tool for resource retrieval, the effect dropped by half. Fan et al. (2025) documented something similar with metacognitive laziness: the product improved but the cognitive process didn't.

Wang and Fan are direct about something most studies skip: ChatGPT lacks emotional intelligence. It delivers content efficiently but can't spark the kind of interaction that builds genuine curiosity.

Kosmyna et al. (2025) showed reduced neural engagement when students relied on ChatGPT for writing. Hard to ignore that connection.

The tool works. The question is whether we'll design the pedagogy around it well enough to matter.

Link in the first comment!



References
Fan, Y., Tang, L., Le, H., Shen, K., Tan, S., Zhao, Y., Shen, Y., Li, X., & Gašević, D. (2025). Beware of metacognitive laziness: Effects of generative artificial intelligence on learning motivation, processes, and performance. British Journal of Educational Technology, 56(2), 489–530.

Kosmyna, N., Hauptmann, E., Yuan, Y. T., Situ, J., Liao, X.-H., Beresnitzky, A. V., Braunstein, I., & Maes, P. (2025). Your brain on ChatGPT: Accumulation of cognitive debt when using an AI assistant for essay writing tasks. MIT Media Lab.

Shaw, S. D., & Nave, G. (2026). Thinking fast, slow, and artificial: How AI is reshaping human reasoning and the rise of cognitive surrender. Working paper, The Wharton School, University of Pennsylvania.

Wang, J., & Fan, W. (2025). The effect of ChatGPT on students' learning performance, learning perception, and higher-order thinking: Insights from a meta-analysis. Humanities and Social Sciences Communications, 12, 621.

09/08/2025
11/05/2023

Reading about reading helps us understand reading.

The IDA 2023 Annual Reading, Literacy & Learning Conference is abuzz! 🌟📚

Come see us at booth #410 and get your all-new book, Science of Reading 2.0! It's packed with the best practices and inspiration you need to implement the science of reading and transform literacy in your school or district.

We look forward to seeing you soon! 🙌

IMPROVING SCHOOLS INC 12/30/2022

Happy end of ‘22, friends.

If you’re still looking for that tax-deductible donation to make before year end, look no further. 🙂

We are continuing the good work of making education more equitable by supporting schools in need.

Read more about us and click the donation button here or at www.improving-schools.org

Thank you and wishing you all health, happiness, and equity in 2023.

IMPROVING SCHOOLS INC Improving Schools Inc is a non-profit educational services provider focused on improving outcomes for all students.

IMPROVING SCHOOLS INC 11/29/2022

We’re less than 24 hours away from and you can DOUBLE YOUR IMPACT!!

Make a donation in support of Giving Tuesday a generous donor will MATCH every $1 raised, up to $5,000!! https://improving-schools.org/

Thank you for your support and for making an impact!

IMPROVING SCHOOLS INC Improving Schools Inc is a non-profit educational services provider focused on improving outcomes for all students.

Want your school to be the top-listed School/college in New York?

Click here to claim your Sponsored Listing.

Location

Telephone

Address

New York, NY