A study of 26,000 students found a pattern hiding behind good grades
A new study tracking 26,000 students found that when students used AI to help with homework, their homework scores rose 18%. On its own, that looks like a clear win for AI-assisted learning.
But researchers followed up roughly six months later with closed-book exams — no AI allowed — for the same students. On those exams, scores fell 20%.
Why the drop happened
The study points to a specific behavior behind the numbers: an estimated 80% of the students using AI were found to be quietly outsourcing their thinking. Rather than using AI to check their work or get unstuck after a genuine attempt, they were using it to produce the answer directly — skipping the effortful practice that builds real understanding.
The homework still got turned in. The grade still looked fine. But the underlying skill — the ability to solve a similar problem without help — never got built. That gap stayed invisible until an exam stripped the AI assistance away.
What this means for parents
A strong homework grade isn't reliable proof that your child understands the material, especially when AI tools are part of how the homework gets done. A more useful check than the grade itself:
Ask your child to explain the concept out loud, with no AI open.
Have them try a similar problem from scratch and see how far they get unassisted.
Treat AI-assisted homework as a first draft to understand, not a finished product to trust blindly.
What this means for teachers
Detecting the gap after the fact — on a graded exam — is the expensive way to find out. A cheaper, earlier signal is a quick, low-stakes closed-book check: a short quiz, a verbal walk-through, or an in-class problem that mirrors the homework. These catch the difference between "the assignment got done" and "the student can actually do this" before it shows up on something that counts.
The bottom line
AI can absolutely help students learn — but this study is a clear example of how it can also let students look like they're learning while actually falling behind. The difference comes down to whether AI is used to understand the material or to skip understanding it. Six months is not a long horizon; families and schools that build in regular no-AI checks now can catch the gap while it's still small.
▶ Watch the 30-second video version: https://youtube.com/shorts/GyEtwP3hOyA
Want practical AI guidance for parents and educators every week?
Subscribe: https://www.aibyage.com/?modal=signup&utm_source=beehiiv&utm_medium=newsletter