Skip to content
Back to the collection

Your Brain on ChatGPT: Accumulation of Cognitive Debt when Using an AI Assistant for Essay Writing Task

Nataliya Kosmyna, Eugene Hauptmann, Ye Tong Yuan

Show all 8 authors

Jessica Situ, Xian-Hao Liao, Ashly Vivian Beresnitzky, Iris Braunstein, Pattie Maes

2025 · arXiv

Read the paper
HN score
1
Mentions
25
Readers
18
Months
9
What’s in a score?

From the abstract

This study explores the neural and behavioral consequences of LLM-assisted essay writing. Participants were divided into three groups: LLM, Search Engine, and Brain-only (no tools). Each completed three sessions under the same condition. In a fourth session, LLM users were reassigned to Brain-only group (LLM-to-Brain), and Brain-only users were reassigned to LLM condition (Brain-to-LLM). A total of 54 participants took part in Sessions 1-3, with 18 completing session 4. We used electroencephalography (EEG) to assess cognitive load during essay writing, and analyzed essays using NLP, as well as scoring essays with the help from human teachers and an AI judge. Across groups, NERs, n-gram patterns, and topic ontology showed within-group homogeneity. EEG revealed significant differences in brain connectivity: Brain-only participants exhibited the strongest, most distributed networks; Search Engine users showed moderate engagement; and LLM users displayed the weakest connectivity. Cognitive activity scaled down in relation to external tool use. In session 4, LLM-to-Brain participants showed reduced alpha and beta connectivity, indicating under-engagement. Brain-to-LLM users exhibited higher memory recall and activation of occipito-parietal and prefrontal areas, similar to Search Engine users. Self-reported ownership of essays was the lowest in the LLM group and the highest in the Brain-only group. LLM users also struggled to accurately quote their own work. While LLMs offer immediate convenience, our findings highlight potential cognitive costs. Over four months, LLM users consistently underperformed at neural, linguistic, and behavioral levels. These results raise concerns about the long-term educational implications of LLM reliance and underscore the need for deeper inquiry into AI's role in learning.

Metadata: arXiv. Abstracts retain their original authors’ rights.

In the conversation

Original HN comments, with labels from simple text rules. A label describes the whole comment and may miss context or irony. Read the discussion to make up your own mind. About the labels

20 selected excerpts · 25 total mentions

dcre
Recommendation · rule
I recommend people look at the actual study and think about how representative are the subjects, the tasks involved (SAT essay writing), and the way LLMs are being used. https://arxiv.org/abs/2506.08872 To be concrete, this is taking a task in isolation that LLMs can do much better than humans (writing garbage essays) and using LLMs to do that task. In the real world, tasks have parts and they exist in a larger context. When we use LLMs for one part of a task, there are other things we're doing that the LLM is not helping with. If you compared people doing arithmetic by hand and with a calculator, you would also see very big differences in how active their brains are. But it's not anyone's job to add up numbers. Adding up numbers is a subtask of a subtask in someone's job.
dakolli
Neutral mention · rule
The fact that you're even saying this it is probably an admission that you do think it's making you dumber. Most people I know, who are honest with themselves, have admitted to me that they feel like it's making them dumber or "zombifying" them. This is also well studied already, https://arxiv.org/abs/2506.08872 LLMs are poison for the brain, I'm almost certain of it, at least when used in the way most people are using them. If you drive everywhere because you don't want to walk (but you could), you're obviously going to be physically worse off than if you walked. This is the case with llms, if you have them do all the thinking, planning and action you're going to be cognitively worse off than if you didn't use them.
bendriv
Neutral mention · rule
Completely agree, and I think outsourcing critical thinking to AI is a bad idea for learning. Here is one study that researched AI assistance in a writing/learning context: https://arxiv.org/abs/2506.08872. The teachers that have instructed using AI for assistance in our school seems focused on teaching how to technically use specifically ChatGPT (that particular product, not AI in general), and on the courage to speak in front of people. Learning how to speak in front of people is a noble goal, but I believe any person would be better prepared for speaking if they had done the hard work of writing in the first place.
rsoto2
Neutral mention · rule
hm social media maybe you could consider causes cognitive decline similar to what is theorized about over-reliance on an llm. edit: https://arxiv.org/abs/2506.08872
latexr
Neutral mention · rule
> When I read pieces like this all I think is, resistance to change is a helluva drug. When I read comments like yours, I’m reminded of (though I’m not comparing you to—I believe you are arguing in good faith) the cryptocurrency shills saying anyone who is against cryptocurrencies is just jealous they didn’t get in on the gold rush; they are incapable of imagining or accepting other people have their own reasons beyond what the author can themselves conceptualise. When people criticise cryptocurrencies, NFTs, the Metaverse, LLMs, they’re not just stubbornly “resisting change”. Those technologies have important issues and repercussions which should be addressed, we…
Read the full comment
shouldn’t just accept change unquestionably. > Of course, this all depends on using AI to enhance cognition and access to knowledge, as opposed to just letting a machine write all your code for you without review, Yegge-style. And the latter is exactly what is going to happen and is already happening in large enough quantity that it’s going to be a serious problem. > But the one about "endangering human development" is wholly in our individual hands. You can use AI to help you learn, or to replace the need to learn. That completely ignores the loss of skill that happens without you realising, as you lean more on a tool. https://www.thelancet.com/journals/langas/article/PIIS2468-1... https://arxiv.org/abs/2506.08872 This is nothing new. We already know that e.g. heavy GPS use makes us weaker at navigating on our own. https://www.nature.com/articles/s41598-020-62877-0 > One real lesson from this is perhaps that we need to teach people how to use AI in ways that benefit their development, not just their output. Yes, that is a good goal. But good luck achieving it.
cafebabbe
Neutral mention · rule
Socrates was proven dead wrong by neurobiology. LLMs making you dumber is far from being "disproved" by science. Quite the opposite https://arxiv.org/abs/2506.08872
Der_Einzige
Neutral mention · rule
Yup, this is SUPER AI generated. Next time OP that you want to lie about using LLMs, either use the techniques from our paper: https://arxiv.org/abs/2510.15061 Or if you're more lazy, there's a "logit_bias" technique which you can use to ban the em-dash in language models. But you were too lazy to do that, and you lied about not using AI. Shame on you big time. Also, even if you somehow didn't AI generate this, you sure as shit got infected by the LLM mind-virus and now you write/talk like it. That's basically just as bad. Either square up with proof that you overused EM dashes before late 2022 (like Dang!) or fix your writing…
Read the full comment
style. https://arxiv.org/abs/2409.01754 https://arxiv.org/abs/2508.01491 https://aclanthology.org/2025.acl-short.47/ https://arxiv.org/abs/2506.06166 https://en.wikipedia.org/wiki/Wikipedia:Signs_of_AI_writing https://osf.io/preprints/psyarxiv/wzveh_v1 https://arxiv.org/abs/2506.08872 https://aclanthology.org/2025.findings-acl.987/ https://aclanthology.org/2025.coling-main.426/ https://aclanthology.org/2025.iwsds-1.37/ https://www.medrxiv.org/content/10.1101/2024.05.14.24307373v... https://journals.sagepub.com/doi/full/10.1177/21522715251379... https://arxiv.org/abs/2506.21817
agentultra
Neutral mention · rule
Traditional engineering involves more than talking to people, teams, and trade offs. Where I live the engineering society here does license software engineers now and enforces the term, "Software Engineer," as a protected term. You can't just call yourself a software engineer. You have to have educational credentials, pass exams, and be licensed. You have to keep up with your educational requirements. You have to be insured. It boils down to the same thing, people and teams, but the difference is liability. Personally I think we're better off pair programming with actual people than GenAI chat bots. We get to teach each other and learn together which improves our skills.…
Read the full comment
We actually need to socialize and be around people to remain healthy. You miss out on all of these benefits with chat bots. And there's growing evidence that you don't learn as much when using them [0]. Consider when using them is appropriate and maybe don't rely on them for everything. [0] https://arxiv.org/abs/2506.08872
tomrod
Neutral mention · rule
A few things to note. 1. This is arxiv - before publication or peer review. Grain of salt.[0] 2. 18 participants per cohort 3. 54 participants total Given the low N and the likelihood that this is drawn from 18-22 year olds attending MIT, one should expect an uphill battle for replication and for generalizability. Further, they are brain scanning during the experiment, which is an uncomfortable/out-of-the-norm experience, and the object of their study is easy to infer if not directly known by the population (the person being studied using LLM, search tools, or no tools). > We thus present a study which explores the cognitive cost of using an LLM while performing the task…
Read the full comment
of writing an essay. We chose essay writing as it is a cognitively complex task that engages multiple mental processes while being used as a common tool in schools and in standardized tests of a student's skills. Essay writing places significant demands on working memory, requiring simultaneous management of multiple cognitive processes. A person writing an essay must juggle both macro-level tasks (organizing ideas, structuring arguments), and micro-level tasks (word choice, grammar, syntax). In order to evaluate cognitive engagement and cognitive load as well as to better understand the brain activations when performing a task of essay writing, we used Electroencephalography (EEG) to measure brain signals of the participants. In addition to using an LLM, we also want to understand and compare the brain activations when performing the same task using classic Internet search and when no tools (neither LLM nor search) are available to the user. [0] https://arxiv.org/pdf/2506.08872
jrflowers
Neutral mention · rule
> a billion people are using an app that adds absolutely nothing to their lives each week I like this reasoning. If something is popular it is objectively good. For example 21.7% of adults on earth use tobacco, so it must be good then. https://data.worldbank.org/indicator/SH.PRV.SMOK?name_desc=f... Except for TikTok, which is bad because people share their experiences of chat bots not being very good on there. As an aside, “dumb” is subjective, though if we had to put a label on it, “consistently underperformed at neural, linguistic, and behavioral levels” sounds like it could be something? https://arxiv.org/abs/2506.08872
djoldman
Neutral mention · rule
The referenced study is quite the doozy: > We assigned participants to three groups: LLM group, Search Engine group, Brain-only group ... to write an essay. We recruited a total of 54 participants... > We used electroencephalography (EEG) to record participants' brain activity in order to assess their cognitive engagement and cognitive load, and to gain a deeper understanding of neural activations during the essay writing task. We performed NLP analysis, and we interviewed each participant after each session. We performed scoring with the help from the human teachers and an AI judge (a specially built AI agent). > We discovered a consistent homogeneity across the Named…
Read the full comment
Entities Recognition (NERs), n-grams, ontology of topics within each group. EEG analysis presented robust evidence that LLM, Search Engine and Brain-only groups had significantly different neural connectivity patterns, reflecting divergent cognitive strategies. Brain connectivity systematically scaled down with the amount of external support... And then: "...in this study we demonstrate the pressing matter of a likely decrease in learning skills based on the results of our study." I'm not sure "likely decrease in learning skills" is quite right here. [0] https://arxiv.org/pdf/2506.08872v1
bdbenton5255
Neutral mention · rule
Strangely enough, I work with AI models as a programmer and do not use any AI tools to code. The creation of "cognitive debt" as AI researchers describe it means that crucial components of my code are offloaded into a black box understanding. https://arxiv.org/abs/2506.08872 "Across groups, NERs, n-gram patterns, and topic ontology showed within-group homogeneity. EEG revealed significant differences in brain connectivity: Brain-only participants exhibited the strongest, most distributed networks; Search Engine users showed moderate engagement; and LLM users displayed the weakest connectivity." In other words, working with LLMs reduces the level of engagement in our…
Read the full comment
brains and offloads much of our cognitive activity. When working with models that require a high level of abstraction and optimization, offloading these tasks to LLMs that essentially scrape and combine code from various sources can lead to disaster. For something like a basic CRUD app such factors are not nearly as important. I can see the future convergence of two clear trends in software: No-code tools and AI tools. The development of AI agents which handle not only the generation of code but the full development cycle of creating, testing, and deploying projects with a limited level of programming knowledge required. As an additional note: Both of these software trends aim to automate and replace many responsibilities of the programmer in a commercial sense. I believe that future programmers will need to become familiar with these emerging technologies in order to remain competitive in the job market. Namely, math skills. Linear regression, multivariable calculus, the sort of math applied by scientists and researchers. If you do not understand the mathematics at the core of neural networks, now is the time to learn.
lexandstuff
Neutral mention · rule
Maybe, but there's also some evidence that AI coding tools aren't making anyone more productive. One study from last year found that there was no increase in developer velocity but a dramatic increase in bugs.[1] Granted, the technology has advanced since this study, but many of the fundamental issues of LLM unreliability remain. Additionally, a recent study has highlighted the significant cognitive costs associated with offloading problem-solving onto LLMs, revealing that individuals who do so develop significantly weaker neural connectivity than those who don't [2]. It's very possible that AI is literally making us less productive and dumber. Yet they are being pushed by subscription-peddling companies as if it is impossible to operate without them. I'm glad some people are calling it out. [1] https://devops.com/study-finds-no-devops-productivity-gains-... [2] https://arxiv.org/abs/2506.08872
trod1234
Neutral mention · rule
Cloud was a nice promise that was broken all too quickly. This is why cloud repatriation is a growing trend, that and a growingly brittle cloud with outages that are outside anyone's control, and the costs unmanageable. There are also business sectors where they never could fully go cloud-only because of regulatory. Bio-pharma for example. > the role of System Administrator was practically eliminated. You don't have an SA just exclusively work on infrastructure, you do have them as generalists that know your environment and systems, and can have them quickly troubleshoot, modify, and resolve UB issues and outages when something breaks on Sunday night on Christmas Eve, or…
Read the full comment
have the DR required equipment on-site to ensure generators are up right after Hurricane Sandy passes, and pre-emptively handle issues before they become outright disasters. Anyone thinking you can have helpdesk do this isn't right in the head. > I think LLMs have absolutely nothing to do with this. There are a growing number of places that get lock-in contracts where the SA related services they offer are being done by helpdesk staff manning LLM based chatbots without disclosure, blindly. This obviously works right up until it doesn't, and by the time people notice the fundamental issue, the competent people the company needs won't be around anymore with a vicious race to the bottom. These helpdesk people may be manning 3 or more chatbots simultaneously in a foreign country while pulling in the same as retail fast food in California. No SA can compete with nominally free slave labor, and these people don't care about Information Governance and unauthorized data disclosures. Any seasoned SA worth their salt will be capable of automation in python and powershell at a fairly advanced level if they're MS centric, and python/bash for Linux. DevOps Engineer, Architect, SRE all have quite a lot of overlap with a competent SAs, but SAs aren't getting these jobs. There's no path to getting those jobs, and the actual stats and hiring being done seems to indicate there aren't many people getting these positions, and they are almost universally grey beards. No one going in, no one coming out, what happens when they die/age out/flame out... The related IT systems fail in growingly chaotic trends, and related production grinds to a halt. It becomes just like the ending of Ayn Rand's Atlas Shrugged, but without the new beginning. LLMs aren't a substitute for people, but companies are using them as such, and there is an increasing body of literature showing that LLM use increases cognitive debt. (https://arxiv.org/abs/2506.08872)
dakolli
Neutral mention · rule
Its because the people that are eager to develop with llms are talent-less and have no brain muscle of their own left, they're letting the connections between nuerons atrophy with every prompt they send (literally)[0]. [0]: https://arxiv.org/abs/2506.08872
dakolli
Neutral mention · rule
This is already studied, people do not retain knowledge when learning with AI. Learning with AI only creates the most mediocre of people, I've witnessed this myself over and over and over again over the last couple of years. Read a book, write, think and you'll be fine. Use LLM and your brain is going to become completely reliant on its ability to access some billionaires thinking machine in order to read and write. You will be a second class citizen who has no differentiating skills. You will end up not being able to write anything on your own or solve problems independently without paying a billionaire, just like how nobody can navigate without Google Maps anymore. https://arxiv.org/abs/2506.08872

Keep following the thread.

More in Neuroscience

More from the same topics.

2018arXiv

Talent vs Luck: the role of randomness in success and failure

A. Pluchino. A. E. Biondo, A. Rapisarda

The largely dominant meritocratic paradigm of highly competitive Western cultures is rooted on the belief that success is due mainly, if not exclusively, to personal qualities such as talent, intelligence, skills, efforts or risk taking.

16 mentions14 months
2.5HN score