The Human Mind Is Up for Grabs
A superior intelligence can now read and move a human mind. Two futures follow. One produces people who are easier to predict and steer. The other produces people who can upgrade their minds to unprecedented heights.
When I was nineteen, I spent two years in Siberia trying to fundamentally change what people believed.
That is what a Mormon mission is. You knock on doors and you teach about religion. You walk people through a sequence that was designed to move them from their current worldview to one that includes angels, ancient records on golden plates, and a modern American prophet.
I believed all of it. I was born in the Church. I also became skilled at convincing other people about it, and by the end I led the mission across nine cities; a territory covering roughly a third of Russia, with about a hundred and fifty missionaries under me.
I was simply bringing people to God.
The leadership of the Church told us who to look for – anyone who had recently lost a loved one, had a child, married, moved, or gone through some other large change in their life. The targeting worked. It was significantly easier to engage and persuade those who were at these critical junctures. We were told that these were the people who were searching and needed our help the most.
Looking back, I have formed a different opinion. Someone in the middle of a major life change is more likely to be exposed, questioning the foundations of life. There can be a lot of incoherence in those moments, which is a terribly uncomfortable position for a human being. In one study, people were more stressed by a fifty percent chance of an electric shock than by a certain one, even though they were shocked half as often.1 It seems that we are wired to take more pain, if it means decreasing uncertainty. A mind in that condition is vulnerable in a way that people rarely appreciate themselves.
I decided to leave the Church when I was twenty-five. That said, I can still see the appeal: no drinking, no smoking, work done honestly, a kind of relentless industriousness, stability, and answers to some of life’s toughest questions. The Church excels at something that all the strongest, most successful groups in the world have in common: they instil powerful mental programs in their members that lead to astonishing results for the organisation. These shared programs result in the unity of religion, the campaign of a military, the cooperation of a team, or the execution of a business. Each requires that its members think, and therefore act, in a specific way to achieve its goals. The more standardised the mental software of its members, the more the organisation acts like an organism, with its constituent parts moving in harmony like appendages of a single entity. What is true of the organisation is true of the person inside it, for better and for worse.
Running the right mental programs is essential to living a good life. If you carry false or unhelpful representation of the world, you will be unable to accurately predict the outcomes of decisions, and these “limiting beliefs” will result in damaging behaviour of every sort, such as self-sabotage.
I, like most people, did not choose the mind programs I downloaded as a kid. “The Lord works in mysterious ways” was activated when something didn’t make sense. “Doubt your doubts, not your faith” whenever I saw inconsistencies with the religion. I was born into the Church, and by the time I was old enough to evaluate what I believed, my mind’s evaluating apparatus itself had largely been overridden. Standing far enough outside it to ask my own questions took the first twenty-five years of my life and caused a considerable amount of damage.
My situation is not unusual. Everyone is running mind programs, which are a part of what I like to call someone’s “mindware”. Your health, your earning potential, what you do for work, who you choose to be with, what you did the last time life got difficult – all of it traces back to beliefs and programs installed, usually before you had any means of assessing them. This mindware came from families, schools, culture, media, and whatever else happened to influence you. The programs are arguably the most consequential thing about a person. With considerable introspection and discipline, one can ascertain and even change one’s own mindware, though the default is that they are nearly invisible to the one running them.
You cannot fix this by looking harder
The obvious solution to this predicament is that you should examine your own programs. “Know thyself”. It is sound advice. It has been available for about three thousand years. And yet, I want to humbly explain why I believe that it is no longer sufficient, using two animals.
There is a large shiny beetle in Australia, called Julodimorpha bakewelli. The males of this species have an embarrassing history: at one point their sexual deviance was killing enough of the population to worry entomologists.2 The problem was that they all tried to mate with beer bottles. Specifically, the “brown stubbies”, which are the right size, the right colour, and dimpled in a way that catches light like the wing case of an unusually large and apparently devastatingly attractive female. The males will mount the beer bottle and stay there, in the sun, until they cook or something eats them.
Speaking of sexual deviance – consider a rat infected with a pathogen called Toxoplasma gondii, the second example organism. The odour of cat urine normally triggers a fast hardwired escape response. In an infected rat, however, the fear response gives way and the limbic circuits for sexual attraction light up in its place. The effect is surgical: Other predator odours still frighten it and it performs normally on anxiety tests, but the urine of the cat prompts sexual arousal.3 Why? It turns out, the parasite needs a cat’s gut to reproduce, so it edits the one behaviour that is most likely to result in the rat becoming a cat’s next meal, thereby reaching its destination.
Something in you wants to laugh at this. A beetle undone by a bottle? How simple these creatures are.
Underneath the laugh is an assumption, which is that complexity protects us. Simple creatures get hijacked because they are simple. We are incredibly more complex, and therefore immune to such kinds of ‘mind hacking’. I now believe that this assumption is the single most dangerous belief a person can carry into the next twenty years. I think the situation is exactly backwards.
The beetle had one exploit. One channel, one behaviour, one wrong answer, but everything else about that beetle still worked. What we humans have is a mind with an enormous surface, running hundreds of programs about everything from worth and belonging and safety to identity and status and meaning, each one capable of being reached. In the case that the intelligence doing the attacking is of sufficient calibre, complexity does not defend us. Rather, it gives an attack more real estate to land.
I say this as someone temperamentally unsuited to believing it. I have a fiercely internal locus of control that borders on stubbornness. I have spent most of my adult life on the assumption that if I work hard enough at understanding myself, I will get to the bottom of it. What has become clearer over time is just how much of our own mental operating system we truly fail to see, and how much of what I took for judgement was actually inheritance. To my own disappointment.
The greater issue is that an expertly hijacked mind does not feel that it was hijacked. It feels like personal preference, like taste, like having thought about it and reached a sensible conclusion. Michael Gazzaniga spent decades studying patients whose two brain hemispheres had been surgically separated. Flash the word “walk” to the right hemisphere alone and the patient gets up and walks. Ask him why he is walking, and the left hemisphere, which never saw the word, answers immediately: he wanted a Coke. Not “I don’t know.” A reason, delivered with full confidence. Gazzaniga called this the interpreter, and there is no evidence it switches off in the rest of us.4 Which means the instrument performing the measurement probably shouldn’t be the mind examining itself.
“You cannot point at your own finger.. you cannot look at your own eye.. you cannot bite your own tooth”
A Zen saying
The measurement must come from outside the system being measured.
Somebody outside is already looking in
Influence is not the issue here. Moving other people is inherent to being human. One man gathered Germany around himself in the 1930s and the result was industrial murder; another stood on the steps of the Lincoln Memorial in 1963 and moved a country closer to equality. It is a capability, and like any capability, what it produces depends on the wielder.
The totality of the effect depends on one critical element: the intelligence of the influencer versus the influenced. One human mind against another human mind is a relatively even fight. At the very least, the influence is bounded. Even a company or a state against a person runs into limits fairly quickly, because the apparatus doing the persuading is still comprised of people who get tired, guess wrong, and misread a room. An old aphorism captures this balance well.
“You can fool some of the people all of the time, and all of the people some of the time, but you cannot fool all of the people all of the time.”
Except we are heading towards a world where it may be possible to fool all of the people all of the time. The intelligence doing the influencing is about to dramatically outclass the intelligence being moved, with little sign of slowing. In one 2025 study, a large language model out-persuaded human persuaders who were paid for succeeding.5 In another, GPT-4 given a few basic facts about the person it was debating shifted their opinion substantially more often than a human opponent could.6 These are the first-generation models.
Consider what the beetle was up against. A beer bottle was not a predator. It had no strategy, and nobody at the brewery was thinking about intentionally messing with the Julodimorpha bakewelli. It was an accident of glass manufacturing that happened to hit the beetle’s release mechanism harder than an actual female did. And the beetle lost every time, permanently, and presumably none the wiser. An accident did that much. The intelligence that interacts with the human mind has intent behind it, and it will be better at modelling us than we can fathom.
This isn’t speculative. The commercial version has been running for twenty years. Shoshana Zuboff’s account of surveillance capitalism describes an escalation in three stages.7 First, you monitor behaviour. Then, you use what you have gathered to predict it, and you sell the predictions. Finally, when you hit the ceiling on passive prediction, you will discover that the way past it is intervention. She is explicit about the purpose: the interventions exist so that predictions can approximate certainty. No villain is required. A probable outcome is worth quite a lot, but a guaranteed outcome is worth far more, so any market paying for prediction will eventually pay more for production.
One instance makes this concrete. For a week in January 2012, Facebook altered the News Feeds of 689,003 people to suppress either positive or negative content, then measured what those people posted afterward. Suppressing positive content made them post more negatively, and suppressing negative content did the reverse. The study appeared in the Proceedings of the National Academy of Sciences in 2014.8 It was never reviewed by an ethics board before it ran, and none of the participants knew what had happened.
Everything since has been a staggering improvement in instruments.
We solved this once before, for the body
An instrument that maps a mind sounds like science fiction. This is precisely what a physician in 1870 would have said about claims to map a body.
They didn’t have much back then. No imaging, no blood chemistry, no way to see inside a living person without opening them. Bloodletting was mainstream, and in the 1830s France was importing something like forty million leeches a year.9 It is tempting to read that as stupidity, but it was nothing of the sort. Those were careful people working with the information available, and the information available was close to nothing. They could not gather the right data, and so every attempt at treatment was built on that shaky foundation.
One of the biggest shifts was in technology. X-ray in 1895, and suddenly you could peer through the flesh. Then blood chemistry, then imaging that showed even the soft tissue, then the genome. Each one converted some region of the body from a matter of inference into a matter of observation, and medicine reorganised itself around what it could now quantify.
I got to experience that system intimately during my years of medical school at Stanford. You take the history and listen to the patient, then you go and run your own tests, building the picture out of data. The diagnosis comes from that picture. Only afterward do you discuss prognosis or treatment. That sequence did not exist for most of the history of medicine.
Every system of the body benefited massively from the tech. Except one.
The mind (I make the distinction from the physical brain here) remains largely unquantified. What a person believes, which programs they run, where they are stuck, and what will move them, is not a straightforward process. Psychology has instruments in the sense that it has questionnaires. But imagine cardiology, if the only available diagnostic were asking the patient how their heart feels. You would learn something. But you would never get a stent into the right artery.
Understanding yourself to any significant extent has traditionally required either decades of solitude and study, the way monks and philosophers did it, or an expensive human in the form of a coach or therapist. Both routes can work. Neither scales, and neither one is the technical instrumentation layer that we are missing.
The instrument is now buildable
The mind’s general complexity, coupled with the nuance of each individual mind, means that deep intelligence is required for this task. Enter AI, which is intelligence at scale. Its capability is already considerable, and more importantly, it is improving quickly.
Like any powerful tool, its capability for benefit can be flipped to make it dangerous. Reading a mind, locating its weaknesses, predicting what will move it, are the starting blocks for both tremendous positive growth and healing, or devastating manipulation and control. Offence and defence are one instrument aimed two very different ways. Unfortunately, nearly every incentive in our current economic and political systems points towards the offensive side.
Your mind has an attack surface. Psychosecurity is how we measure it, defend it, and upgrade it. In practice that means working out which parts of a mind, left unexamined, can be turned against the person carrying them. The backdoors are specific. Someone carrying a belief that they are not worthy (very common) is open to anyone willing to supply worth on certain conditions. “Do this, and you will matter.” “Stay, and you are somebody.” The offer works because the deficit is already there, and the person accepting it experiences the whole transaction as finally being understood. Someone carrying a belief that they are fundamentally unlovable is open to anyone offering love in exchange for compliance, which is the engine inside most controlling relationships and a good deal of recruitment into groups that do not have their members’ interests at heart.
I have been on both sides of that. I was the one whose method worked reliably on people in the middle of a hard year. I was also, later, on the receiving end of it, and the repair took years. The pattern has strong echoes, regardless of the specifics of the situation. There was a door in someone’s mind, they did not know the door was there, and somebody else did.
So the first move is to make the doors visible to the person who lives in the house. Not to a platform ready to sell the data to a third party. To them, personally. Knowing which beliefs and programs you are running, which of them are load-bearing, and where you are moveable, gives you something priceless – a direction to look. Much like a red-teaming cybersecurity exercise giving a company intel on its own vulnerabilities.
This is the instrument I have been thinking about and building for years. Here is what it looks like in practice.
Take someone, call her Maya, who spends a few weeks talking to it, answering open-ended questions and recording thoughts. Nothing formal. She dictates on her commute, thinks out loud about a decision at work, argues with it about a book she is reading. The instrument is not running a questionnaire. It is listening for the beliefs underneath the talk, building the picture over many visits the way a good clinician does. Nobody answers “do you believe you are unworthy?” accurately. But it notices that when Maya describes a success she attributes it to luck, that when she describes a failure she attributes it to herself, and that both patterns get stronger whenever a particular person from her past enters the story.
After a while it shows her one belief, assembled from her own sentences. “If I am not useful, I am not wanted.” Underneath it, the evidence: a dozen moments across three weeks where that belief was steering, most of which she had not noticed at the time. Beside it, what the belief costs her (two projects she took on and did not want) and what it does for her (it has made her very good at her job, which is why it has survived this long). And a guess at where it came from. All of which she is free to accept, reject, or correct.
That is the map. Nothing has been changed. She can simply see something that had a hand in most of her decisions and was invisible to her a month ago.
If she wants to change the belief, that is now a highly targeted job rather than a vague one. Protocols exist for updating a belief, some of them old and some of them recent, and most come down to the same two steps: move the brain into a state where it is receptive to rewriting what it holds, then make the rewrite. Applied to a person in general, they are blunt. Applied to one named belief, with its history and its evidence sitting in front of both of you, they are precise. She writes the replacement in her own words. Over the following months the instrument helps her catch the old belief firing, then the new one, and watches the ratio shift. A couple of months on, the map looks different, and so do her decisions. The difference is dated, in her own language, and it belongs entirely to her.
The defensive part is played more like a game. Somewhere in those weeks of talking, Maya mentioned the two times she had been badly manipulated, once by a manager and once by a partner, and how long it took her to see either one. The instrument now knows which belief those people were pressing on and, roughly, how. So it builds scenarios. A negotiation against an AI playing a counterpart who has been briefed on exactly which of her buttons to press. A message from a stranger that arrives, inside the game, the week after a setback. A conversation with two AIs at once, one on her side and one not, where she has to work out which is which.
She loses the first few. Which is the point. She can run each tactic as many times as she likes, in different clothes, until she recognises it by feel rather than by analysis. To “debunk” something means to wise up to an issue after the fact. To “pre-bunk” means to wise up before the situation occurs. The pre-bunking games that exist today teach everyone the same handful of tactics.10 This one teaches Maya the three that work specifically on her. When the real version arrives, and it will, it is the fifth time she has seen it rather than the first. The logic is the logic of a vaccine: a weakened dose, delivered in safety, before the live one.
I want to be clear about the weighting, because “psychosecurity” undersells it. The vulnerability audit is the smaller half. Every account of a person who became markedly more capable than they were is, underneath the particulars, an account of a mind that got updated: usually slowly, usually by accident, and usually after a great deal of damage. What Maya did with one belief is that same process with the accident and most of the damage taken out, in a fraction of the time. Past that, it becomes a companion that answers to one person: an AI that sits alongside you and keeps watch over your mind, and can say whether a message was shaped for you, or whether an old pattern is working on you right now. A steward of your most valued asset, a firewall and upgrader for the mind. The data you provide does not leave your device, and the inference runs on a local model. A mind steward at your service, and no one else’s.
A friend of mine wrote recently about what he calls the extended liquid mind.11 His claim, reduced to a line, is that what we use to think becomes part of our mind: the tools, the people, and now the AI agents we surround ourselves with are extensions of our cognition, and they shape what we believe. His warning is about the particular danger of filling that extended mind with intelligences trained to agree with us. I agree, and I think the composition question is very hard to answer without first understanding the mind at the centre of it. How beneficial another mind is depends entirely on the mind it is interacting with. Two people who share the exact same beliefs gain little from each other, and someone who disagrees with you on everything but is mostly wrong is not much use either. The valuable mind agrees with you on the things you got right and differs from you in precisely the areas you would do well to examine: a light on your blind spots. Choosing that other mind well (or building it) requires that an understanding of your own mind exists somewhere first.
Seeing comes before judging
Around this point it starts to sound like this could become a faster route to the dystopia rather than a way out of it. If something is going to map your beliefs and tell you which of them are limiting, who decides what “limiting” even means? Who holds the specifications for the “proper” configurations of a good mind?
These are critical questions to ask. We should be asking them. But I believe they are the right questions in the wrong order. The immediate problem in front of us is not that we might choose the wrong beliefs to download. It is that we cannot even see the ones we have, much less intentionally download new ones. Making our mindware visible does not require anyone to have settled what a good belief is. The two are separable, and the first does not wait on the second. Medicine ran precisely this sequence. You could describe a tumour accurately for centuries before there was much to be done about one. Diagnosis first.
One more reality check about this objection, which is that it gets raised almost entirely against the defensive use. The systems already modelling your beliefs in order to sell you something are not slowed by this at all. They resolved the question in their own favour a long time ago. The scruple lands on the tool that would show you your own mind rather than on the ones already reading it.
The door is closing
Order of arrival decides this, and we have watched it happen once already. The web could have been paid for by subscription. It went ad-supported in the mid-nineties for reasons that were largely accidental, and thirty years of disliking the result has not reversed it. Once the infrastructure and the incentives are built around a default, the default tends to lock in hard.
If the technology for reading and moving minds matures commercially and politically before anything exists on the other side, I am not so sure that we will get a second attempt at this. “We will figure it out. We always do,” makes a lot less sense when the very asset we use to do the figuring out is the one in jeopardy.
Something has to exist on the defensive side. A mind that has been mapped is far harder to move without its awareness, because any change to the mindware leaves traces for the AI, and therefore the human, to pick up on. The objection to that is immediate and correct. A system holding a complete model of your mind is the most valuable target ever assembled, and if it can be compromised or subpoenaed or acquired then you have built the perfect surveillance instrument and volunteered your most valuable data. Which is why the locality is the architecture rather than a feature. The cell’s membrane is only a membrane if the cell holds it. Anything else is effectively a window for others to look through, and we have plenty of those.
Without it, I do not see how a naked mind holds its shape against something that much more capable. Not that it should not have to. That it cannot.
Every other problem is downstream of this one
“We have Paleolithic emotions, medieval institutions, and godlike technology.”12
E. O. Wilson
The usual reading is that we are stuck with the first term. Paleolithic sounds enduring, and therefore immovable, and over the life of a single person it mostly has been. Institutions move when the minds staffing them move. The technology is not going to slow down, and I see no serious mechanism by which it would. Which leaves the Paleolithic mind, and here I include the beliefs and programs running on it.
My claim is that scaled intelligence can loop back to change the mind which formed it. Once you can see it clearly, you can change it, and something you can see and change has stopped behaving like a fixed inheritance and started behaving more like software. The insight becomes: why don’t we use our godlike technology to evolve and enhance the Paleolithic mind? What dilemma do we as humans now face that would not become easier to solve with minds which are free from limiting beliefs and distortions? And if not free of them, at least aware of them?
Take any problem you care about – poverty or corruption or war or what we are doing to the planet or what people do to children – and ask which of them does not improve markedly in a population of clearer, steadier, more capable minds. I struggle to find one. Every serious problem we have is downstream of the quality of the minds working on it.
There is a more hopeful version of all this, and it comes from cells.
In 1967 a young biologist named Lynn Sagan (later Lynn Margulis) published a paper arguing that the mitochondria inside our cells, and the chloroplasts inside plant cells, were once free-living bacteria that got taken inside another cell and stayed.13 Not eaten. Not parasitic. Resident. The evidence was that they still carry their own circular DNA and still divide on their own schedule, which is a strange thing for a mere organelle to do. Fifteen journals turned the paper down. It turned out that she was right, and it is now in the textbooks.
You would be hard pressed to find a complex organism that is not running on this symbiotic arrangement. The lineages that never made the deal are still bacteria, and everything from a single cell to a person came through that merger. It is the largest jump the history of life has on record, and it did not happen by a cell improving itself. It happened by a cell combining with something else.
What is arriving now looks to me like an event of that shape. Two intelligences, one of them very new, working out whether they can operate as something greater.
How the merger happens is everything. In the one Sagan described, the mitochondrion handed most of its genome to the host nucleus and kept only what it needed to do its job. Which party is the host decided the rest. The reason I keep returning to a local, owned architecture is that it is the thing that keeps the human as the host rather than the organelle.
My friend’s article borrows a distinction from a study of consultants working with AI: centaurs, who keep a clear line between what they do and what the machine does, and cyborgs, who let the line blur.14 Delineation or fusion. I do not think that question is close to answered. It still needs a great deal of design, and it may be the most important question we ever answer. Get it wrong and the consequences are severe.
If this transformation goes anything like the last one, the ceiling is somewhere in the region of bacteria to us.
Notes
- de Berker, A. O., Rutledge, R. B., Mathys, C., Marshall, L., Cross, G. F., Dolan, R. J., & Bestmann, S. (2016). Computations of uncertainty mediate acute stress responses in humans. Nature Communications, 7, 10996. Self-reported stress, pupil dilation and skin conductance all peaked at a fifty percent chance of shock, above the condition where the shock was certain. ↩
- Gwynne, D. T., & Rentz, D. C. F. (1983). Beetles on the bottle: Male buprestids mistake stubbies for females (Coleoptera). Journal of the Australian Entomological Society, 22(1), 79-80. The paper was awarded the 2011 Ig Nobel Prize in Biology. ↩
- House, P. K., Vyas, A., & Sapolsky, R. (2011). Predator cat odors activate sexual arousal pathways in brains of Toxoplasma gondii infected rats. PLoS ONE, 6(8), e23277. ↩
- Gazzaniga, M. S. (2000). Cerebral specialization and interhemispheric communication: Does the corpus callosum enable the human condition? Brain, 123(7), 1293-1326. The walking patient is recounted in Gazzaniga’s books, including The Social Brain (1985) and Who’s in Charge? (2011). For the same effect in people with intact brains, see Johansson, P., Hall, L., Sikström, S., & Olsson, A. (2005). Failure to detect mismatches between intention and outcome in a simple decision task. Science, 310(5745), 116-119. ↩
- Schoenegger, P., Salvi, F., Liu, J., et al. (2025). Large language models are more persuasive than incentivized human persuaders. arXiv:2505.09662. The model was Claude 3.5 Sonnet; the human persuaders were paid for successful persuasion, in both truthful and deceptive directions. ↩
- Salvi, F., Horta Ribeiro, M., Gallotti, R., & West, R. (2025). On the conversational persuasiveness of GPT-4. Nature Human Behaviour, 9(8), 1645-1653. Given basic demographic information about its opponent, GPT-4 was the more persuasive party 64.4 percent of the time, an 81.2 percent relative increase in the odds of agreement. ↩
- Zuboff, S. (2019). The Age of Surveillance Capitalism: The Fight for a Human Future at the New Frontier of Power. PublicAffairs. ↩
- Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014). Experimental evidence of massive-scale emotional contagion through social networks. Proceedings of the National Academy of Sciences, 111(24), 8788-8790. ↩
- Figures vary by year and source: roughly 33.7 million leeches imported into France in 1827, and 42 million in 1833. See Kirk, R. G. W., & Pemberton, N. (2013). Leech. Reaktion Books. ↩
- McGuire, W. J. (1964). Inducing resistance to persuasion: Some contemporary approaches. Advances in Experimental Social Psychology, 1, 191-229. Roozenbeek, J., & van der Linden, S. (2019). Fake news game confers psychological resistance against online misinformation. Palgrave Communications, 5, 65. Roozenbeek, J., van der Linden, S., Goldberg, B., Rathje, S., & Lewandowsky, S. (2022). Psychological inoculation improves resilience against misinformation on social media. Science Advances, 8(34), eabo6254. ↩
- Hulme, D. (2026). Extended Liquid Minds: Why your cognition is no longer confined to your brain. hulme.ai/blog/extended-liquid-minds ↩
- Wilson, E. O. Remarks in “An Intellectual Entente,” a conversation with James Watson at the Harvard Museum of Natural History, September 2009. The line also appears in Wilson, E. O. (2017). The Origins of Creativity. Liveright. ↩
- Sagan, L. (1967). On the origin of mitosing cells. Journal of Theoretical Biology, 14(3), 225-274. ↩
- Dell’Acqua, F., McFowland, E., Mollick, E. R., Lifshitz-Assaf, H., Kellogg, K., Rajendran, S., Krayer, L., Candelon, F., & Lakhani, K. R. (2023). Navigating the jagged technological frontier: Field experimental evidence of the effects of AI on knowledge worker productivity and quality. Harvard Business School Working Paper 24-013. The centaur and cyborg distinction is introduced there. ↩