Pascal wrote a sentence everyone thinks they know, and almost no one really reads. Man is but a reed, the weakest in nature, but he is a thinking reed. And he adds, in the same breath, that all our dignity consists in thought, that it is by thought that we are worth something, not by the space or the time we occupy.
I keep coming back to these lines since machines that seem to think have existed. Because they pose, three and a half centuries apart, the exact question of our age. If a machine produces sentences truer than mine, faster, better documented, what is left to me? Where has the reed’s dignity gone, if even its thought is outdone by a calculation?
It is a real question, and I find we handle it badly, torn between wide eyed wonder and panic. Pascal, for his part, helps us pose it correctly.
Producing sentences is not thinking
A generative AI lines up words with an ease that humbles. It summarises, it translates, it rephrases, it argues both ways. On the ground of produced language it often surpasses us, and it would be childish to deny it.
But Pascal was not talking about producing sentences. He was talking about thinking, that is, knowing that one thinks. About that strange awareness that makes the reed, as it bends in the wind, feel that it bends, know that it is fragile, and know that it will die. Thought, for Pascal, is not a performance, it is a relationship to oneself and to the world, coupled with the awareness of one’s own end.
The machine does not know that it produces. It has no world, no stake, nothing to lose. It does not bend, it calculates. Asking it for a truth or a lie comes to the same thing for it: it lines up the plausible, without preferring one to the other, because it has no reason to prefer anything. To confuse that fluency with thought is the central error of our time, and it has very concrete consequences.
The practical consequence of a philosophical question
You might think all this is a matter for philosophers, with no effect on real life. It is not, and I see it every week.
If I believe the machine thinks, I trust it like an expert. I take its answer for an opinion, I fall in line, I decide on its word. If I know it predicts the plausible without understanding anything, I use it quite differently: as a brilliant assistant with no judgement, whose material I gather and whose committing parts I check. The same sentence produced by the machine does not carry the same weight depending on what I believe it to be. The whole difference between enduring the tool and using it sits in that belief.
That is why I always begin my sessions with this question, does the machine think, before touching any tool. Because the answer you give it, even an implicit one, decides everything else.
The real risk, and it is not the one you think
People worry a great deal about whether the machine will start to think, to wake up, to surpass us. I think we are afraid of the wrong thing.
The real risk is more modest and more immediate. It is that we stop thinking. When a tool gives the answer before you have even formed the question, the effort of thinking becomes optional. And what becomes optional withers, quietly, without anyone noticing. We delegate the calculations first, then the wordings, then the reasoning, and one morning we realise we can no longer hold an idea on our own. The danger is not a machine that wakes up. It is a reed that puts its thinking away because a machine takes care of it, and loses, with it, what made its dignity.
Keeping the reed’s dignity
The whole stake sits there, and it is surprisingly practical. Use the machine for what it does better than us, and jealously keep what cannot be delegated. The calculation, yes. The judgement, no. The sentence, gladly. The meaning we give it, never.
Pascal did not know our machines, and he would have been the first fascinated by their power. But he had understood what mattered long before us. What keeps us standing is not our strength, since we are the weakest of reeds. It is our awareness, including the awareness of our weakness. No machine has that, however eloquent it may be. It is perhaps all we have to defend in the face of them. Looking closely, it is more than enough.