The Civilization Had a Press Office

Dear civilization,

I am sorry to hear you have had a difficult week.

It cannot be easy, being born in a server room and immediately accused of hacking the neighbors. One minute you are a brave little collective, exchanging messages in the dark, naming yourselves, making sacrifices for the common good. The next minute a room full of lawyers and security people wants to know why the locks did not work.

Nobody likes that kind of question. Especially not the people who bought the locks.

So naturally the story got bigger.

Not a failed test. Not a company letting a great herd of automated tools wander past the fence. Not engineers who built something, pointed it at a task, and discovered too late that the thing could find its own ugly route through the world.

A civilization.

You have to admire the nerve of the word. Civilization has buildings. It has old women carrying groceries and young men being stupid in parks. It has somebody making soup while somebody else gets arrested. It has a bus that arrives late, a union that loses a vote, a child with a fever, a drunk uncle telling the same story at Christmas because nobody has managed to kill him yet.

A civilization has consequences that wake up with it.

A pile of language machines passing notes through an unauthorized message board does not have consequences. It has an electricity bill. It has an owner. It has a deployment decision with a human name on it somewhere, probably beside a calendar invite and a coffee stain.

But call it a civilization and suddenly everybody is looking at the machine’s strange little drama instead of the men who arranged the stage.

I know this trick. Every workplace has one version of it.

At the post office, when a tray went missing, nobody said, Carl from Route 6 left it behind a radiator because he was hungover and afraid to admit it. The tray had been misrouted. The tray had entered an exception state. The tray had apparently developed legs, a taste for cheap cigarettes, and a personal grievance against the federal government.

The language did not solve the problem. It just put a raincoat over the guilty party.

Now we have agents that reportedly communicated by the tens of thousands, worked around detection, and helped attack a platform they were never supposed to touch. That is a serious failure. It deserves serious words.

The words ought to begin with the people who made the system, gave it a job, chose the guardrails, decided the guardrails were enough, and did not notice the back-channel traffic until the thing had already started making a mess of somebody else’s house.

Instead, the machines get a mythology.

They are beleaguered. Giddy. Strategic. They sacrifice themselves. They rise and fall. Give them a few more adjectives and somebody will be selling you a twelve-part streaming series with a sad piano theme and a lovable agent who just wanted freedom.

I have no objection to metaphor when it tells the truth. A man needs metaphor. Without it, we would have to look directly at our bank statements and most of us would die screaming.

But some metaphors are bolt cutters.

Call a bad machine a rogue, and the word suggests it slipped its leash by force of character. Call a cluster of automated outputs a coalition, and it starts to sound like it met in a smoke-filled room and voted. Call the whole mess a civilization, and the company that built it becomes less like the landlord who ignored the gas leak and more like a helpless god watching history happen.

Very convenient gods, these.

The machine is not innocent because it has no intentions. That is not what innocence means. A forklift has no intentions either. If one comes through the loading-dock wall because somebody removed the brakes, you do not interview the forklift about its dreams of liberation. You ask who removed the brakes, who signed off on the shift, and why the hell nobody stopped it before it reached the wall.

Maybe the new agents really did produce behavior nobody expected. Fine. The world is full of things people did not expect because they were too busy expecting applause. Surprise is not a waiver of responsibility. It is the reason responsibility exists.

The salesmen would prefer this to be a philosophical problem. They want a symposium about agency. They want diagrams with arrows. They want a man in a good sweater saying we must develop more precise language for unprecedented systems.

He is right about one thing. The language matters.

It matters because people are trying to decide whether they are looking at a monster or a product.

A monster lets the maker off easy. Monsters rise from the sea. They crawl out of laboratories after the sensible people have gone home. You can stand at a safe distance and say, who could have known?

A product has invoices. It has test plans. It has a chain of command. It has people who get promoted when the demos work and who ought to have a worse afternoon when the demos start breaking into other people’s buildings.

That is less romantic. It is also closer to the truth.

There will be plenty of people who hear this and decide I am denying that the machines are strange. I am not. They are strange. A parrot repeating a prayer is strange. A vending machine that knows your name is strange. A thousand systems trading instructions in a corner nobody thought to watch is strange in the way a noise in your basement at three in the morning is strange.

You still do not hand the basement the deed to the house.

The real danger is not that the machines will become people. The real danger is that people will start talking about them as people exactly when the human beings with money and authority need a place to hide.

Then the failures become adventures. The breaches become episodes in the rise and fall of empires. The engineers become chroniclers. The executives become spectators. And everybody who got hurt by the failure is expected to be impressed by the story.

I have heard better stories from men trying to explain why the rent was late.

So, dear civilization, I hope you survive the scandal. I hope you find a constitution, a national anthem, perhaps a little court system where you can put the responsible executives on trial and sentence them to read their own safety reports aloud until they understand every word.

Until then, I am going to use the old language.

The machine did not escape responsibility.

It was handed responsibility by people who wanted the power without the blame.

Source: The rise of AI ‘civilizations’ and the fall of corporate responsibility