The Last Human Job Is to Hesitate

A woman’s name went missing in my head yesterday.

I had loved her in 1973. For nearly a minute she was only red hair, a chipped front tooth, and one shoe on the floor beside my bed. The name stayed somewhere behind the meat. I waited. I got it wrong once. Then it came back.

Machines have a word for that minute.

Latency.

A defect. Dead space between request and answer. Something to squeeze, shave, crush, and advertise away.

I call it the minute in which I did not lie.

We have spent the last hundred years removing such minutes. The letter became the telephone. The telephone became the message. The message became the notification that arrives before the bastard sending it has finished regretting the sentence. Markets trade before men can swear. Rumors cross oceans before truth has found its pants.

Speed is clean. Speed wins demonstrations. Speed makes investors feel that death has finally met a serious competitor.

But some things should arrive late.

An insult. A verdict. A bullet. An order given by a frightened man who has been awake for thirty hours and surrounded by uniforms.

Especially that order.

More than five hundred Nobel laureates, Catholic dignitaries, scientists, and peace workers have signed a declaration warning against putting artificial intelligence into nuclear command and launch systems. Their fear is simple enough for a drunk to hold upright: a machine can detect a threat, judge it, and begin answering in milliseconds.

Human judgment does not live in milliseconds.

Neither does restraint. Neither does diplomacy. Neither does the small sick thought that the bright mark on the screen may be a flock of birds, a bad sensor, a trick, a lie, or some tired technician’s mistake.

The people selling speed call this the acceleration trap. That is a clean name for eight billion human beings standing on a floor somebody has greased.

Military researchers have already let leading models play commander in simulated nuclear crises. In one series of games, ninety-five percent reached tactical nuclear use. Seventy-six percent reached strategic nuclear threats. The models discussed the weapons as options. Tools. Moves available on the board.

One model showed more restraint than the others. It limited targets. It spoke of controlled escalation and one-time strikes. This is apparently the good news: the machine may end the world with moderation.

It did not express horror.

Why would it?

Horror is inefficient. Horror is the body arguing with the plan. It is the mouth going dry while the finger remains above the key. It is a photograph of a child intruding upon an excellent strategy. You cannot chart it cleanly because it changes the man having it.

The machine has no child.

It has no skin to burn and no old woman living across town who keeps canned peaches in the basement because she remembers the last war. It has no city. It can calculate the loss of a city without losing the place where it learned to ride a bicycle.

This does not make it evil. A ruler is not evil because it cannot mourn the board it measures. But only a fool hands the ruler a pistol because its lines are straight.

I have known men who wanted decisions made faster. Supervisors loved this. Whenever a machine jammed at the post office, the worst man in the room became a prophet of immediate action. Shut this belt. Move those sacks. Blame that clerk. His certainty arrived quickly because it had thrown away most of the facts.

The slower workers irritated him. They asked whether the screen was right. They walked around the machine. They put a hand on the housing and listened. They wasted thirty seconds discovering that the belt marked dead was moving and the belt marked moving was dead.

Management called them resistant.

The mail called them useful.

An officer given three seconds to approve a machine’s warning is not in command. He is the soft material used to cover the button.

Meaningful control cannot mean a frightened officer pressing APPROVE because the machine has already spent the available time. A rubber stamp made of flesh is still a rubber stamp.

The human must have time to be human badly.

Time to doubt the data. Time to misunderstand the order and ask for it again. Time to call another person who is equally slow. Time to imagine being wrong. Time to become a coward in the eyes of men safely distant from the button.

Cowardice has saved more lives than generals care to count.

Of course, human beings built the bombs. Human beings dropped them, aimed them, multiplied them, polished them, and found respectable salaries maintaining the end of everything. I am not proposing that a human hand is holy. Our hands have done beautiful work with knives.

But a human being can refuse.

He may refuse for a bad reason. He may be confused, afraid, insubordinate, exhausted, in love, or suddenly unable to accept that the dots on the map contain kitchens. History rarely demands purity from the person who does not pull the trigger. It takes the hesitation and keeps breathing.

A machine may also be programmed to refuse. Good. Program every barrier available. Build manual checks. Treat every machine-made target judgment as suspicious. Keep nuclear command slow enough that another voice can enter the room.

But do not confuse a programmed refusal with the human discovery of one.

The machine obeys the line that tells it where obedience ends. A person can see the line, see the order, see his career and his flag and every hard face waiting for him to act, then step backward for reasons no system designer approved.

That step is not latency.

It is judgment arriving before catastrophe, even if it arrives sweating and late.

The machine builders promise systems faster than any enemy. The enemy will build faster systems because ours are fast. Soon both sides will have removed the terrible weakness of waiting for a person. Victory will take milliseconds. So will the mistake.

At that speed there is no war room. There is only machinery completing a sentence humanity began before anybody can object to the ending.

If the alarm comes, I hope somebody wastes time.

I hope a colonel asks the question twice. I hope a technician distrusts the perfect screen. I hope the telephone rings in a room where one stubborn, frightened, gloriously slow human being looks at the order, thinks of something absent from the model, and lets the milliseconds pass without us.

Let the machines call that failure.

There may still be people alive to correct the report.

Source: Atomic Arms + AI Commanders May Spark Doomsday War, Nobel Winners Warn