The Bulletproof Summary Had No Pulse

IN THE MATTER OF A MAN WHO WANTED THE WORK DONE FOR HIM

I submit the following because I am tired of hearing this called a technology story, as if the technology crept in through a window while the adults slept.

Exhibit A: The phrase “bulletproof summary.”

A defense lawyer in New Mexico had a murder appeal on his desk. A real one. Not a spreadsheet with a bad formula in it. Not a pitch deck. A man had been convicted, sentenced to life, and the old machinery of the state had already put its greasy hand on the lever.

The lawyer fed a transcript and other case material into ChatGPT. He wanted a summary. He later told the court he assumed it would be bulletproof.

There is something almost tender about this. Tender in the way a man walking into traffic with a blindfold is tender. He trusted a word machine with a thing that required a witness, a memory, a hand on a Bible, somebody looking at somebody else across a room and saying: yes, that is what happened.

The machine gave him some of that. Only it made it up.

Police testimony that did not happen. Witnesses with no lungs, no mothers, no place to go after court. A shooter in dark pants and a white shirt, apparently summoned out of the electronic basement because the prose needed a jacket on the rack.

The lawyer put it in a brief.

That is the part that keeps getting softened until it becomes a little workplace lesson with pastel icons. The machine hallucinated. The professional failed to verify. Best practices. Human in the loop. Everybody nods and goes back to their little screens where the next shortcut is already warming up.

No.

A man’s appeal was fed through a box that makes plausible sentences for a living. Then somebody signed his name beneath the box’s inventions and carried them into a court.

That is not a cautionary tale. That is a cheap room with a loaded gun on the bed.

Exhibit B: The missing job.

People keep saying the machines will take the boring work. They say it with the rosy confidence of a dentist who has never had a tooth drilled. They imagine all the forms and summaries and sorting will vanish, and human beings will be freed up for the beautiful difficult stuff.

But the boring work in a murder appeal is not just boring work. It is the ugly scaffolding around the difficult part. Reading every page. Checking every quote. Knowing when a sentence looks too clean because real life is not clean. Calling somebody. Looking again. Losing an afternoon to one detail because one detail can be the whole goddamn thing.

That is the job.

It is not glamorous. Nobody makes a keynote slide about a tired lawyer at 11:30 at night finding a discrepancy on page 418. But that tired person, if he is doing his job, is the thin human wall between a defendant and a story the state likes better.

The machine does not know that wall exists. It knows the shape of language that often appears near other language. Give it a trial transcript and it does not become a reader. It becomes a very confident parrot in a necktie, pecking at the evidence table.

And the parrot does not wake up sweating because it got a man buried alive in prison.

Exhibit C: “I did not understand.”

The lawyer said he did not understand how much AI could hallucinate facts. The court, quite reasonably, asked whether he watched the news or read anything about the world.

This is funny in the black way. The whole country has spent two years watching lawyers get burned for fake cases, fake citations, fake quotations. We have watched firms announce their shiny robot assistants while their junior people quietly clean up the robot’s vomit. We have been told in a thousand conference rooms that this thing is transformational, which is another word people use when they want you to skip the part where it breaks your leg.

Still, a grown man with a client facing life in prison expected a bulletproof summary.

He expected an answer without responsibility.

That is the real product being sold. Not intelligence. Relief.

Relief from reading the thing. Relief from doubt. Relief from the old embarrassing fact that a professional is supposed to know where his knowledge ends. The machine offers a clean little package with the mess taken out. It does not tell you that it has also taken out the truth. Why would it? It is not lying in the human sense. It has no shame to hide behind. It has only the next likely word, and the next, and the next.

We are the ones bringing shame into it. We are the ones putting it in the briefcase and driving it to court.

Exhibit D: The client.

The lawyer was fined five thousand dollars and held in contempt. There may be disciplinary proceedings. Fine. Let him sit with that bill and whatever comes after.

But the story should not end on the lawyer because he is the easiest man in it to look at. He had an explanation. He had a machine. He had a profession that will probably survive him.

The client had a murder conviction, a life sentence, and a filing full of people who were never there.

The appeal is still pending. Another lawyer has it now.

Somewhere, perhaps, a real person is reading the transcript. Line by line. Not because he is noble. Maybe he is tired. Maybe he wants to get home. Maybe the coffee tastes burnt and the office light has been flickering since Tuesday.

But he is reading it.

He is doing the shabby, unmarketable work of deciding whether a sentence belongs to the world before he lets it do damage in the world.

The machine can produce a witness in half a second.

It cannot notice the chair beside the witness stand is empty.

Source: ChatGPT invented fake police testimony in murder appeal, New Mexico high court says