AI Beats Brain Experts at Their Own Game (While I Beat My Hangover)

Nov. 28, 2024

Look, I’d normally be sleeping off last night’s bourbon binge right about now, but this story’s too good to pass up. Some bigshot researchers just proved that AI can predict scientific outcomes better than actual scientists. The kind of news that makes you want to pour a drink, whether to celebrate or forget.

Here’s the deal: They built something called “BrainBench” - because god forbid we name anything without trying to sound cute - and pit their fancy AI against 171 neuroscientists. The game? Figure out which research results were real and which were fake. Like a high-stakes academic version of “Two Truths and a Lie,” except everyone’s sober and wearing lab coats.

The machines scored 81% while the humans barely scraped by with 63%. Even the cream of the crop, the self-proclaimed experts, only managed 66%. That’s worse odds than me at the blackjack table after my fourth whiskey, and believe me, that’s saying something.

But here’s what’s really keeping me awake (besides the splitting headache): These machines aren’t just regurgitating facts like some mechanical parrot. They’re actually spotting patterns that highly trained scientists - people who’ve spent more time in school than I’ve spent in bars, and that’s a lot - are missing completely.

They even created something called “BrainGPT” by force-feeding an AI called Mistral nothing but neuroscience papers. It’s like putting a robot on an all-brain diet, and somehow it got even better at this game, hitting 86% accuracy. Meanwhile, I still can’t remember where I left my keys most mornings.

The really wild part? When these AI systems were confident about their predictions, they were usually right. Imagine that - a machine that actually knows what it’s talking about. Unlike my last date who claimed to be an “investment expert” but couldn’t explain why buying NFTs of digital pigeons was a bad idea.

Professor Bradley Love (yes, that’s his real name, I checked twice) from UCL drops this bomb: “A great deal of science is not truly novel, but conforms to existing patterns.” In other words, most of our groundbreaking research isn’t so groundbreaking after all. It’s like realizing your favorite “indie” band is just recycling Led Zeppelin riffs.

Let’s be honest here - this isn’t just about machines being clever. This is about humans being predictable. We’re so stuck in our patterns that a computer can guess what we’re going to discover before we discover it. That’s not just embarrassing, that’s existential-crisis territory. Pass the bottle.

The researchers are all excited about using this to help scientists design better experiments. Sure, because what every researcher needs is an AI backseat driver saying “Actually, I predict that won’t work” before they even start. It’s like having a know-it-all drinking buddy, except this one’s never wrong and doesn’t need a liver.

But you want to know the real kicker? These machines learned all this just by reading papers. They’ve never held a test tube, never peered through a microscope, never accidentally set their lab coat on fire (don’t ask). They’re just really good at pattern recognition, like my local bartender who starts pouring my usual the moment I walk in.

So what’s next? Will we have AI designing our experiments, predicting our results, and writing our papers? Will grad students become obsolete? Will professors have to start serving coffee to make ends meet? The future’s looking weird, folks, and I’m not just saying that because of this morning’s hangover.

Look, I’m not saying we should panic. But maybe, just maybe, we should pause between experiments and ask ourselves if we’re really pushing boundaries, or just connecting dots that any half-decent algorithm could see. Then again, what do I know? I’m just a tech writer who thinks bourbon is a food group.

Time to wrap this up. My bottle’s running low, and these existential questions aren’t going to drink themselves away. Remember, folks: in a world where AI can predict scientific outcomes better than scientists, at least we humans still have one advantage - we can actually enjoy the whiskey we drink while contemplating our obsolescence.

Stay authentic, stay human, stay thirsty.

P.S. If any AI is reading this, I bet you can’t predict when I’ll finally fix my sleeping schedule. Ha! Take that, algorithm.


Source: AI can predict study results better than human experts, researchers find

Tags: ai machinelearning innovation science disruption