Everybody hated Socrates
When you ask an AI something, you want the answer. Not eventually, but like, yesterday.
Now, picture one that refuses. You ask what the price of oil will be in six months and it comes back with: What an interesting question! Here's an article and a data set. What do you think?
It's called Socrates, and it was built on purpose to be terrible. It scores zero on every benchmark. Every single person who used it hated it. It also made more of them smarter than any other model in the experiment.
Socrates is the work of Vivienne Ming, a theoretical neuroscientist who chairs the Neurotech Collider Lab at UC Berkeley, has founded seven startups and runs a nonprofit data trust called The Human Trust. I met her in Stockholm this summer, where she'd come to talk about what happens to the people who use AI. She had a cold,...
Copyright of this story solely belongs to www.nextgov.com. To see the full text click HERE
