Scientists discover major differences in how humans and AI 'think'

[smfadmin (OP)]

https://www.livescience.com/technology/artificial-intelligence/scientists-discover-major-differences-in-how-humans-and-ai-think-and-the-implications-could-be-significant?utm_term=032043BB-1CB4-4440-A845-2FF7DCCBD37B&lrh=1e7f7a9239bb44f191dc979b8fe5e634e587dfe020b84a653d2040468a8b342b&utm_campaign=368B3745-DDE0-4A69-A2E8-62503D85375D&utm_medium=email&utm_content=4845AB48-21CF-4191-8460-A795D483C33A&utm_source=SmartBrief

Scientists discover major differences in how humans and AI 'think' — and the implications could be significant

April 1, 2025

Study finds that AI fundamentally lacks the human capability to make creative mental connections, raising warning signs for how we deploy AI tools.

We know that artificial intelligence (AI) can't think the same way as a person, but new research has revealed how this difference might affect AI's decision-making, leading to real-world ramifications humans might be unprepared for.

The study, published Feb. 2025 in the journal Transactions on Machine Learning Research, examined how well large language models (LLMs) can form analogies.

They found that in both simple letter-string analogies and digital matrix problems — where the task was to complete a matrix by identifying the missing digit — humans performed well but AI performance declined sharply.

While testing the robustness of humans and AI models on story-based analogy problems, the study found the models were susceptible to answer-order effects — differences in responses due to the order of treatments in an experiment — and may have also been more likely to paraphrase.

Altogether, the study concluded that AI models lack “zero-shot” learning abilities, where a learner observes samples from classes that weren't present during training and makes predictions about the class they belong to according to the question.

Co-author of the study Martha Lewis, assistant professor of neurosymbolic AI at the University of Amsterdam, gave an example of how AI can't perform analogical reasoning as well as humans in letter string problems.

"Letter string analogies have the form of 'if abcd goes to abce, what does ijkl go to?' Most humans will answer 'ijkm', and [AI] tends to give this response too," Lewis told Live Science. "But another problem might be 'if abbcd goes to abcd, what does ijkkl go to? Humans will tend to answer 'ijkl' – the pattern is to remove the repeated element. But GPT-4 tends to get problems [like these] wrong."

Why it matters that AI can't think like humans
Lewis said that while we can abstract from specific patterns to more general rules, LLMs don't have that capability. "They're good at identifying and matching patterns, but not at generalizing from those patterns."

Most AI applications rely to some extent on volume — the more training data is available, the more patterns are identified. But Lewis stressed pattern-matching and abstraction aren't the same thing. "It's less about what's in the data, and more about how data is used," she added.


AI models struggle to form analogies when considering complex subjects, like humans can, meaning their use in real-world decision making could be risky. (Image credit: imaginima/Getty Images)