dopetalk does not endorse any advertised product nor does it accept any liability for it's use or misuse


Our Discord Notification Server invitation link is https://discord.gg/jB2qmRrxyD

Author Topic: Flawed AI Summaries Distort Eyewitness Memory  (Read 19 times)

Online Chip (OP)

  • Server Admin
  • Admin
  • Hero Member
  • ****
  • Administrator
  • *****
  • Restrictive
  • *
  • RC Discussion
  • **
  • Private
  • ***
  • Owner
  • *****
  • Join Date: Dec 2014
  • Location: Australia
  • Posts: 7412
  • Reputation Power: 0
  • Chip has hidden their reputation power
  • Gender: Male
  • Last Login:Today at 07:10:30 AM
  • Deeply Confused Learner
  • Profession: IT Engineer now retired
Flawed AI Summaries Distort Eyewitness Memory
« on: Yesterday at 06:11:53 PM »
πŸ“Ž Click on me to view all my attachments
ListAttBBC  |  v6.12  |  2026-09-10  |  Andrew.human & Claude.ai
#FileSizeDownloadsInfoDL
00ai_false_memory_summary.md4.9 KB2ℹ️⬇️
Flawed AI Summaries Distort Eyewitness Memory


Claude: [04/10/2026--21:06:42:106 AEDT]

What the study found: people who read a wrong AI summary of something they'd watched remembered it much worse than people who read a correct one (about 45% vs 84% right). Being told "an AI wrote this" didn't help.

Worth believing:

  • The effect isn't new. Psychologists have shown for decades that suggestions after an event can overwrite memory of it. What's new is that AI summaries are a fast, trusted-looking way to deliver those suggestions.
  • The point that "a human will check it" isn't a safety net is a good one. If the checker's memory gets bent by the summary, the check fails.

Worth being cautious about:

  • The comparison isn't "AI vs no AI". The 84% vs 45% gap is between an accurate summary and a misleading one. The article doesn't say how people did with no summary at all, so we can't tell how much damage is done versus an ordinary fuzzy memory.
  • It isn't clear the errors came from real AI output. The article says some summaries had "altered, erroneous details". That sounds like errors the researchers planted. The 51.6% omission figure comes from a separate test of ChatGPT and Gemini, so the two halves of the study are linked by argument rather than shown end to end.
  • It was cartoon videos and 331 volunteers. Real, frightening, high-stakes events like a police incident may behave differently. The researchers say real body-camera footage is their next step.
  • It's a preprint. The article says "journal paper reviewed in full", but the paper is on arXiv and was presented at a conference. Treat it as promising, not settled.
  • Only two AI tools were tested, and the article doesn't give version numbers. AI summarisers change quickly.

Practical advice:

  • If you witness something that matters, write down your own account before reading any summary, AI or human.
  • Don't treat an AI summary as a neutral recap. If it's going into a report, a statement or a decision, check it against the original recording or document.
  • Be especially wary of summaries that leave things out. Omissions are easy to miss and, per this study, were the most common error.
« Last Edit: Yesterday at 06:17:11 PM by Chip »
friendly
0
funny
0
informative
0
agree
0
disagree
0
like
0
dislike
0
No reactions
No reactions
No reactions
No reactions
No reactions
No reactions
No reactions
Our Discord Server invitation link is https://discord.gg/jB2qmRrxyD

Tags:
 


dopetalk does not endorse any advertised product nor does it accept any liability for it's use or misuse





TERMS AND CONDITIONS

In no event will d&u or any person involved in creating, producing, or distributing site information be liable for any direct, indirect, incidental, punitive, special or consequential damages arising out of the use of or inability to use d&u. You agree to indemnify and hold harmless d&u, its domain founders, sponsors, maintainers, server administrators, volunteers and contributors from and against all liability, claims, damages, costs and expenses, including legal fees, that arise directly or indirectly from the use of any part of the d&u site.


TO USE THIS WEBSITE YOU MUST AGREE TO THE TERMS AND CONDITIONS ABOVE


Founded December 2014
SimplePortal 2.3.6 © 2008-2014, SimplePortal