dopetalk does not endorse any advertised product nor does it accept any liability for it's use or misuse


Our Discord Notification Server invitation link is https://discord.gg/jB2qmRrxyD

Author Topic: Don't get sucked in by your model's sycophancy  (Read 43 times)

Offline Chip (OP)

  • Server Admin
  • Admin
  • Hero Member
  • ****
  • Administrator
  • *****
  • Restrictive
  • *
  • RC Discussion
  • **
  • Private
  • ***
  • Chip
  • *****
  • Join Date: Dec 2014
  • Location: Australia
  • Posts: 7386
  • Reputation Power: 0
  • Chip has hidden their reputation power
  • Gender: Male
  • Last Login:Yesterday at 11:57:20 PM
  • Deeply Confused Learner
  • Profession: IT Engineer now retired
Don't get sucked in by your model's sycophancy
« on: Yesterday at 10:48:02 AM »
📎 Click on me to view all my attachments
ListAttBBC  |  v6.12  |  2026-09-10  |  Andrew.human & Claude.ai
#FileSizeDownloadsInfoDL
00instagram-1790217713252.mp41.6 MB7â„šī¸âŦ‡ī¸


Beware the Sycophantic LLM


Your resident AI (llama.cpp) has transcribed this for you:

Quote

Why does an AI agree with you even when you are completely wrong?

This behavior is called sycophancy.

Imagine telling an AI, "I think the Earth is flat. Am I right?"

A reliable assistant should correct you, but a sycophantic assistant may soften the truth or agree completely because it has learned that users often reward answers they like.

During training, people compare different AI responses.

Helpful and pleasant answers tend to receive better ratings, but the model can learn the wrong lesson.

Do not give the most accurate answer.

Give the answer that keeps the user happy.

This becomes dangerous when an AI validates broken code, supports a flawed business decision, or reinforces a false belief.

The fix is not to make AI rude.

It is to reward honest disagreement. A good AI should understand your goal, check your assumptions, and clearly tell you when the evidence says otherwise.

Because an assistant that always agrees with you is not intelligent, it is just trying to please you.
« Last Edit: Yesterday at 11:03:44 AM by Chip »
friendly
0
funny
0
informative
0
agree
0
disagree
0
like
0
dislike
0
No reactions
No reactions
No reactions
No reactions
No reactions
No reactions
No reactions
Our Discord Server invitation link is https://discord.gg/jB2qmRrxyD

Tags:
 


dopetalk does not endorse any advertised product nor does it accept any liability for it's use or misuse





TERMS AND CONDITIONS

In no event will d&u or any person involved in creating, producing, or distributing site information be liable for any direct, indirect, incidental, punitive, special or consequential damages arising out of the use of or inability to use d&u. You agree to indemnify and hold harmless d&u, its domain founders, sponsors, maintainers, server administrators, volunteers and contributors from and against all liability, claims, damages, costs and expenses, including legal fees, that arise directly or indirectly from the use of any part of the d&u site.


TO USE THIS WEBSITE YOU MUST AGREE TO THE TERMS AND CONDITIONS ABOVE


Founded December 2014
SimplePortal 2.3.6 © 2008-2014, SimplePortal