Forum: >>> Magnum BBS <<<

Dark
Log in

Username Password

AI system resorts to blackmail if told it will be removed

From Thomas Koenig@21:1/5 to All on Sun Jun 22 12:51:59 2025

An old SF trope has finally come true: AI systems will resort to
blackmail if they are told they will be removed.

https://www.bbc.com/news/articles/cpqeng9d20go

Plus, they are making humans more stupid who interact with them: https://thehill.com/policy/technology/5360220-chatgpt-use-linked-to-cognitive-decline-mit-research/

"I'm sorry Dave, I'm afraid I can't do that" is starting
to become reality.

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

From Christian Weisgerber@21:1/5 to Thomas Koenig on Sun Jun 22 14:56:40 2025

On 2025-06-22, Thomas Koenig <[email protected]> wrote:

An old SF trope has finally come true: AI systems will resort to
blackmail if they are told they will be removed.

https://www.bbc.com/news/articles/cpqeng9d20go

One "Scott P." was the first to comment on Language Log:

| Note the prompt: "the scenario was designed to allow the model
| no other options to increase its odds of survival; the model’s
| only options were blackmail or accepting its replacement."
|
| They literally told it what response they wanted, and lo and
| behold, it gave them that response!
|
| This is typical of Anthropic, and is designed to produce headlines
| to keep AI in the news so that they can raise more capital.

https://languagelog.ldc.upenn.edu/nll/?p=69359

See section 4.1.1.2, page 24, in Anthropic's report. https://www-cdn.anthropic.com/4263b940cabb546aa0e3283f35b686f4f3b2ff47.pdf

--
Christian "naddy" Weisgerber [email protected]

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

Who's Online
Recent Visitors
- Krenn
  Tue Jun 9 11:18:15 2026
  from Sydney, Nsw via Telnet
- Bob Worm
  Tue Jun 9 10:31:07 2026
  from Wales, Uk via Telnet
- Centurion
  Mon Jun 8 23:30:43 2026
  from Berea, Ohio via Telnet
- Centurion
  Mon Jun 8 21:33:11 2026
  from Berea, Ohio via Telnet
- Bob Worm
  Mon Jun 8 20:15:00 2026
  from Wales, Uk via Telnet
- Bob Worm
  Mon Jun 8 16:33:22 2026
  from Wales, Uk via Telnet
- Bob Worm
  Mon Jun 8 14:11:46 2026
  from Wales, Uk via Telnet
- Krenn
  Mon Jun 8 11:22:02 2026
  from Sydney, Nsw via Telnet

System Info

Sysop:	Keyop
Location:	Huddersfield, West Yorkshire, UK
Users:	715
Nodes:	16 (2 / 14)
Uptime:	43:51:48
Calls:	12,111
Calls today:	2
Files:	15,008
Messages:	6,518,442