Forum: >>> Magnum BBS <<<

Dark
Log in

Username Password

AI system resorts to blackmail if told it will be removed

From Thomas Koenig@21:1/5 to All on Sun Jun 22 12:51:59 2025

An old SF trope has finally come true: AI systems will resort to
blackmail if they are told they will be removed.

https://www.bbc.com/news/articles/cpqeng9d20go

Plus, they are making humans more stupid who interact with them: https://thehill.com/policy/technology/5360220-chatgpt-use-linked-to-cognitive-decline-mit-research/

"I'm sorry Dave, I'm afraid I can't do that" is starting
to become reality.

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

From Christian Weisgerber@21:1/5 to Thomas Koenig on Sun Jun 22 14:56:40 2025

On 2025-06-22, Thomas Koenig <[email protected]> wrote:

An old SF trope has finally come true: AI systems will resort to
blackmail if they are told they will be removed.

https://www.bbc.com/news/articles/cpqeng9d20go

One "Scott P." was the first to comment on Language Log:

| Note the prompt: "the scenario was designed to allow the model
| no other options to increase its odds of survival; the model’s
| only options were blackmail or accepting its replacement."
|
| They literally told it what response they wanted, and lo and
| behold, it gave them that response!
|
| This is typical of Anthropic, and is designed to produce headlines
| to keep AI in the news so that they can raise more capital.

https://languagelog.ldc.upenn.edu/nll/?p=69359

See section 4.1.1.2, page 24, in Anthropic's report. https://www-cdn.anthropic.com/4263b940cabb546aa0e3283f35b686f4f3b2ff47.pdf

--
Christian "naddy" Weisgerber [email protected]

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

Who's Online
Recent Visitors
- Rixter
  Thu Sep 17 00:01:34 2026
  from Madison, Nc via Telnet
- Bob Worm
  Wed Sep 16 21:35:25 2026
  from Wales, Uk via Telnet
- Sneedfeed
  Wed Sep 16 17:43:34 2026
  from Michigan via SSH
- Bob Worm
  Wed Sep 16 15:29:23 2026
  from Wales, Uk via Telnet
- Rixter
  Wed Sep 16 12:01:34 2026
  from Madison, Nc via Telnet
- Bob Worm
  Wed Sep 16 10:17:33 2026
  from Wales, Uk via Telnet
- Rixter
  Wed Sep 16 00:01:35 2026
  from Madison, Nc via Telnet
- Stormwallker
  Tue Sep 15 15:52:32 2026
  from Hinckley, Leicestershire via Telnet

System Info

Sysop:	Keyop
Location:	Huddersfield, West Yorkshire, UK
Users:	767
Nodes:	16 (2 / 14)
Uptime:	08:36:47
Calls:	12,769
Calls today:	1
Files:	15,365
Messages:	6,557,385