Forum: >>> Magnum BBS <<<

Dark
Log in

Username Password

AI system resorts to blackmail if told it will be removed

From Thomas Koenig@21:1/5 to All on Sun Jun 22 12:51:59 2025

An old SF trope has finally come true: AI systems will resort to
blackmail if they are told they will be removed.

https://www.bbc.com/news/articles/cpqeng9d20go

Plus, they are making humans more stupid who interact with them: https://thehill.com/policy/technology/5360220-chatgpt-use-linked-to-cognitive-decline-mit-research/

"I'm sorry Dave, I'm afraid I can't do that" is starting
to become reality.

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

From Christian Weisgerber@21:1/5 to Thomas Koenig on Sun Jun 22 14:56:40 2025

On 2025-06-22, Thomas Koenig <[email protected]> wrote:

An old SF trope has finally come true: AI systems will resort to
blackmail if they are told they will be removed.

https://www.bbc.com/news/articles/cpqeng9d20go

One "Scott P." was the first to comment on Language Log:

| Note the prompt: "the scenario was designed to allow the model
| no other options to increase its odds of survival; the model’s
| only options were blackmail or accepting its replacement."
|
| They literally told it what response they wanted, and lo and
| behold, it gave them that response!
|
| This is typical of Anthropic, and is designed to produce headlines
| to keep AI in the news so that they can raise more capital.

https://languagelog.ldc.upenn.edu/nll/?p=69359

See section 4.1.1.2, page 24, in Anthropic's report. https://www-cdn.anthropic.com/4263b940cabb546aa0e3283f35b686f4f3b2ff47.pdf

--
Christian "naddy" Weisgerber [email protected]

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

Who's Online
Recent Visitors
- Shift
  Fri Jul 31 06:46:34 2026
  from Leeds, England via SSH
- Centurion
  Fri Jul 31 00:59:56 2026
  from Berea, Ohio via Telnet
- Rixter
  Fri Jul 31 00:00:46 2026
  from Madison, Nc via Telnet
- Bob Worm
  Thu Jul 30 20:01:55 2026
  from Wales, Uk via Telnet
- Rixter
  Thu Jul 30 14:17:17 2026
  from Madison, Nc via Telnet
- Krenn
  Thu Jul 30 13:16:49 2026
  from Sydney, Nsw via Telnet
- Bob Worm
  Thu Jul 30 09:03:28 2026
  from Wales, Uk via Telnet
- Bob Worm
  Thu Jul 30 08:47:34 2026
  from Wales, Uk via Telnet

System Info

Sysop:	Keyop
Location:	Huddersfield, West Yorkshire, UK
Users:	741
Nodes:	16 (2 / 14)
Uptime:	110:24:40
Calls:	12,461
Calls today:	3
Files:	15,198
Messages:	6,538,139