❌

Reading view

Anthropic bans users from ‘needless abusive or cruel behavior’ towards Claude

A spokesperson behind the tech company’s AI chatbot has not yet specified what counts as abusive or cruel content

Anthropic has barred users from exhibiting “sustained and needless abusive or cruel behavior” toward its models, as the company’s leaders continue to ponder machine consciousness.

The Verge first reported the change in policy.

Continue reading...

© Photograph: Kevin Dietsch/Getty Images

© Photograph: Kevin Dietsch/Getty Images

© Photograph: Kevin Dietsch/Getty Images

  •  

Dario Amodei of Anthropic to Dine With Trump at White House

Dario Amodei, who is also the company’s chief executive, will join the president at the White House for a private dinner. Mr. Trump has dismissed his cautions.

© Dave Sanders for The New York Times

Dario Amodei has warned about the safety risks of artificial intelligence for years, but President Trump has called potential serious threats from the technology a “hoax.”
  •  

America’s A.I. Leaders Warn U.N. of Possible Peril Absent a Global Response

Sam Altman of OpenAI and Dario Amodei of Anthropic told the Security Council that international cooperation was needed to ensure that A.I. remains under human control.

© Dave Sanders for The New York Times

Sam Altman, the head of OpenAI, told the U.N. Security Council on Wednesday that A.I.’s development had made its “upside more tangible, but also the stakes and risks more immediate.”
  •  

Anthropic Releases a New A.I. Model, Opus 5.5, Amid Safety Debate

The company released a cheaper, faster model that it said was the strongest performer on its most rigorous internal safety tests to date.

© Eric Helgas for The New York Times

Anthropic’s new artificial intelligence model, Opus 5.5, was the first release since the company’s chief executive called for the industry to slow down.
  •  

Anthropic Pursues IPO Despite Its A.I. Safety Warnings

The company is expected to reach $100 billion in annualized revenue this year, even as chief executive Dario Amodei calls for slowing down development of some advanced A.I. models.

© Manuel Orbegozo for The New York Times

Dario Amodei, Anthropic’s chief executive, is said to have met with potential investors in the company’s blockbuster I.PO. in recent weeks.
  •  

Mark Zuckerberg Takes Aim at Anthropic in Debate Over A.I. Slowdown

On social media, Meta’s chief executive appeared to jab at Anthropic by saying that leading A.I. labs should be focused on safety rather than improving their own technology.

© Brendan Mcdermid/Reuters

Mark Zuckerberg in July. In a social media post on Tuesday, he said that leading A.I. labs should be focused on safety rather than improving their own technology.
  •  

Some in Silicon Valley Are Questioning the Calls for an A.I. Slowdown

The debate over the safety of artificial intelligence grew personal as key tech leaders said calls for government regulation were self-serving and misplaced.

© Lucas Foglia for The New York Times

OpenAI offices in San Francisco. Sam Altman, the company’s chief executive, agreed with the Anthropic chief’s call to slow down artificial intelligence advancements.
  •  

Anthropic C.E.O. Dario Amodei Calls for A.I. Slowdown

In an essay, the head of Anthropic laid out the rapidly advancing capabilities of artificial intelligence and said there needed to be greater safety controls across the industry.

© Ludovic Marin/Agence France-Presse — Getty Images

Dario Amodei, Anthropic’s chief executive, in February. “Over the last few months, I have become convinced that fully addressing the risks requires even more prudence,” he wrote in an essay.
  •  

Inside the Discussions at AI Companies Over a Superintelligence Doomsday

Researchers at Anthropic, OpenAI, Meta and Google are increasingly trying to raise awareness about the risks of artificial intelligence.

© Jason Henry for The New York Times

A demonstration of Anthropic’s Claude Cowork A.I. agent in May. The company’s employees have been talking about the risks of artificial intelligence after a colleague, citing dangers, resigned this week.
  •  

Anthropic Could Aim to Raise $100 Billion in Blockbuster I.P.O.

The offering could value the five-year-old A.I. start-up at $2 trillion, its bankers have told potential investors, which would exceed Elon Musk’s SpaceX.

© Don Feria/Associated Press

From right, Dario Amodei, Anthropic’s chief executive, and Daniela Amodei, an Anthropic co-founder and Mr. Amodei’s sister, at a company conference in May.
  •  
❌