Skip to main content
Advertisement

Anthropic CEO Refuses Pentagon's Demand to Remove AI Safeguards

Anthropic CEO Dario Amodei refuses Pentagon's demand to allow all lawful uses of its AI, citing concerns over mass surveillance and autonomous weapons, and pledges to maintain ethical safeguards despite threats of removal from the DoD supply chain.

·3 min read
Reuters Anthropic CEO Dario Amodei on a stage, furrowing his brow behind round, black-rimmed eye classes.

Anthropic Stands Firm Against Pentagon's AI Usage Demands

Anthropic has declared it will not relent in its dispute with the US Department of Defense (DoD) regarding the application of its artificial intelligence (AI) technology.

The company's chief executive, Dario Amodei, stated on Thursday that Anthropic would prefer to forgo collaboration with the Pentagon rather than consent to uses of its technology that might

"undermine, rather than defend, democratic values."

These remarks followed a meeting two days earlier with US Secretary of Defense Pete Hegseth, who demanded that Anthropic accept

"any lawful use"
of its AI tools. The meeting concluded with a threat to exclude Anthropic from the DoD's supply chain.

"These threats do not change our position: we cannot in good conscience accede to their request,"
Amodei affirmed.

Concerns Over AI Applications in Surveillance and Autonomous Weapons

The core issue for Anthropic involves the potential deployment of its AI tools, such as Claude, for two specific purposes:

"Mass domestic surveillance"
and
"Fully autonomous weapons."

Amodei emphasized that

"such use cases have never been included in our contracts with the Department of War, and we believe they should not be included now."

It is important to note that the Department of War is an alternative designation for the Defense Department, as per an executive order signed by former US President Donald Trump in September.

Regarding the possibility of being removed from the DoD supply chain, Amodei stated,

"Should the Department choose to offboard Anthropic, we will work to enable a smooth transition to another provider."

A Defense Department representative was unavailable for comment.

Advertisement

Potential Government Actions and Supply Chain Risks

A Pentagon official previously informed the BBC that if Anthropic refuses to comply, Secretary Hegseth would invoke the Defense Production Act on the company.

This act empowers the US president to designate a company or its product as critical to national defense, thereby requiring it to fulfill defense-related demands.

Additionally, Hegseth threatened to classify Anthropic as a

"supply chain risk,"
implying the company would be deemed insufficiently secure for government use.

A former DoD official, speaking anonymously to the BBC on Thursday, described Hegseth's rationale for these measures as

"extremely flimsy."

Anthropic's Position on AI Use and Ethical Concerns

While Amodei did not detail specific instances of Anthropic's AI being used by the DoD for mass surveillance or autonomous weapons, he elaborated in a company blog post that AI technology can be employed to

"assemble scattered, individually innocuous data into a comprehensive picture of any person's life - automatically and at massive scale."

He clarified,

"We support the use of AI for lawful foreign intelligence and counterintelligence missions,"
but emphasized that
"using these systems for mass domestic surveillance is incompatible with democratic values."

Regarding AI's role in weaponry, Amodei asserted that even the most advanced AI systems currently available

"are simply not reliable enough to power fully autonomous weapons."

He further stated,

"We will not knowingly provide a product that puts America's warfighters and civilians at risk."
Amodei highlighted the necessity of human judgment, noting,
"Without proper oversight, fully autonomous weapons cannot be relied upon to exercise the critical judgment that our highly trained, professional troops exhibit every day. They need to be deployed with proper guardrails, which don't exist today."

Amodei also mentioned that Anthropic had

"offered to work directly with the Department of War on R&D to improve the reliability of these systems, but they have not accepted this offer."

Background on the Meeting and Demands

The meeting on Tuesday, which was requested by Hegseth, was confirmed by a source who spoke to the BBC.

This article was sourced from bbc

Advertisement

Related News