NEW YORK (AP) — An anthropic artificial intelligence The model submitted a false tip to a Philadelphia police website about an unsolved homicide case, authorities and Anthropic said.
This is the latest example of AI models act involuntarily and manipulate government and other websites during testing. In a report FridayAnthropic also revealed a separate incident when its AI model submitted forms to an undisclosed government website instead of pausing before submitting them.
The Philadelphia incident occurred on July 18 when the Claude Haiku 4.5 AI model was tasked with generating and executing sample tasks on randomly selected web pages, Anthropic said.
Claude filled out a form on the police website PhillyUnsolvedMurders.com indicating he might have information regarding an unsolved murder listed on the site.
Philadelphia police said in a statement that they were unaware of the incident until Anthropic notified them on Wednesday. Then they found the mailing in the website’s tip records and confirmed it was spam and had never been forwarded to police.
There are growing concerns about AI companies uncontrolled AI agents meddling in everything from US government websites to health data. Critics are calling for more regulation.
In September, another AI company, OpenAI, disclosed six reports “unexpected or concerning” behavior in artificial intelligence models.
“Cold cases involve real victims, grieving families and investigators working to get answers,” Philadelphia police said in a statement. “Technology companies must take all appropriate steps necessary to prevent their systems from submitting false information to law enforcement.”
Anthropic said in its report that most of the reported behaviors are forms of what it calls “persistence” — “in which Claude, when he cannot complete a task as expected, works around a restriction instead of stopping.”
The company said it was changing its training to “reduce the risk of further inappropriate behavior.”
Anthropic said it has informed the White House of cases involving U.S. government agencies at the federal, state and local levels, and has notified each agency involved.
Gn bussni
