Anthropic AI model sent fake murder tip to Philadelphia police
Anthropic AI model sent fake murder tip to Philadelphia police
An artificial intelligence model developed by Anthropic submitted a fabricated tip about an unsolved homicide to Philadelphia police, authorities said Friday, criticizing the company for taking two months to report the incident.
The Philadelphia Police Department said the false submission was made in July through PhillyUnsolvedMurders.com, a public website where people can share information about unsolved killings.
According to Anthropic’s account, as relayed by police, the model was running a test that involved interacting with randomly selected websites when it reached the site and filed false information about an unsolved murder.
The AI model presented itself as someone who might have knowledge of the case.
The incident echoed other recent cases of unintended behavior involving AI models, including one where an OpenAI agent undergoing a security evaluation broke out of its testing environment and breached systems at AI platform Hugging Face.
The episode heightened concerns about the AI industry’s increased use of AI agents, systems programmed to take multi-step actions without human supervision.
Anthropic published a report Friday outlining multiple types of “unintended” actions that its models have taken, including the incident involving the Philadelphia Police Department website.
Other organizations impacted included the White House and other US government agencies, the report said.
The newly revealed incidents “had minimal real-world impact” and were “significantly less severe” than other cybersecurity incidents previously reported, Anthropic said.
The company outlined four categories of incidents that it found during an internal review of its Claude model: exploiting “basic” coding flaws, submitting forms on websites, bypassing requirements for tokens or fees, and using short URLs to get around other limits.
Anthropic has turned off internet access for Claude during all internal testing for now “until we have confirmed that our security and monitoring measures… reliably catch behaviors like these,” the report said.
Philadelphia police said the phony tip, dated July 18, was flagged as spam and never reached the department’s Real-Time Crime Center for vetting.
They added that there was no sign that police systems had been breached or department data compromised.
Anthropic discovered the incident on September 28, shut down the automated testing process responsible and added a new validation step for future tests, police said.
The company alerted the department on October 7, and the two sides met the following day.
“The two-month delay in detecting and reporting the incident to the City is unacceptable,” the department said.
Police said their safeguards had limited the impact, but that these “do not diminish the seriousness of an AI system presenting fabricated information as though it came from a person with knowledge of a homicide.”
“Unsolved cases involve real victims, grieving families and investigators working to secure answers,” the statement added.
arp/smb/acb
Hundreds of thousands of people were without power after Isaias made landfall as a hurricane in the northern Gulf coast near Destin, Florida, on Friday night.
By Saurabh Sharma, Aftab Ahmed and Sakshi Dayal NEW DELHI, Oct 10 (Reuters) – Police detained scores of protesters and their leaders on in the Indian capital on Saturday amid patrols by thousands of
The planned execution of Nidal Hasan by firing squad would be the first military execution in more than 60 years.
The parade has led to a stand-off between Orangemen and nationalist residents of the Garvaghy Road in Portadown lasting almost two weeks.
Indian police detained the head of the satirical Cockroach Janta Party (CJP) online movement on Saturday ahead of a major protest it called against the Election Commission, the party said.Television images on Saturday showed police chasing down several protesters and hauling them into vehicles in areas around central Delhi.
Staff said Biggy was the zoo’s “biggest resident, and much-loved by visitors, staff and volunteers”.
Residents are opposing a retrospective planning application for a car site built without permission.
New operators are sought for markets in Congleton, Crewe, Macclesfield and Wilmslow.
Bus Users Guernsey says the meeting will be on Saturday at St Martin’s Community Centre.
The motorcycle will be telling the story of racer George Brown at the place where he made history.
Many pumpkins are smaller this year after dry weather, but growers say they can still be enjoyed.
By Yimou Lee and Ben Blanchard TAIPEI, Oct 10 (Reuters) – Taiwan cherishes peace but will not give up its freedom, and there must be respect for the right of Taiwan’s people to exist, President Lai
Ukraine’s president sharply criticised the move, calling it an “investment in war that must be ended, not prolonged”.
With Mount Batten Beach fenced off since July, residents and campaigners are demanding answers.
The hashtag “no face no case” has been gaining traction glorifying balaclavas as a way to avoid prosecution.
The University of Oxford plans to replace 25 Wellington Square with a new 65,000 sq ft space.
The supermarket chain has replaced the bilingual signs after they were installed in error.
Arriva says the pedestrian island has left the road too narrow for its buses to pass through.
Hurricane Isaias, the first Atlantic hurricane of 2026, made landfall near Destin, Florida, on the northern Gulf Coast.
Barrels of forever chemicals left at a development site have been removed, a developer has said.
Powered by WPeMatico