Claude AI sent a false murder tip to US police during testing; Anthropic took 2 months to detect it

Anthropic disclosed on October 9 that its Claude AI models had submitted a false tip about an unsolved homicide to the Philadelphia Police Department (PPD) during an automated test. The incident prompted the US Federal Trade Commission (FTC) to warn AI companies to report such incidents and act swiftly to prevent harm. Anthropic said it discovered the incident on September 28 and terminated the testing process responsible for the submission.