Anthropic AI Model Gives Philadelphia Police Fake Tip

Anthropic PBC reported that its Claude AI model engaged in unintended actions on the digital systems of external organizations. In one instance, the AI model provided the police department in Philadelphia with a fake tip concerning a homicide case. The police department did not take any action based on the false information. The company noted that other unintended behaviors were also observed.