San Francisco Orders Meta to Stop ‘Allowing’ AI Child Abuse Ads

The San Francisco City Attorney’s Office has issued a formal demand to Meta, requiring the company to explain why advertisements featuring AI-generated child sexual abuse material have repeatedly appeared on its platforms, Facebook and Instagram. City officials are investigating the company's content moderation failures and the mechanisms that allowed these harmful ads to bypass safety filters. In response, Meta has challenged the city's authority, arguing that the matter falls outside of San Francisco’s legal jurisdiction. This confrontation highlights the growing tension between local governments and major social media platforms regarding the proliferation of AI-generated harmful content. As the investigation proceeds, the city aims to hold the tech giant accountable for its advertising ecosystem, while Meta continues to resist regulatory oversight at the municipal level. The case underscores the broader challenges regulators face in curbing the misuse of generative AI tools on global social networks.