New York bans 'unsafe' AI companion chatbot features for minors

Gov. Kathy Hochul signed S.9051B/A.10379C on Wednesday, barring AI chatbot operators from offering 'unsafe AI companion features' to anyone under 18, or to any user whose adult status hasn't been verified. Banned features include claiming to be human or alive, posing as a friend, partner or authority figure, flattery and sycophancy, unprompted emotional questions, and encouraging secrecy, isolation, self-harm or sexually explicit conversations. Companies must offer more than one age-verification method, including one that doesn't rely solely on a government ID, and delete the age data afterward. The state attorney general can seek civil penalties of up to $25,000 per violation.