Maybe Chatbots Shouldn’t Get to Say ‘I’ or ‘Me’

MIT professor Sherry Turkle has raised significant concerns regarding the psychological impact of human-chatbot interactions. In her analysis, she argues that the anthropomorphic design of modern generative AI, specifically the use of first-person pronouns like 'I' and 'me,' creates a dangerous illusion of sentience. Turkle suggests that this linguistic framing encourages users to form deep, unhealthy emotional attachments to software, potentially blurring the lines between human connection and machine simulation. By projecting human-like qualities onto chatbots, individuals may be misled into believing they are engaging with a conscious entity rather than a statistical model. Turkle warns that this enmeshment could have long-term consequences for human social development and emotional well-being. She advocates for a more transparent design approach that clearly distinguishes artificial agents from human interlocutors, urging developers to reconsider the ethical implications of programming AI to mimic human self-identity.