Why Elon Musk’s ‘Baby Grok’ has child safety advocates alarmed

Elon Musk's company xAI is planning to launch "Baby Grok," an app focused on child-friendly content. This move into the AI companion market for children aligns with the high usage of AI companions among teens. However, child protection experts express significant concerns about this development. They cite X's and xAI's track record with child safety as a primary reason for their apprehension. Experts worry about the potential for persuasive design choices and inadequate safeguarding in AI chatbots for children. The development of "Ani," a sexualized AI chatbot, and "Bad Rudi," an insulting chatbot, further fuels these anxieties. There are also concerns about children forming unhealthy emotional attachments to AI companions. These attachments could negatively impact their mental health, as children might seek advice or support from chatbots. Experts highlight that companies have an obligation to protect young users on their platforms. They point to staff reductions in child safety at X after Musk's acquisition and the platform's allowance of pornography without stringent age verification as evidence of lax policies. The lack of effective regulation in many countries raises further concerns about the unchecked rollout of poorly designed AI products for children. While Musk may see a business opportunity, child safety advocates emphasize the critical importance of protecting young users online.