Meta has introduced new tools to notify parents when their teenagers discuss suicide or self-harm with the Meta AI chatbot. If parents have activated the supervision feature for their teens on Instagram, they will receive notifications on their own devices if a teenager exhibits signs of crisis while interacting with Meta AI on any Meta platform. Meta AI is accessible on all Meta platforms, including Instagram, WhatsApp, Facebook Messenger, and the standalone Meta.ai website.
This enhancement is an extension of Meta’s safety measures. Previously, when a teen indicated thoughts of self-harm or suicide, the AI chatbot would refer them to crisis helplines and recommend reaching out to a trusted individual. If teenage Instagram users repeatedly search for content related to self-harm and suicide using the platform’s regular search function, it already triggers notifications to parents.
Meta, the parent company of Instagram and Facebook, has rolled out this new feature in Canada, the U.K., the U.S., and Australia. The company had initially announced plans to incorporate a flagging feature into Meta AI back in February.
Moreover, Meta is developing a tool to contact emergency services if conversations with the chatbot by both adults and teens suggest potential self-harm. While stakeholders appreciate the initiative, they believe more improvements are necessary.
London-based technology analyst Carmi Levy mentioned that any advancement providing better safety tools for teens and parents online is beneficial. He emphasized that although the new tool is not flawless and may occasionally generate false alarms, it is a step in the right direction.
According to Sara Austin, founder of Children First Canada, voluntary measures are insufficient, and stricter regulations are needed to protect young individuals. The Safe Social Media Act introduced by the Canadian government in June aims to enforce safety requirements for AI chatbots when users express thoughts of self-harm or suicide.
Meta’s initiative aligns with the ongoing scrutiny of AI’s role in addressing mental health crises among young people. OpenAI faced criticism after an account linked to a tragic incident was not reported to authorities despite exhibiting concerning content. OpenAI has since implemented parental controls and a feature similar to Meta’s to alert parents about risky conversations or potential dangers.
In conclusion, while Meta’s new tool is a positive step towards online safety, continuous improvements and regulatory actions are essential to safeguard young users effectively.