Meta to alert parents on teen self-harm AI chats

·

·

1–2 minutes

Summary

Meta said it will alert parents if teens discuss suicide or self-harm with its AI chatbot and plans to expand the feature globally this year.

Why this matters

The changes affect how parents can monitor teens’ interactions with Meta AI and how the company responds to potential self-harm risks. They also reflect broader scrutiny of how tech companies handle crisis-related chatbot conversations.

Meta said Thursday it will notify parents if their teen discusses suicide or self-harm with the company’s Meta AI chatbot. The company also said it is developing a way to contact emergency services if conversations suggest someone may be at imminent risk of suicide.

The changes came as Meta and other tech companies faced scrutiny from regulators and parents over how artificial intelligence chatbots respond to users in crisis, especially teenagers.

Meta said it built a dedicated AI system to identify conversations in which a teen makes a clear reference to hurting themselves.

“We understand how distressing these alerts may be for a parent to receive,” Meta wrote in a blog post. “That’s why, as we continue to improve our detection, all chats flagged by our AI will be manually reviewed before an alert is sent. If a teen’s intent is ambiguous, we’ll err on the side of caution and alert the parent. While that means we may sometimes notify parents when there may not be real cause for concern, we feel this is the right starting point, and we’ll continue to monitor to help make sure we’re in the right place.”

Meta said the alerts are live for parents using Instagram Parental Supervision in the U.S., U.K., Australia, and Canada, and will roll out globally by the end of the year.

Meta also said its “Limited Content” setting, which lets parents place teens in a more restrictive Instagram experience, now applies to Meta AI. Meta said the chatbot is already trained to avoid sexual, romantic, or alcohol-related conversations with teens, and that the setting broadens the range of prompts it will decline.

Meta also said it will contact emergency services if a conversation with Meta AI, involving either an adult or a teen, suggests someone is at risk of suicide. Meta said it already takes that step when posts on Facebook or Instagram suggest someone may be at risk.

  • Myanmar approves death penalty in online scam law

    Repatriated foreigners have reported being trafficked to sites in Myanmar and tortured by operators.

    Full story +

  • Hilton Head outages persist after storm-downed tree

    By early Monday, some power had been restored, but outages remained.

    Full story +

  • Meta, BlackRock partner on $14B Texas data center

    The El Paso campus is already under construction and is designed to provide 1 gigawatt of compute capacity for Meta’s AI technologies and core business. Operations are expected to begin in 2028.

    Full story +

  • Pentagon review could reshape U.S. force in Europe

    The review is expected to take up to six months and will provide options that account for “geopolitical and military realities.”

    Full story +

  • U.S. diplomats walk out during France U.N. remarks

    The Trump administration said it would reassess its involvement with the UN after its human rights chief, Volker Turk, was voted in for another four-year term.

    Full story +

  • Israeli raids hit West Bank towns, UN facility

    The Arab League and several Arab states condemned the attacks, including a mosque fire in Tulkarem. Spain also called on Israel to reverse settlement expansion and what it described as shielding settler violence.

    Full story +

  • Trump says Morocco will name Sahara highway for him

    Morocco has not officially confirmed the naming.

    Full story +

  • Pentagon shifts Iran war casualties to new category

    The Pentagon had first updated its system to show 18 killed, then lowered that number to 14.

    Full story +

  • U.S., Iran Extend Strike Pause as Diplomacy Continues

    Iran halted retaliatory attacks after the U.S. stopped strikes.

    Full story +

  • Navy updates flu vaccine rules for some personnel

    The vaccine is required for service members in initial entry training programs and for Navy healthcare personnel who interact with patients.

    Full story +