Discord says AI bug wrongly banned 8,000 users

·

·

1–2 minutes

Summary

Discord said a moderation bug wrongly banned more than 8,000 users after harmless images were flagged as harmful.

Why this matters

The episode shows how errors in automated moderation can affect thousands of users and disrupt work and communication. It also adds to broader scrutiny of how major platforms use artificial intelligence to enforce content rules.

Discord said a bug in its automated moderation system wrongly banned more than 8,000 users over the past two months after harmless images, including spreadsheets, chessboards, game textures, and white or gray transparent backgrounds, were flagged as harmful content.

The company said the issue had affected accounts since May. It said another 200 users were banned over the weekend before the problem was identified and fixed, and that affected accounts were being restored.

In a thread on X, Discord said its safety system matches uploaded content against databases of known harmful material. The company said that process can produce false positives and that a Trust & Safety team member is supposed to review flagged content before action is taken, but a bug caused affected accounts to be banned immediately.

“We’re working on better safeguards so this can’t happen again,” the company wrote.

Users on X and Reddit said they had been permanently suspended after uploading images with square grid patterns. Some users speculated that Discord’s moderation tools had become more sensitive to grid-like images because such patterns have been used to try to disguise NSFW and child exploitation content from automated detection systems.

“Losing a Discord account to something as unfair as this can be extremely devastating and affect users severely, and every day millions of users are affected by false AI bans. This needs to be stopped,” one X user wrote.

Another user wrote: “My account was wrongfully banned from your platform due to a bug in your AI automod detecting my GAME TEXTURES as CSAM. I need my account back as I’m a game director and use Discord for all my communication. I have requested a review of my suspension.”

Discord is not alone in facing complaints tied to automated moderation. Last year, users of Instagram, Facebook Groups, and Tumblr reported unexplained suspensions they believed were linked to automated systems. Meta did not publicly confirm whether artificial intelligence errors were responsible, though its Oversight Board has called for more transparency.

  • VA settlement may reopen 90,000 disability appeals

    The Federal Circuit said in 2024 that about 3,000 erroneously closed appeals were then known.

    Full story +

  • Iran downed 30 U.S. Reaper drones, official says

    Iran said it shot down one Reaper during U.S. strikes on Tuesday and another “enemy” drone over southern Iran on Wednesday.

    Full story +

  • Trump says U.S. will let Ukraine make Patriots

    The meeting marked a contrast with earlier encounters between the two leaders that ended in acrimony. Trump said he believed a deal to end the war could be near.

    Full story +

  • Trump says Iran deal is over after new strikes

    The heaviest exchange since the MoU was signed on June 17 took place from Tuesday night into Wednesday.

    Full story +

  • Trump says Syria will be removed from terror list

    The United States designated Syria a state sponsor of terrorism in 1979, the longest such designation for any country on the list.

    Full story +

  • U.S. stock futures rise after second day of Iran strikes

    Investors were assessing the June sell-off in chip stocks that pressured the artificial intelligence trade.

    Full story +

  • BofA extends $520 million credit line to OpenAI

    The bank is also seeking advisory roles on the planned IPOs of OpenAI and Anthropic.

    Full story +

  • Elaine Chao Addresses China Trip, McConnell Health

    The trip drew criticism from Rep. Marjorie Taylor Greene, who accused Chao of being a “possible Communist spy.”

    Full story +

  • White House touts gas station selling $3.47 fuel

    A spokesperson said the Trump administration was not involved with the company and was not subsidizing the stations. The company can offer lower prices by reducing its profit margins.

    Full story +

  • Stein vetoes homeless camp bill, signs 12 N.C. laws

    Stein also signed bills on wildlife rules, skiing liability, property tax changes, state crime victim compensation and emergency response, and personnel and administrative changes requested by state agencies.

    Full story +