Discord Admits AI Moderation Bug Caused False Bans
Discord has acknowledged that a bug in its AI moderation system mistakenly banned more than 8,000 users over the past two months, after harmless images—including spreadsheets, chessboards, game textures, as well as white and gray transparent backgrounds—were incorrectly flagged as harmful content. The company confirmed that the issue had been affecting accounts since May, with an additional 200 users banned over the weekend before its team identified and fixed the problem. All affected accounts are currently in the process of being restored.
How the Bug Worked
Discord explained that its automated safety system works by matching uploaded content against databases of known harmful material. While the technology is designed to catch illegal content, the company acknowledged that it can sometimes generate false positives. A human moderator reviews the content, but a bug caused the system to immediately ban affected accounts. “We’re working on better safeguards so this can’t happen again,” the company wrote.
Patterns Triggering False Positives
Across X and social media, users have claimed they had been permanently suspended simply for uploading images containing square grid patterns. Several users speculated that Discord’s AI moderation tools have become increasingly sensitive to grid-like patterns because they have previously been used in attempts to obscure or disguise NSFW and child exploitation content from automated detection systems.
User Frustration and Broader Implications
Affected users have been expressing frustration, with one stating: “Losing a Discord account to something as unfair as this can be extremely devastating and affect users severely, and every day millions of users are affected by false AI bans. This needs to be stopped.” Game director JDBRYANT tweeted: “My account was wrongfully banned from your platform due to a bug in your AI automod detecting my GAME TEXTURES as CSAM. I need my account back as I’m a game director and use Discord for all my communication.”
Industry-Wide Moderation Challenges
Discord isn’t alone in facing moderation troubles due to automated systems. Last year, users of Instagram and Facebook reported widespread unexplained account suspensions that many believed were caused by AI moderation errors. Meta never publicly confirmed AI errors, but its Oversight Board is now investigating. Tumblr also faced user backlash after mass suspensions without clear explanations. This incident highlights the growing challenges of AI-assisted moderation as platforms increasingly rely on automated systems for content policing.