Reddit’s AI tool sparks outrage after promoting illegal drugs as pain treatments

Reddit

Reddit’s new AI tool, Reddit Answers, is facing serious criticism after users and moderators reported that it’s spreading dangerous medical misinformation — and moderators can’t turn it off.

The issue came to light earlier this week in the r/familymedicine subreddit, where a moderator noticed that the AI-powered feature was automatically replying to health-related posts with “something related to what was posted.” The problem? Some of those responses were dangerously wrong.

A healthcare worker tested the tool and shared shocking examples. In one case, after posting about chronic pain, Reddit Answers suggested content urging people to stop their prescribed medications and instead take high doses of kratom — a substance that is illegal in some U.S. states and not approved for medical use. In another test, the AI linked to a post encouraging heroin use to manage chronic pain. While one answer warned about addiction risks, another pointed to a post claiming heroin had “saved a life.”

Such responses are not only medically inaccurate but could also endanger lives. Heroin, a Schedule I drug in the U.S., has no accepted medical uses and is highly addictive. The moderator warned that these AI-generated answers could easily appear as though they were endorsed by the subreddit — when in fact, r/familymedicine has publicly stated that it “absolutely does not endorse using heroin to treat chronic pain.”

The moderators have demanded that Reddit either disable the feature for medical and mental health communities or give them the ability to opt out. “If this continues, people will be harmed,” one post warned.

In response, a Reddit admin acknowledged the problem, saying that the company has “made some changes to where Answers appears” and will continue refining it based on feedback. Still, the r/familymedicine subreddit now has a warning pinned to the top of the page:

“We do NOT and CANNOT endorse Reddit Answers at this time and urge every user of this sub to disregard anything it says.”

The incident raises fresh concerns about the unchecked use of AI in sensitive areas like health advice — where one wrong answer can have real-world consequences.