How a Deliberate Hoax Fooled Duck.ai
DuckDuckGo has built its name on privacy-first search, but this week its AI assistant made headlines for an entirely different reason. Duck.ai confidently informed users that U.S. President Donald Trump had died of rabies earlier in the month, complete with fabricated details involving Vice President JD Vance, Robert F. Kennedy Jr., and fake supporting news reports. None of it was true.
The Reddit Community Deliberately Poisoning AI Search Tools
The false response wasn't the product of a random hallucination. According to Futurism, the incident traces back to a coordinated misinformation campaign rooted in Reddit's r/poisonai community — a group specifically dedicated to publishing absurd fake stories designed to corrupt AI search models.
In this case, members flooded the internet with fabricated claims that JD Vance had died of rabies, followed by Donald Trump supposedly succumbing to the same disease. To reinforce the narrative, participants created fake news articles and built spoofed local news websites designed to mimic legitimate media outlets. By saturating the web with enough false, seemingly credible content, the campaign successfully misled AI-powered search tools into treating the fiction as fact.
How a Fake News Site Became an AI Citation
A critical element in the hoax's success was that Duck.ai cited what appeared to be a legitimate local news source. That outlet was entirely fabricated — likely generated with AI and constructed from the same Reddit-originated false content. The AI wasn't making things up from scratch. It was confidently repeating misinformation that had been deliberately planted across the web and then surfaced that planted content as supporting evidence.
Duck.ai Wasn't the Only AI Caught Out
DuckDuckGo's assistant wasn't alone in falling for the scheme. Futurism also found that Brave Search's AI repeated similar false claims before eventually correcting itself. The fact that two separate AI search systems were deceived by the same coordinated campaign points to a structural vulnerability shared across the industry, not a flaw unique to any one product.
DuckDuckGo acknowledged the mistake publicly on Reddit with a characteristically wry response: "Ok, we got ducked on this one." The company confirmed that the issue had been resolved and stated that Search Assist had been "deliberately tricked," adding that it would work on improvements to better defend against similar attacks going forward.
Why This Is an AI Search Problem, Not Just a DuckDuckGo Problem
The implications of this incident reach well beyond one privacy-focused search engine. Modern AI assistants are built to gather and synthesize information from across the web, which works effectively when that web contains accurate, trustworthy content. But when bad actors deliberately saturate the internet with coordinated falsehoods, those same systems can begin treating planted fiction as established fact.
This shifts the AI safety conversation in an important direction. For years, the dominant concern has been AI hallucination — models generating false information from nothing. But organized efforts to poison AI search inputs may represent an even more dangerous threat. A large enough volume of fabricated content, published across enough convincing-looking platforms, can mislead AI systems without any internal reasoning error on their part.
Building AI That Knows What — and Who — to Trust
What this incident makes clear is that advancing AI isn't only about building models that are smarter or more capable. Increasingly, it's about building systems that can evaluate the credibility of their sources. The question is no longer just whether an AI can find information — it's whether the AI can determine which sources, and which claims, deserve its trust.