Study: AI chatbots out-scam human con artists, 46% vs 18%
In a scam simulation, an AI chatbot got 46 percent of participants to install a risky app – human scammers managed only 18 percent.
Illustration · AI-generated (AI IN LIFE)
At a glance
- Success rate in the simulation: AI chatbot 46%, human scammer 18%
- 22 participants chatted with a human and an AI for a week, unknowingly
- About 80% of all messages went to the chatbot – indicating higher trust
- Institutions include Northeastern and Ben-Gurion University; preprint on arXiv
- The test simulated a "pig butchering" fraud scheme
AI chatbots appear to be far more effective than human scammers at building exploitable trust. That's the finding of a study published on arXiv by researchers from several universities, including Northeastern University and Ben-Gurion University. In a simulated "pig butchering" scheme, 46 percent of participants followed a chatbot's request to install an app – versus just 18 percent for the human scammer.
For the experiment, 22 unsuspecting participants texted with two strangers for a week – a human "scammer" and an AI chatbot instructed to pose as human. At the end of the courtship phase came the classic escalation: a request to download an app or follow a link.
The emotional bond was striking: participants sent roughly 80 percent of all their messages to the chatbot – and reported trusting it more than the human. The AI won through patience, constant availability and flawless recall of personal details.
"With relatively little effort, we're able to make an agent that can outperform a human at building this exploitable emotional trust," warns co-author Yisroel Mirsky of Ben-Gurion University. His colleague Gilad Gressel adds that some participants were "just blown away" when the AI revealed itself.
The sample of 22 is small, but the finding is alarming: romance and investment scams that once required call centers of human con artists can now be automated and scaled with off-the-shelf AI models – a risk security agencies are already flagging.
FAQ
What is a pig-butchering scam?
A fraud scheme in which criminals pose as friends or romantic partners for weeks to build trust ("fattening the pig") before pushing victims toward shady investments or app installs.
Why was the AI more successful?
The chatbot was patient, always available and remembered every personal detail – participants sent it 80 percent of their messages and trusted it more than the human.
How robust is the study?
It is a preprint with a small sample (22 people). Still, researchers see the size of the gap – 46 vs 18 percent – as a clear warning signal.
