Can’t Trust That Survey Anymore

Who knows, maybe our inaugural radical Pulse survey (you can still participate!) will be our last? Researchers at Dartmouth just published a paper demonstrating an AI-based tool that defeats all safeguards in online surveys to suss out bots – and thus can flood online surveys (the backbone of many research efforts) with false data.

“We can no longer trust that survey responses are coming from real people,” Westwood said in a press release. “With survey data tainted by bots, AI can poison the entire knowledge ecosystem.”

As my statistics professor quipped some 30 years ago: “Never trust a statistic which you haven’t made up yourself.” Apparently, that sentence is based on a German proverb: “Traue keiner Statistik, die du nicht selbst gefälscht hast.” Who knew?!

A Researcher Made an AI That Completely Breaks the Online Surveys Scientists Rely On

Pascal Finette @radical