Rethink needed to stop the spread of hateful material online

Digital platform Reddit’s efforts to limit the spread of hateful and misogynistic content is driving users to self-moderated forums where the material can spread largely unchecked, according to new research from The Australian National University (ANU). 

PhD researcher Simon Copland analysed the impact of Reddit’s ‘quarantine’ on two men’s rights subreddits – r/TheRedPill and r/Braincels.  

The quarantine was revamped in 2018 and limits the ability of Reddit users to access particular channels – a similar initiative to recent bans of groups such as QAnon from Facebook, Twitter and YouTube. 

“While the quarantine resulted in a drop in activity of around 50 per cent on both channels, those users who stayed didn’t become less misogynistic in their language,” Mr Copland said. 

“More worryingly, it resulted in a significant campaign from users to migrate to other, self-moderated forums. 

“These forums are watched far less closely and in turn allow hateful material to develop and spread more quickly.  

“Essentially, this move from Reddit simply made the issue someone else’s problem.”  

Mr Copland says this could have larger implications when it comes to banning right wing and hateful material from major social media platforms. 

“Increasingly, we’re seeing large digital platforms become more active in the moderation of material and particular users on their sites,” he said. 

“Earlier this year for example Reddit banned the largest pro-Donald Trump channel, r/The_Donald. More recently Facebook, Twitter and YouTube have banned accounts and removed material associated with QAnon. 

“These bans are increasingly resulting in users, particularly from the far-right, migrating off large platforms to self-moderated ones. This includes the far-right platforms of Gab and Voat, as well as self-moderated communities. Early research is already showing that QAnon followers banned from Facebook, Twitter and YouTube are flooding to some of these platforms. 

“Outside of the eyes of the broader community these spaces can potentially host even more violent and extreme material. Bans also lead these users to further distrust mainstream institutions, potentially entrenching more extremist views.” 

The research has been published in the journal Internet Policy Review. 


FOR INTERVIEW: 
Mr Simon Copland  

School of Sociology  
ANU College of Arts & Social Sciences 
M: +61 423 390 887 
E: simon.copland@anu.edu.au 

For media assistance, contact Jess Fagan on +61 436 694 750 or the ANU Media Team on +61 2 6125 7979 or at media@anu.edu.au.

About The Australian National University

ANU is a world-leading university in Australia’s capital city, Canberra. Our location points to our unique history, ties to the Australian Government and special standing as a resource for the Australian people.

Our focus on research as an asset, and an approach to education, ensures our graduates are in demand the world-over for their abilities to understand, and apply vision and creativity to addressing complex contemporary challenges.

The Australian National University
East Road, Acton
2601 Canberra