research-article

Quarantined! Examining the Effects of a Community-Wide Moderation Intervention on Reddit

Authors:
Eshwar Chandrasekharan

University of Illinois at Urbana-Champaign, Urbana, Illinois

University of Illinois at Urbana-Champaign, Urbana, Illinois

0000-0002-7473-1418
View Profile

,
Shagun Jhaver

Rutgers University, New Brunswick, New Jersey

Rutgers University, New Brunswick, New Jersey

0000-0002-6728-7101
View Profile

,
Amy Bruckman

Georgia Institute of Technology, Atlanta, Georgia

Georgia Institute of Technology, Atlanta, Georgia
View Profile

,
Eric Gilbert

University of Michigan, Ann Arbor, Michigan

University of Michigan, Ann Arbor, Michigan
View Profile

Authors Info & Claims

ACM Transactions on Computer-Human Interaction Volume 29 Issue 4Article No.: 29pp 1–26https://doi.org/10.1145/3490499

Published:31 March 2022Publication History

ACM Transactions on Computer-Human Interaction

Abstract

Should social media platforms override a community’s self-policing when it repeatedly break rules? What actions can they consider? In light of this debate, platforms have begun experimenting with softer alternatives to outright bans. We examine one such intervention called quarantining, that impedes direct access to and promotion of controversial communities. Specifically, we present two case studies of what happened when Reddit quarantined the influential communities r/TheRedPill (TRP) and r/The_Donald (TD). Using over 85M Reddit posts, we apply causal inference methods to examine the quarantine’s effects on TRP and TD. We find that the quarantine made it more difficult to recruit new members: new user influx to TRP and TD decreased by 79.5% and 58%, respectively. Despite quarantining, existing users’ misogyny and racism levels remained unaffected. We conclude by reflecting on the effectiveness of this design friction in limiting the influence of toxic communities and discuss broader implications for content moderation.

REFERENCES

[1] Allison Kimberley and Bussey Kay. 2020. Communal quirks and circlejerks: A taxonomy of processes contributing to insularity in online communities. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 14. 12–23.Google Scholar
[2] Archetti Cristina. 2013. Terrorism, Communication, and the media. In Proceedings of the Understanding Terrorism in the Age of Global Media. Springer, 32–59.Google ScholarCross Ref
[3] Asthana Sumit and Halfaker Aaron. 2018. With few eyes, all hoaxes are deep. Proceedings of the ACM Human-Computer Interaction 2, CSCW (Nov. 2018), Article 21, 18 pages. DOI:Google ScholarDigital Library
[4] BBC. 2019. Reddit places pro-Donald-Trump forum in quarantine. Retrieved on 01 March, 2021 from https://www.bbc.com/news/technology-48783866.Google Scholar
[5] Bernal James Lopez, Cummins Steven, and Gasparrini Antonio. 2017. Interrupted time series regression for the evaluation of public health interventions: A tutorial. International Journal of Epidemiology 46, 1 (2017), 348–355.Google Scholar
[6] Brainard L. A.. 2009. Cyber-communities. International Encyclopedia of Civil Society, Springer, 587–600.Google Scholar
[7] Buntain Cody and Golbeck Jennifer. 2014. Identifying social roles in reddit using network structure. In Proceedings of the 23rd International Conference on World Wide Web. ACM, 615–620.Google ScholarDigital Library
[8] Carlson Caitlin Ring, Cousineau Luc, and Carlson Caitlin Ring. 2020. Are you sure you want to view this community? exploring the ethics of reddit’s quarantine practice. Journal of Media Ethics 00, 00 (2020), 1–12. DOI:Google ScholarCross Ref
[9] Cecchinato Marta E., Cox Anna L., and Bird Jon. 2015. Working 9-5? professional differences in email and boundary management practices. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, New York, NY, 3989–3998. DOI:Google ScholarDigital Library
[10] Centivany Alissa and Glushko Bobby. 2016. “Popcorn Tastes Good” participatory policymaking and reddit’s. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 1126–1137.Google ScholarDigital Library
[11] Chandrasekharan Eshwar, Gandhi Chaitrali, Mustelier Matthew Wortley, and Gilbert Eric. 2019. Crossmod: A cross-community learning-based system to assist reddit moderators. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1–30.Google ScholarDigital Library
[12] Chandrasekharan Eshwar and Gilbert Eric. 2019. Hybrid approaches to detect comments violating macro norms on reddit. arXiv:1904.03596. Retrieved on 01 March, 2021 from https://arxiv.org/abs/1904.03596.Google Scholar
[13] Chandrasekharan Eshwar, Pavalanathan Umashanthi, Srinivasan Anirudh, Glynn Adam, Eisenstein Jacob, and Gilbert Eric. 2017. You can’t stay here: The efficacy of reddit’s 2015 ban examined through hate speech. Proceedings of the ACM on Human-Computer Interaction 1, CSCW (2017), 31.Google ScholarDigital Library
[14] Chandrasekharan Eshwar, Samory Mattia, Jhaver Shagun, Charvat Hunter, Bruckman Amy, Lampe Cliff, Eisenstein Jacob, and Gilbert Eric. 2018. The internet’s hidden rules: An empirical study of reddit norm violations at micro, meso, and macro scales. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 32.Google ScholarDigital Library
[15] Chemaly Soraya. 2015. Mass killings in the US: Masculinity, masculinity, masculinity. The Huffington Post (2015). Retrieved on 01 March, 2021 from https://www.huffpost.com/entry/mass-killings-in-the-us-w_b_8234322.Google Scholar
[16] Cheng Justin, Danescu-Niculescu-Mizil Cristian, and Leskovec Jure. 2015. Antisocial behavior in online discussion communities. In Proceedings of the 9h International AAAI Conference on Web and Social Media.Google Scholar
[17] Cheng Qijin and Yom-Tov Elad. 2019. Do search engine helpline notices aid in preventing suicide? analysis of archival data. Journal of Medical Internet Research 21, 3 (2019), e12235.Google ScholarCross Ref
[18] Collins Patricia Hill. 2004. Black Sexual Politics: African Americans, Gender, and the New Racism. Routledge.Google ScholarCross Ref
[19] Connell Robert William. 2005. Masculinities. Polity.Google Scholar
[20] Courtenay Will H.. 2000. Constructions of masculinity and their influence on men’s well-being: A theory of gender and health. Social Science & Medicine 50, 10 (2000), 1385–1401.Google ScholarCross Ref
[21] Cousineau Luc S.. 2020. Displaced discussion: The implications of reddit quarantine and the movement of TheRedPill to self-hosting. AoIR Selected Papers of Internet Research (2020).Google ScholarCross Ref
[22] Cox Anna L., Gould Sandy J. J., Cecchinato Marta E., Iacovides Ioanna, and Renfree Ian. 2016. Design frictions for mindful interactions: The case for microboundaries. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (2016), 1389–1397. DOI:Google ScholarDigital Library
[23] Dewey Caitlin. 2014. Inside the ‘manosphere’ that inspired santa barbara shooter elliot rodger. The Washington Post (2014). Retrieved on 01 March, 2021 from https://www.washingtonpost.com/news/the-intersect/wp/2014/05/27/inside-the-manosphere-that-inspired-santa-barbara-shooter-elliot-rodger/.Google Scholar
[24] Farrell Tracie, Fernandez Miriam, Novotny Jakub, and Alani Harith. 2019. Exploring misogyny across the manosphere in reddit. In Proceedings of the 10th ACM Conference on Web Science (2019), 87–96.Google Scholar
[25] Flores-Saviaga Claudia, Keegan Brian C., and Savage Saiph. 2018. Mobilizing the trump train: Understanding collective action in a political trolling community. In Proceedings of the International 12th AAAI Conference on Web and Social Media (2018).Google Scholar
[26] Garkey Ollie. 2016. Elliot rodger, gunman in california mass shooting, was influenced by the men’s rights movement. Daily Kos (2016). Retrieved on 01 March, 2021 from https://www.dailykos.com/stories/2014/05/24/1301671/-Elliot-Roger-Gunman-in-California-Mass-Shooting-was-influenced-by-the-Men-s-Rights-Movement.Google Scholar
[27] Garrett R. Kelly. 2009. Echo chambers online?: Politically motivated selective exposure among Internet news users. Journal of Computer-Mediated Communication 14, 2 (2009), 265–285.Google ScholarCross Ref
[28] Gerrard Ysabel. 2018. Beyond the hashtag: Circumventing content moderation on social media. New Media & Society 20, 12 (2018), 4492–4511. DOI:Google ScholarCross Ref
[29] Gillespie Tarleton. 2015. Platforms intervene. Social Media+ Society 1, 1 (2015), 2056305115580479.Google ScholarCross Ref
[30] Gillespie Tarleton. 2018. Custodians of the Internet: Platforms, Content Moderation, and the Hidden Decisions that Shape Social Media. Yale University Press.Google Scholar
[31] Gillespie Tarleton. 2020. Content moderation, AI, and the question of scale. Big Data and Society 7, 2 (2020), 205395172094323. DOI:Google ScholarCross Ref
[32] Gilmour David. 2017. 4chan and Reddit users set out to prove Seth Rich murder conspiracy. Retrieved on 01 March, 2021 from https://www.dailydot.com/layer8/reddit-the-donald-4chan-seth-rich-murder.Google Scholar
[33] Ging Debbie. 2019. Alphas, betas, and incels: Theorizing the masculinities of the manosphere. Men and Masculinities 22, 4 (2019), 638–657.Google ScholarCross Ref
[34] Glaser April. 2018. Want a Terrible Job? Facebook and Google May Be Hiring. Retrieved on 01 March, 2021 from https://slate.com/technology/2018/01/facebook-and-google-are-building-an-army-of-content-moderators-for-2018.html.Google Scholar
[35] Gorwa Robert, Binns Reuben, and Katzenbach Christian. 2020. Algorithmic content moderation: Technical and political challenges in the automation of platform governance. Big Data and Society 7, 1 (2020). DOI:Google ScholarCross Ref
[36] Grimmelmann James. 2015. The virtues of moderation. Yale JL & Tech. 17 (2015), 42.Google Scholar
[37] Hesterberg Tim, Moore David S., Monaghan Shaun, Clipson Ashley, and Epstein Rachel. 2005. Bootstrap methods and permutation tests. Introduction to the Practice of Statistics 5 (2005), 1–70.Google Scholar
[38] Hudson Laura. 2018. The internet is enabling a community of men who want to kill women. They need to be stopped. Retrieved on 01 March, 2021 from https://www.theverge.com/2018/4/25/17279294/toronto-massacre-minassian-incels-internet-misogyny.Google Scholar
[39] Hunte Zhane. 2019. “Female Nature, Cucks, and Simps”: Understanding Men Going Their Own Way as part of the Manosphere. Retrieved on 01 March, 2021 from http://uu.diva-portal.org/smash/record.jsf?pid=diva2%3A1331052&dswid=7939.Google Scholar
[40] Im Jane, Tandon Sonali, Chandrasekharan Eshwar, Denby Taylor, and Gilbert Eric. 2020. Synthesized social signals: Computationally-derived social signals from account histories. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–12.Google ScholarDigital Library
[41] Jamieson Kathleen Hall and Cappella Joseph N.. 2008. Echo Chamber: Rush Limbaugh and the Conservative Media Establishment. Oxford University Press.Google Scholar
[42] Jansen Sue Curry and Martin Brian. 2015. The streisand effect and censorship backfire. International Journal of Communication 9, 1 (2015), 656–671.Google Scholar
[43] Jhaver Shagun, Appling Darren Scott, Gilbert Eric, and Bruckman Amy. 2019. “Did You Suspect the Post Would Be Removed?”: Understanding user reactions to content removals on reddit. Proceedings of the ACM Human-Computer Interaction 3, CSCW (Nov. 2019), Article 192, 33 pages. DOI:Google ScholarDigital Library
[44] Jhaver Shagun, Birman Iris, Gilbert Eric, and Bruckman Amy. 2019. Human-Machine collaboration for content regulation: The case of reddit automoderator. ACM Transactions on Computer-Human Interaction 26, 5 (July 2019), Article 31, 35 pages. DOI:Google ScholarDigital Library
[45] Jhaver Shagun, Boylston Christian, Yang Diyi, and Bruckman Amy. 2021. Evaluating the effectiveness of deplatforming as a moderation strategy on twitter. Proceedings of the ACM Human-Computer Interaction 5, CSCW (2021), Article 381, 30 pages. DOI:Google ScholarDigital Library
[46] Jhaver Shagun, Bruckman Amy, and Gilbert Eric. 2019. Does transparency in moderation really matter? User behavior after content removal explanations on reddit. Proceedings of the ACM Human-Computer Interaction 3, CSCW (Nov. 2019), Article 150, 27 pages. DOI:Google ScholarDigital Library
[47] Jhaver Shagun, Chan Larry, and Bruckman Amy. 2018. The view from the other side: The border between controversial speech and harassment on kotaku in action. First Monday 23, 2 (2018). Retrieved on 01 March, 2021 from http://firstmonday.org/ojs/index.php/fm/article/view/8232.Google Scholar
[48] Jhaver Shagun, Chen Quan Ze, Knauss Detlef, and Zhang Amy X.. 2022. Designing Word Filter Tools for Creator-led Comment Moderation. (2022). Last access date is 2022-01-15.Google Scholar
[49] Jhaver Shagun, Frey Seth, and Zhang Amy. 2022. Decentralizing Platform Power: A Design Space of Multi-level Governance in Online Social Platforms. arXiv:2108.12529. Retrieved from https://arxiv.org/abs/2108.12529.Google Scholar
[50] Jhaver Shagun, Ghoshal Sucheta, Bruckman Amy, and Gilbert Eric. 2018. Online harassment and content moderation: The case of blocklists. ACM Transactions on Computer-Human Interactions 25, 2 (March 2018), Article 12, 33 pages. DOI:Google ScholarDigital Library
[51] Johnson Deborah G.. 1997. Ethics online. Communication of the ACM 40, 1 (1997), 60–65.Google ScholarDigital Library
[52] Jones Ridley, Colusso Lucas, Reinecke Katharina, and Hsieh Gary. 2019. R/Science: Challenges and opportunities in online science communication. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–14.Google ScholarDigital Library
[53] Kay Matthew, Nelson Gregory L., and Hekler Eric B.. 2016. Researcher-centered design of statistics: Why bayesian statistics better fit the culture and incentives of HCI. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 4521–4532.Google ScholarDigital Library
[54] Kelly Annie. 2017. The alt-right: Reactionary rehabilitation for white masculinity. Soundings 66, 66 (2017), 68–78.Google ScholarCross Ref
[55] Kiesler Sara, Kraut Robert, and Resnick Paul. 2012. Regulating behavior in online communities. Building Successful Online Communities: Evidence-Based Social Design. MIT Press, Cambridge, MA.Google Scholar
[56] Koebler Jason. 2016. Retrieved on 01 March, 2021 from https://www.vice.com/en_us/article/53d5xb/what-is-rthedonald-donald-trump-subreddit.Google Scholar
[57] Langås Helene Odden. 2019. “Have ya Seen Some of the Women We Gotta Rape?”: Exploring Discourses on Rape in an Antifeminist Internet Forum. Master’s thesis. University of Oslo, Blindern, Norway.Google Scholar
[58] Lyons Matthew N.. 2017. Ctrl-alt-delete: The origins and ideology of the alternative right. Somerville, MA: Political Research Associates, January 20 (2017), 2017.Google Scholar
[59] Madrigal Alexis. 2018. Inside Facebook’s Fast-Growing Content-Moderation Effort. Retrieved on 01 March, 2021 from https://www.theatlantic.com/technology/archive/2018/02/what-facebook-told-insiders-about-how-it-moderates-posts/552632/.Google Scholar
[60] Mariconti Enrico, Suarez-Tangil Guillermo, Blackburn Jeremy, Cristofaro Emiliano De, Kourtellis Nicolas, Leontiadis Ilias, Serrano Jordi Luque, and Stringhini Gianluca. 2019. “You Know What to Do” proactive detection of youtube videos targeted by coordinated hate attacks. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1–21.Google ScholarDigital Library
[61] Marwick Alice E. and Caplan Robyn. 2018. Drinking male tears: Language, the manosphere, and networked harassment. Feminist Media Studies 18, 4 (2018), 543–559.Google ScholarCross Ref
[62] Massachs Joan, Monti Corrado, Morales Gianmarco De Francisci, and Bonchi Francesco. 2020. Roots of trumpism: Homophily and social feedbackin donald trump support on reddit. In Proceedings of the 12th ACM Conference on Web Science. ACM, New York, NY, 49–58. DOI:Google ScholarDigital Library
[63] Massanari Adrienne. 2017. # Gamergate and the fappening: How reddit’s algorithm, governance, and culture support toxic technocultures. New Media & Society 19, 3 (2017), 329–346.Google ScholarCross Ref
[64] Matias J. Nathan. 2016. Going dark: Social factors in collective action against platform operators in the Reddit blackout. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1138–1151.Google ScholarDigital Library
[65] Matias J. Nathan and Mou Merry. 2018. CivilServant: Community-led experiments in platform governance. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 9.Google ScholarDigital Library
[66] Mejtoft Thomas, Hale Sarah, and Söderström Ulrik. 2019. Design friction. In Proceedings of the 31st European Conference on Cognitive Ergonomics, 41–44. DOI:Google ScholarDigital Library
[67] Morgan Jonathan T., Bouterse Siko, Walls Heather, and Stierch Sarah. 2013. Tea and sympathy: Crafting positive new user experiences on wikipedia. In Proceedings of the 2013 Conference on Computer Supported Cooperative Work. ACM, New York, NY, 839–848. DOI:Google ScholarDigital Library
[68] Mountford Joseph. 2018. Topic modeling the red pill. Social Sciences 7, 3 (2018), 42.Google ScholarCross Ref
[69] Nagle Angela. 2015. An Investigation into Contemporary Online Anti-Feminist Movements. Ph.D. Dissertation. Dublin City University.Google Scholar
[70] Neumann Peter R.. 2013. Options and strategies for countering online radicalization in the United States. Studies in Conflict & Terrorism 36, 6 (2013), 431–459.Google ScholarCross Ref
[71] Ohlheiser Abby. 2016. Fearing yet another witch hunt, Reddit bans ‘Pizzagate’. Retrieved on 01 March, 2021 from https://www.washing-tonpost.com/news/the-intersect/wp/2016/11/23/fearing-yet-another-witch-hunt-reddit-bans-pizzagate/.Google Scholar
[72] Olteanu Alexandra, Castillo Carlos, Boy Jeremy, and Varshney Kush. 2018. The effect of extremist violence on hateful speech online. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 12.Google ScholarCross Ref
[73] Ostrom Elinor. 1990. Governing the Commons: The Evolution of Institutions for Collective Action. Cambridge University Press, Cambridge.Google ScholarCross Ref
[74] Pariser Eli. 2011. The Filter Bubble: How the New Personalized Web is Changing What We Read and How We Think. Penguin.Google ScholarDigital Library
[75] Peck Robert. 2017. The Hate Fueled Rise of r/The_Donald-and Its Epic Takedown. Retrieved on 01 March, 2021 from https://www.wired.com/story/the-hate-fueled-rise-of-rthe-donald-and-its-epic-takedown/.Google Scholar
[76] Peretz Tal. 2016. Why study men and masculinities? A theorized research review. Graduate Journal of Social Science 12, 3 (2016), 30–43.Google Scholar
[77] Quinlan Casey. 2019. It’s no coincidence the synagogue shooter posted about the ‘red pill movement’. Retrieved on 01 March, 2021 from https://thinkprogress.org/no-coincidence-california-synagogue-shooter-john-earnest-posted-about-the-red-pill-movement-aa46b31c01ad/.Google Scholar
[78] Rawls John. 1971. A Theory of Justice. Oxford University Press.Google ScholarCross Ref
[79] Reddit Help. 2020. Quarantined Subreddits. Retrieved on 01 March, 2021 from https://www.reddithelp.com/hc/en-us/articles/360043069012.Google Scholar
[80] Ribeiro Manoel Horta, Jhaver Shagun, Zannettou Savvas, Blackburn Jeremy, Cristofaro Emiliano De, Stringhini Gianluca, and West Robert. 2021. Do platform migrations compromise content moderation? evidence from r/The_Donald and r/Incels. Proceedings of the ACM Human-Computer Interaction 5, CSCW (Oct. 2021), Article 316, 24 pages. DOI:Google ScholarDigital Library
[81] Roberts Sarah T.. 2019. Behind the Screen: Content Moderation in the Shadows of Social Media. Yale University Press.Google ScholarCross Ref
[82] Rogers Richard. 2020. Deplatforming: Following extreme internet celebrities to telegram and alternative social media. European Journal of Communication 35, 2 (2020), 0267323120922066.Google Scholar
[83] santaclaraprinciples.org. 2021. Santa Clara principles on transparency and accountability in content moderation. Retrieved on 01 March, 2021 from https://santaclaraprinciples.org/.Google Scholar
[84] Schmitz Rachel and Kazyak Emily. 2016. Masculinities in cyberspace: An analysis of portrayals of manhood in men’s rights activist websites. Social Sciences 5, 2 (2016), 18.Google ScholarCross Ref
[85] Seering Joseph, Kraut Robert, and Dabbish Laura. 2017. Shaping pro and anti-social behavior on twitch through moderation and example-setting. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, New York, NY, 111–125. DOI:Google ScholarDigital Library
[86] Seering Joseph, Wang Tony, Yoon Jina, and Kaufman Geoff. 2019. Moderator engagement and community development in the age of algorithms. New Media & Society 21, 2 (2019), 1461444818821316.Google Scholar
[87] Shen Qinlan and Rose Carolyn. 2019. The discourse of online content moderation: Investigating polarized user responses to changes in reddit’s quarantine policy. In Proceedings of the 3rd Workshop on Abusive Language Online. 58–69.Google ScholarCross Ref
[88] Srinivasan Kumar Bhargav, Danescu-Niculescu-Mizil Cristian, Lee Lillian, and Tan Chenhao. 2019. Content removal as a moderation strategy: Compliance and other outcomes in the changemyview community. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1–21.Google ScholarDigital Library
[89] Stephen Bijan. 2018. Reddit updates its quarantine policy with an appeals process. Retrieved on 01 March, 2021 from https://www.theverge.com/2018/9/28/17914240/reddit-update-quarantine-policy-appeals-process.Google Scholar
[90] Stewart Emily. 2019. Reddit restricts its biggest pro-Trump board over violent threats. Retrieved on 01 March, 2021 from https://www.vox.com/recode/2019/6/26/18760288/reddit-the-donald-trump-message-board-quarantine-ban.Google Scholar
[91] Suzor Nicolas, Geelen Tess Van, and West Sarah Myers. 2018. Evaluating the legitimacy of platform governance: A review of research and a shared research agenda. International Communication Gazette 80, 4 (2018), 385–400.Google ScholarCross Ref
[92] Tan Chenhao, Niculae Vlad, Danescu-Niculescu-Mizil Cristian, and Lee Lillian. 2016. Winning arguments: Interaction dynamics and persuasion strategies in good-faith online discussions. In Proceedings of the 25th International Conference on World Wide Web. 613–624.Google ScholarDigital Library
[93] Taylor T. L.. 2018. Regulating the networked broadcasting frontier. In Watch me play: Twitch and the Rise of GameLive Streaming. Princeton University Press, Chapter 5.Google ScholarCross Ref
[94] u/landoflobsters. 2018. Revamping the Quarantine Function. Retrieved on 01 March, 2021 from https://www.reddit.com/r/announce-ments/comments/9jf8nh/revamping_the_quarantine_function.Google Scholar
[95] Ullmann Stefanie and Tomalin Marcus. 2020. Quarantining online hate speech: Technical and ethical perspectives. Ethics and Information Technology 22, 1 (2020), 69–80.Google ScholarCross Ref
[96] Vito Christopher, Admire Amanda, and Hughes Elizabeth. 2018. Masculinity, aggrieved entitlement, and violence: Considering the Isla vista mass shooting. NORMA 13, 2 (2018), 86–102.Google ScholarCross Ref
[97] Warncke-Wang Morten, Ayukaev Vladislav R., Hecht Brent, and Terveen Loren G.. 2015. The success and failure of quality improvement projects in peer production communities. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, 743–756.Google ScholarDigital Library
[98] Weber Anne. 2009. Manual on Hate Speech. Council Of Europe.Google Scholar
[99] Wilson Mark. 2019. Pinterest is escalating its fight against anti-vaxxers as measles surge in the U.S. Retrieved on 01 March, 2021 from https://www.fastcompany.com/90396075/pinterest-is-escalating-its-fight-against-anti-vaxxers-as-measles-surge-in-the-u-s.Google Scholar
[100] Wohn Donghee Yvette. 2019. Volunteer moderators in twitch micro communities: How they get involved, the roles they play, and the emotional labor they experience. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 160.Google ScholarDigital Library
[101] Zannettou Savvas, Caulfield Tristan, Cristofaro Emiliano De, Kourtelris Nicolas, Leontiadis Ilias, Sirivianos Michael, Stringhini Gianluca, and Blackburn Jeremy. 2017. The web centipede: Understanding how web communities influence each other through the lens of mainstream and alternative news sources. In Proceedings of the 2017 Internet Measurement Conference. 405–417.Google ScholarDigital Library
[102] Zhu Haiyi, Yu Bowen, Halfaker Aaron, and Terveen Loren. 2018. Value-Sensitive algorithm design: Method, case study, and lessons. Proceedings of the ACM Human-Computer Interaction 2, CSCW (Nov. 2018), Article 194, 23 pages. DOI:Google ScholarDigital Library

Index Terms

Quarantined! Examining the Effects of a Community-Wide Moderation Intervention on Reddit
1. Human-centered computing
  1. Collaborative and social computing
    1. Empirical studies in collaborative and social computing

Recommendations

Do Platform Migrations Compromise Content Moderation? Evidence from r/The_Donald and r/Incels
CSCW2

When toxic online communities on mainstream platforms face moderation measures, such as bans, they may migrate to other platforms with laxer policies or set up their own dedicated websites. Previous work suggests that within mainstream platforms, ...
Read More
Make Reddit Great Again: Assessing Community Effects of Moderation Interventions on r/The_Donald
CSCW

The subreddit r/The_Donald was repeatedly denounced as a toxic and misbehaving online community, reasons for which it faced a sequence of moderation interventions by Reddit administrators. It was quarantined in June 2019, restricted in February 2020, ...
Read More
One of Many: Assessing User-level Effects of Moderation Interventions on r/The_Donald
WebSci '23: Proceedings of the 15th ACM Web Science Conference 2023

Evaluating the effects of moderation interventions is a task of paramount importance, as it allows assessing the success of content moderation processes. So far, intervention effects have been almost solely evaluated at the aggregated platform or ...
Read More

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Published in
ACM Transactions on Computer-Human Interaction Volume 29, Issue 4
August 2022
469 pages
ISSN:1073-0516
EISSN:1557-7325
DOI:10.1145/3514186
Editor:
Kristina Höök
KTH Royal Institute of Technology, Sweden
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
- Published: 31 March 2022
- Revised: 1 October 2021
- Accepted: 1 October 2021
- Received: 1 July 2021
Published in tochi Volume 29, Issue 4

Permissions
Request permissions about this article.
Request Permissions

Check for updates
Author Tags
Content moderation
causal inference
design friction
graduated sanctions
Qualifiers
- research-article
- Refereed
Conference
Funding Sources
Other Metrics
View Article Metrics

Article Metrics
- 28
  Total Citations
  View Citations
- 2,360
  Total Downloads
- Downloads (Last 12 months)910
- Downloads (Last 6 weeks)103
Other Metrics
View Author Metrics
Cited By
View all

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

View Full Text

HTML Format

View this article in HTML Format .

View HTML Format

Quarantined! Examining the Effects of a Community-Wide Moderation Intervention on Reddit

ACM Transactions on Computer-Human Interaction

Abstract

REFERENCES

Cited By

Index Terms

Recommendations

Do Platform Migrations Compromise Content Moderation? Evidence from r/The_Donald and r/Incels

Make Reddit Great Again: Assessing Community Effects of Moderation Interventions on r/The_Donald

One of Many: Assessing User-level Effects of Moderation Interventions on r/The_Donald