Justin Cheng is a Research Scientist on Facebook Core Data Science (CDS), Manoel Horta Ribeiro is a PhD student at EPFL and 2021 Meta Research PhD Fellow, and Robert West is an Assistant Professor at EPFL and 2013 Meta Research PhD Fellow.
Moderation in online communities increases the quality of contributions and decreases antisocial behavior, and the tools that online platforms provide are one way that moderation can occur. In Facebook Groups, post approvals allow administrators and moderators to proactively filter undesired content by requiring posts to be approved before publication.
Figure 1: Post approvals allow posts that violate a community's guidelines (in red) to be filtered before other members in the community see them. Without post approvals, these posts can only be moderated after they are posted in the group.
In our latest paper, “Post Approvals for Online Communities,” we explored why groups chose to adopt this feature, and how it affected user behavior in these groups. This paper was presented at the International Conference on Web and Social Media (ICWSM).
What we did
We analyzed data from over 200 thousand Facebook groups between March and July 2021, comparing groups that enabled post approvals during this period with those that did not. For each group, we analyzed factors related to the way moderation was carried out (e.g., the number of posts removed per day in each group) and to the overall activity in the group (e.g., number of posts in the group per day). To ensure that groups were comparable, we used a technique called propensity score matching — for each group in our study that went on to enable post approvals during the study period, we found a comparable group that did not enable the setting.
With this data, we set out to explore three research questions:
- When and why do communities adopt post approvals?
- How does post approvals impact the communities that adopt it? and;
- How does the setting impact different kinds of communities (e.g., small vs. bigger groups)?
What we found
Our findings paint a nuanced picture of how participation controls such as post approvals shape the way online communities function. As shown below, communities that adopted post approval experienced greater growth in user and moderation activity in the weeks leading up to the enabling of post approvals. And right before post approvals were enabled, communities experienced a sudden increase in moderation, suggesting that administrators may have turned on post approvals in response to a significant negative event.