anonymity and privacy seem to come at odds with a social platform’s ability to moderate content and control spam.

If users have sufficient privacy and anonymity, then they can simply use another identity to come back, or use multiple identities.

Are there ways around this? It seems that any method of ensuring that a banned user is kept off the platform would necessitate the platform knowing information about the user and their identity

  • @tr00st
    7•1 year ago

    Two main points personally:

    • with self-moderation, you can’t really say “I don’t want to see this sort of content”, you can only say “I don’t want to see this content again”. A well stated set of rules for a community let’s you know what to expect, so you get to make that choice if advance. This is a massive difference in preventing distress and general unpleasant feelings. It’s not absolutely necessary, but it’s a lot nicer.
    • it avoids massive duplication of effort. If you have a moderator-to-reader ratio of 1000:1, you’ll be saving the vast majority of self moderation with those people would be doing. Yes, reporting exists, but it’s a tiny fraction of the time one would spend “moderating” for yourself
    • CyclohexaneOP
      3•1 year ago

      Great points; thanks! On that, there’s a couple of ways I could see content moderation involving more personal freedom and choice:

      • give users more general types of content. For example “block all content containing ____ racial slur”. Could be made more complex as well, especially with how open source language models are coming along

      • give users the ability to follow another user’s content self-moderation choices. Consequently, a group of users can all be part of a group where, if one user flags content or type of content, it applies to others. The niceness of this is that it would be extremely fluid and you can opt out with a button.

      This could lead to better moderation in my opinion, and less disconnect between moderators and users.

      Does not solve the anonymity issue, but that’s for another comment.

      • @tr00st
        1•1 year ago

        Those are reasonable options - though I’m pessimistic enough to believe that trolls will get better than every automated system, so we’d probably want some manual options. I wouldn’t say it’s not possible - just would require quite a bit of work, and would likely be an ongoing battle to improve your auto-moderator.

        It feels like I’m moving the goalposts, so apologies, but your response got me thinking further. The other big advantages I can think of for central censorship is that it can actually prevent hosting of content - which has two benefits:

        • legal concerns - make countries will require the removal of some amount of content - extreme stuff of all the usual sorts. Some jurisdictions will also require minors being prevented from accessing certain content, at least to a reasonable degree - refusing to host that kind of content is an easy solution.
        • community unity and protection - is a lot more abstract, age debatable - but I’d contest that central moderation can give a certain “this content isn’t wanted in our community” that individual censorship won’t. Really difficult to define, though.