Internet/Telecom/Social Media

S&R makes major change to commenting policy

CATEGORY: ScholarsAndRoguesOnce upon a time I could be counted on to say something like “the comment thread is often the most important part of a blog post.” When you have an intelligent community of good-faith readers and commenters, the initial post need not be fully baked and comprehensive – it can instead be treated as a conversation-starter, a jumping-off point for something larger and organic. I have learned a great deal in comment threads, and I imagine many of our readers have, as well.

I not only participate in comment threads here at S&R, I have been aggressive in counseling my former employers and business clients with blogs to keep the comment section as open and free as possible because such a policy promotes clear, productive communications between the company and its customers. (It also serves an important canary-in-the-coalmine function – if you let your customers say what they want, a lot of times you’ll glean useful information and you’ll frequently get a clue of impending problems before you would through conventional channels.) In sum, comments good.

Lately my belief in the value of the comments sections has waned, and I’m not alone. Nearly everyone on the S&R staff feels some level of frustration at how unproductive our comment threads have been lately, and many other online publishers are encountering the same issues. How to respond? Some sites, including Xark, Dan Conover and Zen Habits, have gone so far as to completely shut comments off. (Some big names, including Seth Godin, The Dish, John Hawks and Talking Points Memo, never enabled comments in the first place.)

Fueling our individual and anecdotal suspicions that the train has jumped the tracks is a new study suggesting that the modern-day comment thread can actually damage the perceived credibility of the original post.

In an experiment mentioned in the Science paper and soon to be published elsewhere in greater detail, about 2,000 people were asked to read a balanced news report about nanotechnology followed by a group of invented comments. All saw the same report but some read a group of comments that were uncivil, including name-calling. Others saw more civil comments.

“Disturbingly, readers’ interpretations of potential risks associated with the technology described in the news article differed significantly depending only on the tone of the manipulated reader comments posted with the story,” wrote authors Dominique Brossard and Dietram A. Scheufele.

“In other words, just the tone of the comments . . . can significantly alter how audiences think about the technology itself.”

Researchers found that even knowledge of science did not seem to mediate the effects of the comments.

These findings are specifically concerned with scientific conversations, but I suspect a similar dynamic plays out around nearly any kind of expertise-oriented post. I know what I see in comment threads these days often follows the path suggested by the study, regardless of the topic.

Why Have Comment Threads Deteriorated?

So, once upon a time comment threads were great and now they’ve gone to hell. What has happened? I described what I called “Thinkworld vs. Shoutworld” for an op-ed in Editor & Publisher back in 2004, and I suspect what Brossard and Scheufele are finding is eight years of further deterioration around a couple of predictable variables.

First, the rise of social media is siphoning off discussions. There have been a number of times where an S&R post has spurred lengthy and lively comment threads…somewhere else. Like at Reddit or Current or, of course, Facebook. Perhaps the reason here is simple: blogs and online publications like Scholars & Rogues are perceived as “public” space. Anyone can wander in and say whatever.

Your social networks are controlled by you, however. If you want to discuss something we have written, you can port it over to FB and do so with your own circle of trusted friends. You have constructed those networks in a way that suits you – if you don’t like flaming and shouting, you have unfriended the people who are prone to that kind of behavior. Beyond that, these people are “friends,” not strangers. While you may not know them very well all the time, there exists a social contract between you.

Second, what’s left once the nice people are gone? We have known since the ’90s that online conversations can quickly get nasty. Online forums are impersonal and seem to foster appalling behavior of the sort we’d never exhibit in person. There have been any number of times when participants in online groups have hidden behind anonymity and said things to me that they wouldn’t say to my face, and if you have spent more than ten minutes online you have seen this happen. It has probably happened to you. Perhaps you have been the one exhibiting the anti-social behavior yourself, and if so, you may well have felt embarrassed later as you reflected on your actions and words.

The Internet also tends to be a very “male” environment – that is, it favors those who speak loudly and aggressively. Women have never participated as much as we’d like because many of them, if I might generalize a tad, don’t like being bullied by testosterone-soaked jerks. Further, loud debates are frequently not thoughtful ones, which has the effect of driving off a lot of smart folks, most of whom have better things to do than trade insults with people who are more reliant on attitude than intellect.

In other words, over time online environments self-select for the worst elements: the loud, the belligerent, the less informed, those with agendas and firmly closed minds. In other words, says Bora Zivkovic at Scientific American…

But there is another problem here – most of the good, nice, constructive commenters may have gone silent and taken their discussions of your blog elsewhere, but the remaining few commenters are essentially trolls.

This isn’t always the case, of course. We’ve been fortunate here at S&R to host some fantastic comment threads. Lisa Barnard’s recent online dating post, for instance, spurred a genuinely friendly response, and we heard from dozens of people who shared their own experiences in ways that reminded us all of what a comment section ought to be like.

What Can Be Done?

The staff has kicked the comments question around a good bit. We’ve discussed the good and the bad, we’ve offered up a variety of proposals (ranging from “leave it alone” to “kill them entirely”). In the end, we decided that as badly as we want to rid ourselves of the ignoramuses, the jackasses and the trolls, we don’t want to sacrifice those moments where our readers can be genuinely enlightened by smart input from other readers (nor do we want to deprive our thoughtful followers of the chance to engage in public discussions that interest them).

After some discussion, we think we’ve hit on a better model given the current environment: the old newspaper “letters to the editor” section. Our new policy, which is effective immediately, will operate like a cross between that and what we have now.

The New S&R Comment Policy

The comment section will remain at the bottom of each post, and we will encourage readers to craft thoughtful responses to what they’re seeing. Unlike a regular comment thread, which posts the comment unless it’s objectionable, our new approach will reverse the presumption: we will not post a comment unless we feel it legitimately furthers the conversation. This doesn’t mean we’ll require a fully sourced and cited thesis, but it does mean that we need to see evidence of thought and/or insight.

It also means that we won’t be green-lighting any of the “me, too” comments you find on most blogs. If your response is essentially “hey, I like this,” then please hit the “Like” button at the top of the page (and even better, click the links at the bottom of the post, which make it easy for you to share the article with your social networks).

We don’t want our new policy to come off as too intimidating. We do want to set the bar higher, though. If you read the site regularly, it’s obvious how much effort our writers put into S&R, and we can no longer abide those cases where our hard work is undermined by commenters who aren’t advancing the conversation or who are deliberately sabotaging it for their own narrow, cynical ends.

It goes without saying that hateful, ad hominem, substance-free submissions will be deleted and repeat offenders will be banned.

14 replies »

  1. You write, “The comment section will remain at the bottom of each post, and we will encourage readers to craft thoughtful responses to what they’re seeing. Unlike a regular comment thread, which posts the comment unless it’s objectionable, our new approach will reverse the presumption: we will not post a comment unless we feel it legitimately furthers the conversation.”

    I had thought about suggesting that you try an approach similar to something I have seen on other sites. They will start with the presumption that a comment should not be posted, then if they find value in it, they will post it. But then they will go a step further, and if someone establishes that they write decent comments, then they will green light that person, and whatever that person writes will automatically go through, but may be removed later. Then if what that person writes requires it, the automatic green light will be revoked.

    However, I believe your mentioning the “Me, too!” type of comment gets at a weakness in this approach. You may very well green light someone, but if at some later point their comments end up being less carefully thought out, all too often amounting to a “Me, too!”, out of a sense of shared values, you might not wish to hurt their feelings by revoking their green light, even though the quality of their comments has begun to suffer and actually reduces the quality of discussion.

    Unfortunately this also means that there will be a delay between when people submit a comment, no matter who they are, and the appearance of the comment. This will likewise reduce much of the exchange and spontaneity of discussion. But it seems there are always tradeoffs, and the option that you have chosen may very well be the best, one that puts the focus where it belongs: on the main essay itself.

    I do wonder what the effects of your new policy will be on the volume of traffic. People will often times go to websites in order to participate in discussions, and in the process may discuss points in greater detail, or simply become aware of new essays. However, I will assume that you have the ability the measure this traffic and will adjust your policy if this appears necessary.

    But a precipitous drop in the volume of discussion does not necessarily translate into a drop in the volume of traffic. Climate Progress has greatly reduced the volume of comments that its posts receive, but the volume of traffic remains quite high.

    You write, “When you have an intelligent community of good-faith readers and commenters, the initial post need not be fully baked and comprehensive – it can instead be treated as a conversation-starter, a jumping-off point for something larger and organic. I have learned a great deal in comment threads, and I imagine many of our readers have, as well.”

    This reminds me of something I saw at St. John’s College, a school that emphasized the value of dialogue, where the class would be given reading assignments and teachers would primarily offer gentle guidance in classroom discussions:

    “Oftentimes people wouldn’t have read the assignments, and the discussion would simply turn into some sort of bull session where people would simply debate poorly thought-out personal opinions. This happened the good majority of the time. Alternatively, some one person would try to dominate the discussion, and we would simply end up discussing his views.

    “However, every once in a while we would have a genuine dialogue where insight would build upon insight upon insight until the illumination was almost blinding. Individuals who normally didn’t seem that terribly bright would have insights which made them seem like geniuses. After an especially good discussion, you would leave the classroom, and it would feel like you were six feet off the ground. It would take more than an hour to come back down to earth.”

    A Conspiracy of Silence

    • Tim, we used to have a policy similar to what you describe – we auto-approved posts after the first post had been moderated. But after discussing the issue internally and reading up a great deal on commenting (as well as looking back at our own experience over the last six years), we decided that we wanted something stronger than we had.

      We’ve updated our comment policy once every 18 months on average since S&R came into existence, so if this doesn’t work out for us, we’ll update it again.

  2. By the way, Tim, congrats on having the first approved comment under the new system. This was a textbook case of what we’re looking for in the threads.

    • I doubt it. There has been talk of Brian running a ToR dedicated to electronic and/or industrial. But the new rules would apply. There is a lot that one can say about bands that goes beyond “they suck” and “DD rulz!” 🙂

      Honestly, we LOVE it when people who know music dive in with thoughtful commentary. We have a lot of readers who know a great deal about music and I have learned a lot from reading what they have to say.

      • I’m glad to hear music posts will be sticking around. 🙂 It cracks me up how invested people are in the bands they like. I don’t post often but love your submitters travelogues and will try to post more than a thank you for sharing. lol

  3. Bravo for adopting the new policy! Off-topic comments and personal attacks make me stop reading discussion threads on most sites I visit.

    Question for your consideration: Does the fact that a lack of social controls (that would inhibit this kind of behavior in the real world), and the necessity for bureaucratic controls (new policy) mean that, as a general principle, some kind of controls must be in place to achieve a productive community effort?

    Thanks. Keep up the great work.

    • Well, I can’t say that social controls are necessary inherently. There may be places where you have fantastic threads and no controls whatsoever. However, if we were seeing what we hoped for at S&R, we wouldn’t have changed anything, I guess. So in our case, a little firmer hand on the wheel was called for.

  4. I heartily agree; I’m an expat and have abandoned 3 websites recently because of the socks, trolls, and generally unproductive comments (I’m being kind).
    I value sites that expand thoughtful views on any given subject.
    We live in fantastically fascinating times; so much to learn, so little time…

  5. It is a wonderful irony that a post about banning trogdolyte commenters brings out a wonderful, genuine, and constructive dialogue by excellent commenters. Well done!

    (Sigh, assuming this comment makes the cut.)