Kinks vs. Crimes and Gender-Inclusive Content Moderation at Grindr
Release Date: 05/01/2023
When Open Source Community Software is Bought by Private Equity
Community Signal
When private equity buys online community platforms, who wins? What about if those platforms were built on open source software? Does the company continue to be a good citizen of the open source community that helped build the product? History has shown us that it is often the community managers and pros who lose. They might not just lose a good platform though, they might lose their job. has an interesting perspective on this topic. He joined Vanilla Forums, an open source community software platform, as a senior developer in 2011, having already used it for a couple of years. He left...
info_outline
When an Online Community Pro Retires
Community Signal
is a legend of the online community profession. After 30 years, she has retired. But what does it mean when we retire from this work? Her career began AOL in 1994, building communities and managing a massive volunteer program. Among her numerous stops, Rebecca found a focus in child safety, leading such efforts for Sulake (the company behind Habbo Hotels and Disney’s Virtual Magic Kingdom), Mind Candy (Moshi Monsters), and most recently SuperAwesome, a provider of tools for safer, responsible digital engagement with young people, who was acquired by Epic Games. A program manager for...
info_outline
Breaking: Online Community Consultant Discovers Brand New Concept (Again!)
Community Signal
Online community consultants aren’t unlike consultants for any other area of work. Some are ethical, smart, and talented, and some aren’t. Consultants also don’t often make great guests for the show because they view it as yet another lead generational funnel for them to shout generalities into. But hopefully an exception is this episode with community consultant . On it, we discuss how being humble is often at odds with how many consultants promote themselves, as they place a certain importance on appearing authoritative and revelatory, even if that isn’t actually correct in the...
info_outline
Kinks vs. Crimes and Gender-Inclusive Content Moderation at Grindr
Community Signal
Bodies aren’t moderated equally on the internet. Content moderation efforts, especially those at large, mainstream platforms, can suffer from policy-based bias that results in moderation centering a cisgender gaze. This reinforcing of heteronormativity can leave some of your most vulnerable community members – and potential community members – feeling alienated, ostracized, and simply unwelcome. Last year, in her role as CX escalations supervisor at , Vanity Brown co-authored a whitepaper, . Insightful, with a straight forward approach to making content moderation just a bit...
info_outline
Safeguarding a Diabetes Charity Community and Knowing if You’ve Done the Right Thing
Community Signal
Safeguarding is a term used in Ireland and the United Kingdom that covers efforts to protect the health, wellbeing, and human rights of people, especially children and those who are otherwise vulnerable. At , four people alternate by week as the safeguarding lead, helping to protect those that the charity comes in contact with. One of them is Josh Poncil, the online community and learning manager. Among his responsibilities is . On this episode, we talk about safeguarding and knowing if you’ve done the right thing at the end of the day, plus: What is considered “too technical”...
info_outline
Empowering Employee Resource Group Leaders With Your Internal Community Platform
Community Signal
Employee resource groups (ERGs) can do a lot to create a greater sense of belonging at your organization. But the folks who volunteer to lead these groups may find themselves in need of help when it comes to utilizing perhaps the greatest tool at their disposal: Your internal employee community platform. As a community strategist within large organizations, has trained employees to help them get the most out of these platforms. She has also managed two large migrations, both from Jive, and that has led her to have a (in her words) cynical perspective on the resources made available...
info_outline
The Chief Community Officer Hype Machine
Community Signal
As we celebrate Community Signal’s 7th birthday, Patrick takes questions from Community Signal listeners and supporters in this first ever “Ask Patrick Anything” episode of the show. Questions include: If everything had worked with CNN+, what would community look like for the platform? Would you rather be a working community professional or a community consultant? Will we ever see community leaders in the C-suite as the norm? 2023 will be Patrick’s 25th year of community work, so this is an opportunity to reflect on that passage of time. A lot has changed and, surprisingly, some...
info_outline
Elon Musk’s Quest to Make Twitter Worse
Community Signal
Elon Musk’s presence has loomed over Twitter since he announced plans to purchase the platform. And for these few weeks that he’s been in charge, many concerns have proven to be justified. Musk , and then . He is . The verification process, perhaps one of Twitter’s most trusted features, has been unraveled. He’s offered severance to those who don’t want to be part of Following the results of a Twitter poll, , who was suspended from the platform for his role in inciting the January 6th attacks. So, what happens now? What of the many social movements that...
info_outline
When Community is on 3 Teams in 5 Years
Community Signal
As customer base and product offerings have grown, so has its community. The Zendesk community started in 2008, under the support organization, as a space for people to ask and answer questions about using the product. Since then, it has shifted departments multiple times, leading to changes in KPIs and core purpose. , the company’s director of community, joins the show to explain how she has navigated these challenges. Tune in for her approach on thoughtfully managing change and expectations within your community and inside of your organization. Patrick and Nicole also discuss: ...
info_outline
Why Community on the Product Team Works, From a Product Leader’s Perspective
Community Signal
Recently, community pro Danielle Maveal joined Community Signal to discuss . In this episode, we’re getting the opposite perspective from product leader . Gitesh and Patrick worked together at CNN, where community reported into product. And while the product and community that they were building were short lived, they both speak highly of their time working together. Gitesh describes creating a team atmosphere where each individual’s expertise was respected and given room to ladder into organizational goals, giving each person the opportunity to see the impact of their work....
info_outlineBodies aren’t moderated equally on the internet. Content moderation efforts, especially those at large, mainstream platforms, can suffer from policy-based bias that results in moderation centering a cisgender gaze. This reinforcing of heteronormativity can leave some of your most vulnerable community members – and potential community members – feeling alienated, ostracized, and simply unwelcome.
Last year, in her role as CX escalations supervisor at Grindr, Vanity Brown co-authored a whitepaper, Best Practices for Gender-Inclusive Content Moderation. Insightful, with a straight forward approach to making content moderation just a bit better, I found that it was also a validation of good, thoughtful moderation that has been going on for a long time.
Vanity joins the show to talk about these efforts, which are tempered by a realistic acknowledgement of the limitations of this work, and how our need to be in other places (like app stores) can often slow down the progress we’d like to make.
We also discuss:
- Why it’s not our job to guess the gender of our members
- The state of AI trust and safety tools
- ChatGPT, Midjourney, and how much to worry about them
Big Quotes
How bodies are moderated differently online (2:16): “We want folks to express themselves and their sexuality joyfully, without judgment. Of course, without any harm. But what does that look like? … There traditionally are [community] guidelines for females and guidelines for males, but the world is changing and folks are becoming more in tune with who they are, and we want to be able to treat them equally and let folks, especially I emphasize our trans users, who are uploading photos … and if they are showing the top, then they’re considered a woman if they have female-presenting breasts versus male. There are just a lot of nuances there that we saw as we were moderating content from a community who is very fluid with their gender expression.” -Vanity Brown
When do kinks create a moderation issue? (6:38): “[Kinks vs. crimes get] sticky when the kink looks like a crime. … Everything is about sex and kinks at Grindr. With this mass of kinky stuff, which of these things are harmful? I often echo that, in my work, I’m always driven … to do no harm. At the end of the day, are we harming someone? … Do we have a responsibility to protect them and keep them safe? As we continue to build trust with the community, we have to realize that folks are adults, too.” -Vanity Brown
Empathy sits at the core of good moderation (14:38): “If you can’t be empathetic for the things you are not … then you’re not really doing good thoughtful community moderation, trust and safety work. … Ultimately, if you want to be truly great at this work, you have to protect the people who aren’t you.” -Patrick O’Keefe
What can community pros learn from dating apps? (24:23): “[Community, moderation, trust, and safety pros] can learn from dating apps on the level of how personal and sensitive dating apps are in the content you’re sending back and forth. Folks using dating apps, a lot of times their heartstrings are attached, and their heartstrings are attached on a dating app, but not necessarily Amazon or shopping at Macy’s. … It’s just important to look at folks with a microscope and treat them with kindness as those in dating apps hopefully are doing when they’re handling their customers.” -Vanity Brown
About Vanity Brown
Vanity Brown is the CX escalations supervisor for Grindr, where she has worked in trust and safety for over 2 years, following more than 7 years at eHarmony. Vanity manages an escalations team of specialists devoted to handling the most complex cases that come through Grindr’s support channels.
Related Links
- Vanity on LinkedIn
- Grindr, where Vanity is CX escalations supervisor
- Best Practices for Gender-Inclusive Content Moderation whitepaper, co-authored by Alice Hunsberger, Vanity, and Lily Galib, which I found via Juliet Shen
- Grindr’s community guidelines
- OpenAI’s efforts to identify AI-generated text, which were only able to identify “likely” AI-written text 26% of the time, a bit more than the approximately 10% I mentioned during the show
- Love Light Community, a youth choir founded by Vanity, dedicated to “enriching the lives of youth and families in underserved communities through the transforming power of music and the arts”
- Love Light Community on Instagram
Transcript
Your Thoughts
If you have any thoughts on this episode that you’d like to share, please leave me a comment or send me an email. If you enjoy the show, we would be so grateful if you spread the word and supported Community Signal on Patreon.