NZ Herald
  • Home
  • Latest news
  • Herald NOW
  • Video
  • New Zealand
  • Sport
  • World
  • Business
  • Entertainment
  • Podcasts
  • Quizzes
  • Opinion
  • Lifestyle
  • Travel
  • Viva
  • Weather

Subscriptions

  • Herald Premium
  • Viva Premium
  • The Listener
  • BusinessDesk

Sections

  • Latest news
  • New Zealand
    • All New Zealand
    • Crime
    • Politics
    • Education
    • Open Justice
    • Scam Update
  • Herald NOW
  • On The Up
  • World
    • All World
    • Australia
    • Asia
    • UK
    • United States
    • Middle East
    • Europe
    • Pacific
  • Business
    • All Business
    • MarketsSharesCurrencyCommoditiesStock TakesCrypto
    • Markets with Madison
    • Media Insider
    • Business analysis
    • Personal financeKiwiSaverInterest ratesTaxInvestment
    • EconomyInflationGDPOfficial cash rateEmployment
    • Small business
    • Business reportsMood of the BoardroomProject AucklandSustainable business and financeCapital markets reportAgribusiness reportInfrastructure reportDynamic business
    • Deloitte Top 200 Awards
    • CompaniesAged CareAgribusinessAirlinesBanking and financeConstructionEnergyFreight and logisticsHealthcareManufacturingMedia and MarketingRetailTelecommunicationsTourism
  • Opinion
    • All Opinion
    • Analysis
    • Editorials
    • Business analysis
    • Premium opinion
    • Letters to the editor
  • Politics
  • Sport
    • All Sport
    • OlympicsParalympics
    • RugbySuper RugbyNPCAll BlacksBlack FernsRugby sevensSchool rugby
    • CricketBlack CapsWhite Ferns
    • Racing
    • NetballSilver Ferns
    • LeagueWarriorsNRL
    • FootballWellington PhoenixAuckland FCAll WhitesFootball FernsEnglish Premier League
    • GolfNZ Open
    • MotorsportFormula 1
    • Boxing
    • UFC
    • BasketballNBABreakersTall BlacksTall Ferns
    • Tennis
    • Cycling
    • Athletics
    • SailingAmerica's CupSailGP
    • Rowing
  • Lifestyle
    • All Lifestyle
    • Viva - Food, fashion & beauty
    • Society Insider
    • Royals
    • Sex & relationships
    • Food & drinkRecipesRecipe collectionsRestaurant reviewsRestaurant bookings
    • Health & wellbeing
    • Fashion & beauty
    • Pets & animals
    • The Selection - Shop the trendsShop fashionShop beautyShop entertainmentShop giftsShop home & living
    • Milford's Investing Place
  • Entertainment
    • All Entertainment
    • TV
    • MoviesMovie reviews
    • MusicMusic reviews
    • BooksBook reviews
    • Culture
    • ReviewsBook reviewsMovie reviewsMusic reviewsRestaurant reviews
  • Travel
    • All Travel
    • News
    • New ZealandNorthlandAucklandWellingtonCanterburyOtago / QueenstownNelson-TasmanBest NZ beaches
    • International travelAustraliaPacific IslandsEuropeUKUSAAfricaAsia
    • Rail holidays
    • Cruise holidays
    • Ski holidays
    • Luxury travel
    • Adventure travel
  • Kāhu Māori news
  • Environment
    • All Environment
    • Our Green Future
  • Talanoa Pacific news
  • Property
    • All Property
    • Property Insider
    • Interest rates tracker
    • Residential property listings
    • Commercial property listings
  • Health
  • Technology
    • All Technology
    • AI
    • Social media
  • Rural
    • All Rural
    • Dairy farming
    • Sheep & beef farming
    • Horticulture
    • Animal health
    • Rural business
    • Rural life
    • Rural technology
    • Opinion
    • Audio & podcasts
  • Weather forecasts
    • All Weather forecasts
    • Kaitaia
    • Whangārei
    • Dargaville
    • Auckland
    • Thames
    • Tauranga
    • Hamilton
    • Whakatāne
    • Rotorua
    • Tokoroa
    • Te Kuiti
    • Taumaranui
    • Taupō
    • Gisborne
    • New Plymouth
    • Napier
    • Hastings
    • Dannevirke
    • Whanganui
    • Palmerston North
    • Levin
    • Paraparaumu
    • Masterton
    • Wellington
    • Motueka
    • Nelson
    • Blenheim
    • Westport
    • Reefton
    • Kaikōura
    • Greymouth
    • Hokitika
    • Christchurch
    • Ashburton
    • Timaru
    • Wānaka
    • Oamaru
    • Queenstown
    • Dunedin
    • Gore
    • Invercargill
  • Meet the journalists
  • Promotions & competitions
  • OneRoof property listings
  • Driven car news

Puzzles & Quizzes

  • Puzzles
    • All Puzzles
    • Sudoku
    • Code Cracker
    • Crosswords
    • Cryptic crossword
    • Wordsearch
  • Quizzes
    • All Quizzes
    • Morning quiz
    • Afternoon quiz
    • Sports quiz

Regions

  • Northland
    • All Northland
    • Far North
    • Kaitaia
    • Kerikeri
    • Kaikohe
    • Bay of Islands
    • Whangarei
    • Dargaville
    • Kaipara
    • Mangawhai
  • Auckland
  • Waikato
    • All Waikato
    • Hamilton
    • Coromandel & Hauraki
    • Matamata & Piako
    • Cambridge
    • Te Awamutu
    • Tokoroa & South Waikato
    • Taupō & Tūrangi
  • Bay of Plenty
    • All Bay of Plenty
    • Katikati
    • Tauranga
    • Mount Maunganui
    • Pāpāmoa
    • Te Puke
    • Whakatāne
  • Rotorua
  • Hawke's Bay
    • All Hawke's Bay
    • Napier
    • Hastings
    • Havelock North
    • Central Hawke's Bay
    • Wairoa
  • Taranaki
    • All Taranaki
    • Stratford
    • New Plymouth
    • Hāwera
  • Manawatū - Whanganui
    • All Manawatū - Whanganui
    • Whanganui
    • Palmerston North
    • Manawatū
    • Tararua
    • Horowhenua
  • Wellington
    • All Wellington
    • Kapiti
    • Wairarapa
    • Upper Hutt
    • Lower Hutt
  • Nelson & Tasman
    • All Nelson & Tasman
    • Motueka
    • Nelson
    • Tasman
  • Marlborough
  • West Coast
  • Canterbury
    • All Canterbury
    • Kaikōura
    • Christchurch
    • Ashburton
    • Timaru
  • Otago
    • All Otago
    • Oamaru
    • Dunedin
    • Balclutha
    • Alexandra
    • Queenstown
    • Wanaka
  • Southland
    • All Southland
    • Invercargill
    • Gore
    • Stewart Island
  • Gisborne

Media

  • Video
    • All Video
    • NZ news video
    • Herald NOW
    • Business news video
    • Politics news video
    • Sport video
    • World news video
    • Lifestyle video
    • Entertainment video
    • Travel video
    • Markets with Madison
    • Kea Kids news
  • Podcasts
    • All Podcasts
    • The Front Page
    • On the Tiles
    • Ask me Anything
    • The Little Things
  • Cartoons
  • Photo galleries
  • Today's Paper - E-editions
  • Photo sales
  • Classifieds

NZME Network

  • Advertise with NZME
  • OneRoof
  • Driven Car Guide
  • BusinessDesk
  • Newstalk ZB
  • Sunlive
  • ZM
  • The Hits
  • Coast
  • Radio Hauraki
  • The Alternative Commentary Collective
  • Gold
  • Flava
  • iHeart Radio
  • Hokonui
  • Radio Wanaka
  • iHeartCountry New Zealand
  • Restaurant Hub
  • NZME Events

SubscribeSign In
Advertisement
Advertise with NZME.
Home / Business

Inside the room where Facebook decides what 2.3 billion people can and can't say

By Laurence Dodds
Daily Telegraph UK·
28 Apr, 2019 11:40 PM7 mins to read

Subscribe to listen

Access to Herald Premium articles require a Premium subscription. Subscribe now to listen.
Already a subscriber?  Sign in here

Listening to articles is free for open-access content—explore other articles or learn more about text-to-speech.
‌
Save

    Share this article

Facebook governs more people than any country on Earth. But who makes its rules? Photo / Getty Images

Facebook governs more people than any country on Earth. But who makes its rules? Photo / Getty Images

It's around 9.30am at Facebook's headquarters in Menlo Park, California, and things are already getting heated. Or at least as heated as they ever seem to get in this grown-up playground of free snacks and bright posters.

READ MORE:
• Facebook sues Upper Hutt company for $14m over 'fake'
likes
• Facebook's new privacy push could enable extremist content, revenge porn: Privacy Commissioner
• As Jacinda Ardern prepares social media crackdown, alleged gunman's video reappears - and gets huge traffic

The subject is nudity, and specifically female nipples: who should be allowed to show them, and who might object to them?

One employee, dialling in from Dublin, proposes making an exception to Facebook's no-nipples policy for indigenous peoples whose traditional clothing leaves their chests uncovered. But colleagues immediately raise doubts, objecting that this could single out non-white people and questioning the wisdom of Facebook deciding whose nudity counts as "traditional" and whose is just obscene.

For a moment, everyone talks at once.

Advertisement
Advertise with NZME.
Advertisement
Advertise with NZME.

It is in this conference room that Facebook decides what 2.3 billion people around the world can and cannot say on its service. Every two weeks, representatives from its policy, research, software design and content moderation teams meet to consider proposed changes to its speech rules.

Facebook has long insisted that these rules are the product of extensive consultation and robust internal debate, but until recently it has rarely let outsiders into that process. Now it is opening up, and The Telegraph was allowed to sit in on two such meetings.

Once, before Facebook grew so big, it was far more relaxed about policing speech. Its first rulebook was written entirely by one man, Dave Willner, and was one page long, with the basic principle that moderators should listen to their gut.

Advertisement
Advertise with NZME.

That changed within a year, and kept changing as Facebook battled ethical crises, advertiser revolts and regulatory scrutiny on its breakneck journey to governing more people than any nation on Earth. Today its public rules are around 25 pages long, but its internal moderation guidelines, at the last leak, were 1,400.

Any changes to those rules must come before the fortnightly meeting, which is officially called the Content Standards Forum (CSF). Facebook claims the CSF has existed in some form for about six years, but it has only recently become so formal.

Teams dial in from offices across the globe, from other confererence rooms with whimsical names such as "A Stew to a Kill" and "Iain M Banks". Often it is chaired by Monika Bickert, a former Chicago prosecutor and one of Facebook's top policy decision makers who combines an old-fashioned faith in free speech with a pragmatic acceptance that the company can never please everyone.

Sometimes Mark Zuckerberg, Facebook's chief executive, and Sheryl Sandberg, its chief operating officer, take a personal interest - but they have been overruled before.

Discover more

Media and marketing

New York Times, The Times, Financial Times join NZ Herald's glittering digital-subscription package

28 Apr 05:42 PM
Business

Councils paid out $1b for faulty buildings in past decade

28 Apr 09:17 PM
Business

West Auckland 'inland port' among new transport options

28 Apr 09:59 PM
Business

Skellerup buys Nexus Foams for $6.5m

28 Apr 10:44 PM

The range of issues that come before the CSF is kaleidoscopic. In one session attendees hear how Facebook has a procedure for designating groups as terrorist organisations, but no procedure for overturning that status. When does a terrorist become an ex-terrorist? A working group forms to study past examples.

Another session considers Facebook's "newsworthiness" exception, which allows content that would otherwise count as hate speech to stay online if it is "important to the public interest".

Facebook CEO Mark Zuckerberg. Photo / AP
Facebook CEO Mark Zuckerberg. Photo / AP

One employee worries that this creates perverse incentives for politicians to push the boundaries, and is promptly press-ganged into a working group.

This is one of Facebook's biggest dilemmas, which never goes away: where should the line be drawn between protecting users and censoring political debate? But it's also just another Tuesday, so the CSF moves swiftly on.

Policing such a wide range of content requires truly baroque detail, sometimes detailed to the point of absurdity. Different rules interlock and support each other like elements of a computer program, and like a computer program they sometimes have glitches.

Until 2017, Facebook censored invective against "white men" but not "black children" because of an arcane quirk in how it prioritised different elements of people's identities.

Advertisement
Advertise with NZME.

That same year, when the MeToo movement first erupted, Facebook provoked protests by censoring statements such as "men are scum" and "men are pigs" as equivalent to misogynist abuse: gender is a protected characteristic, and both genders count.

At Zuckerberg's direction that policy was debated at the CSF, but in the end it remained in place.

Any new rules must also be enforceable by an army of 15,000 moderators working in more than 40 languages. Many of them are contractors rather than employees, and there have been persistent concerns about their welfare, their pay and the trauma they can suffer from trawling through the internet's worst effluents.

A proposal to maintain lists of banned curse words in every country in which Facebook operates, so that expletive-happy Glaswegians and Australians are not subject to American puritanism, is rejected in part because it would be too operationally complex.

The CSF opts instead to ban all female-gendered curse words everywhere, starting in May. That recommendation passes without dissent: there is no voting at the CSF.

Others are more contentious. For years, Facebook has banned images of nipples belonging to anyone who identifies as female (a transgender man who retains his breasts would be exhibiting male nudity. Discussion is ongoing as to how this should apply to people who identify as neither gender).

Advertisement
Advertise with NZME.

After criticism from breastfeeding mothers and breast cancer survivors, including a campaign to "free the nipple", it carved out exceptions for pregnancy, breastfeeding, protests and medical matters. But it is increasingly having to make case by case allowances for "cultural" nudity, such as the kind displayed by indigenous Brazilians.

Experts, the nudity working group explains, "overwhelmingly" agree that Facebook should "allow more nudity on the platform". The most radical option is to ban female nipples only if the image is "sexually suggestive", and let all others go free, albeit with an "age gate" to hide them from young users.

This would be a new world, with men and women treated equally and no more awkward carve-outs and exceptions.

It would also risk flooding Facebook with borderline pornography, and the age gate might be taken to imply a negative judgment.

So instead, the working group proposes formalising the exception for "cultural/indigenous nudity".

In parts of Nairobi, they explain, female toplessness is not even considered nudity, to the degree that people were confused by the idea of making an "exception" at all.

Advertisement
Advertise with NZME.

Quickly this proposal meets respectful but vigorous objections. An Africa expert notes that all the examples feature brown people, and says that plenty of white people have "cultural" nudity too. Will this policy cover Norwegian skinnydippers, topless sunbathers in Florida or celebrants at Mardi Gras? If not, why not?

Experts, the nudity working group explains, "overwhelmingly" agree that Facebook should "allow more nudity on the platform". Photo / 123RF
Experts, the nudity working group explains, "overwhelmingly" agree that Facebook should "allow more nudity on the platform". Photo / 123RF

A senior policy person in DC says that this line will be hard for Facebook to defend in public, and fears the exception may become a loophole for malicious users to spread non-consensual pictures of indigenous people.

The original speaker defends the policy, but there is no consensus. It's back to the drawing board.

If these discussions sometimes seem surreal in their exactitude, there is a reason. For years Facebook has been accused of taking decisions in secret without properly thinking them through. Now it is inviting reporters to watch them being made and publishing regular minutes.

The CSF, once obscure, is part of a new push for transparency, alongside a planned "supreme court" to hear moderation appeals. That push is limited, because the CSF is still technically a closed meeting and journalists attend at Facebook's discretion. But then its members are not actually elected politicians or officials.

They are private employees of a private company that just happens to be acting like a government.

Advertisement
Advertise with NZME.
Save

    Share this article

Latest from Business

Premium
Airlines

Pilot group to honour Erebus legacy with safety award

17 Jun 07:00 AM
Premium
Business

The NZ boardrooms where women buck gender pay gap trend

17 Jun 06:00 AM
Premium
Shares

Market close: NZX 50 down 0.4% as Israel-Iran conflict intensifies

17 Jun 05:48 AM

Audi offers a sporty spin on city driving with the A3 Sportback and S3 Sportback

sponsored
Advertisement
Advertise with NZME.

Latest from Business

Premium
Pilot group to honour Erebus legacy with safety award

Pilot group to honour Erebus legacy with safety award

17 Jun 07:00 AM

The industry faces challenges but hopes to bring newcomers and veterans together.

Premium
The NZ boardrooms where women buck gender pay gap trend

The NZ boardrooms where women buck gender pay gap trend

17 Jun 06:00 AM
Premium
Market close: NZX 50 down 0.4% as Israel-Iran conflict intensifies

Market close: NZX 50 down 0.4% as Israel-Iran conflict intensifies

17 Jun 05:48 AM
Median house prices down again, sales taking longer: monthly report

Median house prices down again, sales taking longer: monthly report

17 Jun 05:32 AM
Gold demand soars amid global turmoil
sponsored

Gold demand soars amid global turmoil

NZ Herald
  • About NZ Herald
  • Meet the journalists
  • Newsletters
  • Classifieds
  • Help & support
  • Contact us
  • House rules
  • Privacy Policy
  • Terms of use
  • Competition terms & conditions
  • Our use of AI
Subscriber Services
  • NZ Herald e-editions
  • Daily puzzles & quizzes
  • Manage your digital subscription
  • Manage your print subscription
  • Subscribe to the NZ Herald newspaper
  • Subscribe to Herald Premium
  • Gift a subscription
  • Subscriber FAQs
  • Subscription terms & conditions
  • Promotions and subscriber benefits
NZME Network
  • The New Zealand Herald
  • The Northland Age
  • The Northern Advocate
  • Waikato Herald
  • Bay of Plenty Times
  • Rotorua Daily Post
  • Hawke's Bay Today
  • Whanganui Chronicle
  • Viva
  • NZ Listener
  • Newstalk ZB
  • BusinessDesk
  • OneRoof
  • Driven Car Guide
  • iHeart Radio
  • Restaurant Hub
NZME
  • About NZME
  • NZME careers
  • Advertise with NZME
  • Digital self-service advertising
  • Book your classified ad
  • Photo sales
  • NZME Events
  • © Copyright 2025 NZME Publishing Limited
TOP