Search

February 8, 2022 T&S Newsletter



Early Warning | Policy & Regulations | Good News | Jobs & Careers | T&S FAQs

Subscribe to the newsletter here



T&S Early Warning News

Get ahead of new stories that are impacting the T&S industry.

Kids are flocking to Facebook’s ‘metaverse.’ Experts worry predators will follow.

The Washington Post | February 8, 2022

Company Listed: Social Media

I was alone in the virtual world, meandering through a side corridor of a simplistically rendered palace, when a stranger entered.

“Hello?” a small voice called from the palace’s central plaza. “Where are you?”

I hesitated. The voice sounded like it belonged to a child.

“I can’t find you,” the child said, plaintively. “Can you give me a hint?”

In theory, kids aren’t allowed in the game. The new virtual-reality app Horizon Worlds, the first foray into the much-hyped “metaverse” for Facebook parent company Meta, is limited to adults 18 and older.

In practice, however, very young kids appear to be among its earliest adopters. The person I met that day, who told me they were 9 and using their parents’ Oculus VR headset, was one of many apparent children I encountered in several weeks on the app. And reviews of Horizon Worlds include dozens of complaints about youngsters, some of them foulmouthed and rude, gleefully ruining the experience for the grown-ups.

But experts say the presence of children in Meta’s fledgling metaverse raises a graver concern: that by mixing children with adult strangers in a largely self-moderated virtual world, the company is inadvertently creating a hunting ground for sexual predators.

Read more

Disinformation, Radicalization, and Algorithmic Amplification: What Steps Can Congress Take?

JustSecurity| February 8, 2022

Company Listed: Social Media

Design features of social media platforms are exploited to promote extremism. The platforms’ after the fact, whack-a-mole approach to content moderation is insufficient. However, Section 230 reform – a popular rallying cry – is a blunt instrument that may lead to unintended suppression of important speech and not address radicalization. Congress or agencies acting on their own should push for transparency, consumer protection (in terms of consistent, transparent enforcement of terms of service), and development of transparent codes of conduct. This approach mirrors elements of Europe’s Digital Services Act and could be endorsed by the United States and European Union (EU).

A Glimpse Inside Online Amplification Engines

When an internal Facebook experiment created a fake account for a fictional user – “Carol Smith,” a 41-year old conservative mother from North Carolina – this account was recommended pages and groups related to QAnon within days of its creation. “Carol” was recommended an account associated with the militia group Three Percenters within three weeks.

This research and other documents released by the Facebook whistleblower Frances Haugen underscore that the design features of large social media platforms are exploited to promote extremism.

Read more

Monday Morning Moan - Meta might take its ball home if Europe's regulators don't make the 'right' decisions

Diginomica | February 7, 2022

Company Listed: Meta Facebook

It's safe to say that the past few days won’t be coming up as fond memories to look back on on Mark Zuckerberg’s personal Facebook timeline. On the back of falling user numbers - apparently the one sin that Wall Street isn’t prepared to turn a commercially expedient blind eye to when it comes to The Company Formerly Known As Facebook - the firm’s share price went into freewill, clocking up the largest ever one day collapse. Meanwhile poor old Zuck himself woke up to find his personal fortune down $30 billion.

But before we all start weeping crocodile tears - no? Me neither! - something else emerged from the embers of last week that’s worth keeping front of mind in the months to come. Remember all those protestations from Zuckerberg about how he wanted government to come up with regulations for the social media sector, such as when he told members of the US Congress.

Read more

Getting Rid of Joe Rogan Won’t Solve the Health Misinformation Problem

The New York Times | February 7, 2022

Company Listed: Spotify

Another week, another platform in trouble for allowing its talent to give voice to misinformation. This time, Joe Rogan suggested that the mRNA Covid-19 vaccines are a type of “gene therapy” and that young people are at a greater risk from the shots than the disease, among other false and dubious health claims featured on his popular, Spotify-hosted podcast. The calls to remove his podcast have only intensified after revelations that he’s also repeatedly used a racist slur on the show, leading Spotify’s chief to apologize to the company’s employees.

The best outcome of the scandal wouldn’t be that Mr. Rogan was kicked off Spotify, at least not for the health bunk. It would be seeing his misleading Covid content in context: It’s just a tiny drop in the ocean of online health nonsense.

Medical drivel has ballooned with the rise of streaming, e-commerce and social media platforms. Unlike the anti-vaccine pamphlets that skeptics handed out centuries ago, people spreading erroneous health advice today can near-instantly reach audiences of millions.

The problem is so much bigger than Joe Rogan or Spotify. And platforms, lawmakers and regulators aren’t keeping up.

Read more

China’s cultural industry is being co-opted for disinformation operations

AspiStrategist | February 7, 2022

Company Listed: Social Media

Beijing’s quest to promote positive images of China overseas blurs the distinction between publicity and propaganda. Government departments contract private companies to funnel disinformation on Western social media and co-opt influencers alongside their legitimate public-relations activities. Consequently, the country’s cultural industry is financially incentivised to follow a broader ideological agenda while being strangled by censorship and regulation on sensitive issues.

On 6 September 2021, a representative from a Hong Kong–based marketing agency, Pear Technology (梨科技), emailed more than 100 English-speaking YouTube influencers, mostly based in the US, offering cash to post promotional videos about Hainan, an island province of the People’s Republic of China. Accidentally, one of the recipients was the shared business email account of YouTube content creators and Chinese Communist Party critics Winston Sterzel and Matthew Tye.

After some initial correspondence, the representative offered Sterzel and Tye a new deal. They had another ‘client’ that could pay US$2,000 to promote a pre-made video insinuating that Covid-19 originated in North America and spread via white-tailed deer.

The emails received by Sterzel and Tye potentially provide new details of how Western content creators or ‘key opinion leaders’ can be approached by private companies to be co-opted into pro-CCP disinformation operations. Key opinion leaders, or ‘influencers’, are individuals who have a significant online following and authority on social media. They typically derive some income from producing social media content and can be leveraged by businesses to build brand awareness or trust in products. In ASPI’s December 2021 report Borrowing mouths to speak on Xinjiang, my colleagues and I explored how the CCP uses foreign social media influencers to shape and push messages domestically and internationally that are aligned with its preferred narratives.

Read more

Price comparison site sues Google for $2.4 billion over alleged antitrust breach

CNBC | February 7, 2022

Company Listed: Google

A Swedish price comparison website is suing Google for 2.1 billion euros ($2.4 billion) over allegations that it manipulated search results in favor of its own competing shopping service.

PriceRunner said Monday that it plans to take Google to court in Stockholm. It’s seeking compensation for damages in relation to a 2017 ruling from the European Commission that Google breached antitrust laws by giving preference to its own shopping comparison product, Google Shopping, through its popular search engine.

After a seven-year investigation into the practices, the EU executive body dealt Google a historic $2.7 billion fine. Google appealed the penalty, but in November 2021, the decision was upheld by the EU’s General Court. The verdict can still be appealed and taken to the EU’s highest court.

PriceRunner CEO Mikael Lindahl said the company launched its lawsuit following “extensive and thorough preparations.”

“We are of course seeking compensation for the damage Google has caused us during many years, but are also seeing this lawsuit as a fight for consumers who have suffered tremendously from Google’s infringement of the competition law for the past fourteen years and still today,” Lindahl said in a statement.

“This is also a matter of survival for many European entrepreneurial companies and job opportunities within tech.”

Read more

Feds seek experts’ help in bid to tackle cutting-edge legal issues posed by online harmful content

LawyersDaily| February 7, 2022

Company Listed: Social Media

The federal government has gone back to the drawing board after receiving overwhelmingly negative public feedback to its proposed legislative and regulatory blueprint for tackling online “harmful content.”

During the federal election last fall, the Liberals pledged to introduce online harm regulatory legislation within 100 days of forming government.

At the end of that period, on Feb. 3, 2022, Canadian Heritage Minister Pablo Rodriguez, joined by Justice Minister David Lametti and Public Safety Minister Marco Mendicino, instead announced that the government is applying the brakes and “will engage a group of experts whose mandate will be to collaborate with stakeholders and Canadians, in order to provide the government with advice on how to adjust the proposal.”

Pledging to work “in a transparent and expedited manner” the government said it will propose a revised framework “as soon as possible” and as “as quickly as possible.”

“We are committed to ensuring that online platforms provide safe and respectful experiences for Canadians to engage and share information with one another,” Rodriguez said in a Feb. 3 statement. “This is a very important and complex issue. ... We will continue to engage stakeholders and Canadians in order to get this right.”

Read more

EU Regulators Call for Action to Catch Up to Potential Systemic Risk of Digital Finance

Insurance Journal| February 7, 2022

Company Listed: Social Media

Rapid action is needed to update how cross-border financial services are scrutinized and consumers protected as the sector becomes digitalized with “Big Tech” playing an increased role, European Union regulators said on Monday.

People are turning to social media and using smartphones to buy and sell shares, move money around bank accounts and make payments, a trend accelerated by the COVID-19 pandemic, leaving regulators playing catch-up.

Digital finance has unlocked new synergies between financial and non-financial activities that potentially introduce systemic risk into the market for financial services,” a joint report from the EU’s banking, insurance and markets watchdogs said.

Cloud computing, or banks and other financial firms using outsourced providers for services, is booming, the report said.

It is sometimes unclear how to categorize some digital financial services under existing rules, creating uncertainty over data privacy, anti-money laundering safeguards and how much capital they should be holding, the report said.

It called on the bloc’s executive European Commission, which has opened a public consultation on digital finance, to take a “holistic” view of supervising financial services.

Read more

T&S Policies & Regulations

Regulatory news and policy decisions impacting the T&S ecosystem.

Compare and review T&S Policies for dozens of companies here

State senators seek crackdown on social media sites

ObserverToday | February 7, 2022

Company Listed: Social Media

Two state Senators are proposing a new way of dealing with hateful or violent content posted on social media sites.

State Sen. Brad Hoylman, D-New York City, has introduced S.7568. The legislation, which is co-sponsored by Sen. Anna Kaplan, D-Carle City, creates a cause of action under the state General Obligations Law against anyone who creates or contributes to a condition that endangers the public health or safety by promoting content the person knew is harmful, false or unlawful. That person could be sued by the state Attorney General, a city corporation counsel or a private citizen. The legislation was introduced in late December, but was moved to the Senate Judiciary Committee on Jan. 5. State Sen. George Borrello, R-Sunset Bay, is a member of the Judiciary Committee.

Under the 1996 Communications Decency Act, digital platform companies have legal protection both for content they carry and for removing postings they deem offensive. The shelter from lawsuits and prosecution applies to social media posts, uploaded videos, user reviews of restaurants or doctors, classified ads — or the underworld of thousands of websites that profit from false and defamatory information on individuals.

Section 230 of the law, which outlines the shield, was enacted when many of the most powerful social media companies didn’t even exist. It allowed companies like Facebook, Twitter and Google to grow into the behemoths they are today.

Frances Haugen, an ex-Facebook employee and whistleblower, presented a case in October that Facebook’s systems amplify online hate and extremism and fail to protect young users from harmful content. Her previous disclosures have energized legislative and regulatory efforts around the world aimed at cracking down on Big Tech, and she made a series of appearances recently before European lawmakers and officials who are drawing up rules for social media companies.

Read more

Online safety law to be strengthened to stamp out illegal content

Gov.UK| February 7, 2022

Company Listed: Social Media

Digital Secretary Nadine Dorries today announced extra priority illegal offences to be written on the face of the bill include revenge porn, hate crime, fraud, the sale of illegal drugs or weapons, the promotion or facilitation of suicide, people smuggling and sexual exploitation. Terrorism and child sexual abuse are already included.

Previously the firms would have been forced to take such content down after it had been reported to them by users but now they must be proactive and prevent people being exposed in the first place.

It will clamp down on pimps and human traffickers, extremist groups encouraging violence and racial hate against minorities, suicide chatrooms and the spread of private sexual images of women without their consent.

Naming these offences on the face of the bill removes the need for them to be set out in secondary legislation later and Ofcom can take faster enforcement action against tech firms which fail to remove the named illegal content.

Ofcom will be able to issue fines of up to 10 per cent of annual worldwide turnover to non-compliant sites or block them from being accessible in the UK.

Read more

T&S Good News

Some of the good news in the T&S industry that leaders want to know


Coinbase Explains Guidelines for Removing Accounts and Content

ObserverToday | February 8, 2022

Company Listed: Coinbase

Coinbase's CEO spelled out the crypto exchange's policies on when to remove accounts or moderate content, wading into a broader tech industry debate about free speech, de-platforming and corporate responsibilities.

It's a dangerous precedent, Armstrong wrote in a blog post Friday, when Coinbase (COIN) or any tech company begins to make "judgment calls on difficult societal issues, acting as judge and jury."

Armstrong's post was a timely one given what's happening in Canada, where the crowdfunding platform GoFundMe - at request of Prime Minister Justin Trudeau's government - has frozen distribution of more than C$9 million that had been raised in support of truckers protesting the country's vaccine mandate for truckers who cross into the U.S. It also comes amid mounting pressure on streaming platform Spotify to drop Joe Rogan's podcast for allegedly spreading coronavirus "misinformation."

In describing Coinbase's approach to removal or moderation, Armstrong differentiated between infrastructure products and public-facing products. Infrastructure products are used privately by individual customers and allow access to basic financial services.

For those, he wrote, Coinbase will follow "rule of law," as elected governments, not companies, should decide what is and isn't allowed.

Public-facing products may include user-generated content, with social features visible to large numbers of users, and thus require a more nuanced approach, Armstrong wrote, in an apparent reference to Coinbase's forthcoming marketplace for non-fungible tokens (NFTs).

Read more


T&S Careers & Jobs

T&S jobs posted recently, often within the last 24 hours, looking for top talent.

Check out all the recent T&S job postings here.


Manager, Trust & Safety

SmartNews | San Francisco, CA, USA

Posted: Feb 08, 2022

  • Experience in Ad Quality Assurance or contents moderation

  • Supervise for multiple operators

  • Experience in building new operations from scratch

  • Experience in leading and achieving KPI improvements throughout the year

  • Experience in collaborating with product/engineer team for tool & process development

  • 3+ years in People Management

  • 3+ years in Vendor Management

Trust & Safety Manager- Legal Support

Cloudflare | Los Angeles, CA, USA

Posted: Feb 07, 2022

  • 8+ years experience in a Trust & Safety or customer support role at an Internet service provider or hosting provider processing abuse reports and time sensitive escalations

  • 4+ years experience managing a team effectively with a strong desire to help others learn and grow

  • 2 + years experience managing a largely remote team

  • Experience working with law enforcement and legal requests for customer information

  • Experience in assessing, analyzing and resolving issues, and distilling into communication Experience with analytics and experience solving problems using data and providing practical business insights

  • Strong communication skills across technical and non-technical audiences

  • You understand DNS and how the Internet works

  • Experience with the legal considerations related to hosted material (notice & takedown)

  • Familiarity with DMCA (Digital Millennium Copyright Act), copyright, and trademark issues

  • Experience in sanctions review and compliance

Project Manager, WhatsApp Trust & Safety

Facebook | United States

Posted: Feb 08, 2022

  • WhatsApp is a fast, simple and reliable way to talk to anyone in the world.

  • More than 2 billion people in over 180 countries use WhatsApp to stay in touch with friends and family, anytime and anywhere.

  • WhatsApp helps people connect and share no matter where they are in the world.

  • The Trust & Safety team at WhatsApp is dedicated to ensure that those users have a safe, secure

  • We are responsible for educating and protecting our users from unwanted/unsolicited messages, media, and phishing attempts.

  • We partner with safety engineers to identify patterns and behaviors using internal tools to mitigate attacks and other violations.

  • When Facebook launched in 2004, it changed the way people connect.

Product Manager, Trust and Safety, YouTube

Google Americas | San Bruno, CA, USA

Posted: Feb 08, 2022

  • Bachelor's degree in Computer Science or a related technical field, or equivalent practical experience

  • 7 years of Product Management experience with driving product vision, go-to-market strategy, creating strategic product roadmaps, and working with cross-functional teams

  • Experience with counter abuse or scaled abuse enforcement

  • Experience in web applications


Trust & Safety, Analyst - Moderation Strategy

Indeed | Austin, TX

Posted: Feb 07, 2022

  • This is a remote position with preference for candidates in Dallas, Houston, San Antonio and Austin, Texas.

  • Under the direction of your manager, you improve the job seeker experience by analyzing, investigating, and removing low quality and fraudulent content, while working cross-functionally in order to improve our internal moderation tools.

  • You should be comfortable when asked to perform in-depth analysis and research in a competent and efficient manner.

  • You are able to present your findings in a clear and succinct way.

  • Once the analysis is complete, you are undaunted by developing, communicating, and implementing a plan that may include sweeping product or policy changes.

  • You recognize exploitations of or gaps in products, policies, and standards, and you work toward filling those gaps via product and/or policy revision.

  • Conduct daily reviews in order to find suspicious, malicious, or low-quality accounts

  • Communicate with your peers and cross-functional partners.

T&S FAQs

What is T&S?

Great question (and one the industry hasn’t fully agreed upon). Think of Trust & Safety as the organization that protects social media and Big Tech companies and users from online abuse. As long as users are able to generate content online, time has told us that a minority of these users will create content that is offensive, scandalous, fraudulent, disingenuous, misinformative, hateful, spiteful, and harmful. T&S fights this with flexible policies, resilient operations, and informed detections.


Is T&S interesting?

That depends. If you enjoy stopping bad actors and keeping good people safe, then you’ll love T&S. It requires understanding new technologies and staying on top of breaking issues across society and the world. It also pays Big Tech salaries (no coding skills required).


How do you get into T&S?

That’s the tricky part. The short answer is: not easily. Most T&S orgs are part of Big Tech and (as a result) pay extremely well, so jobs are highly competitive. If you don’t know someone in the industry who can help refer you in, then you can learn more about T&S policies, current events, issues, regulations, and jobs at trustsafetyinstitute.com to improve your hiring chances and start doing meaningful work that helps people.