February 7, 2022 T&S Newsletter

Early Warning | Policy & Regulations | Jobs & Careers | T&S FAQs

Subscribe to the newsletter here

T&S Early Warning News

Get ahead of new stories that are impacting the T&S industry.

Jimmy Carr slammed by Nadine Dorries over hate speech in Netflix show | Feb 06, 2022

Company Listed: Netflix, Facebook Meta

Carr, 49, has caused uproar for the joke in his Netflix show. Ms Dorries said the Government could legislate to stop offensive remarks - such as those made by Carr - being shown on Netflix. And under the beefed-up Online Safety Bill, tech moguls such as Facebook boss Mark Zuckerberg could end up behind bars if their companies fail to remove illegal content, she warned.

Ms Dorries turned her guns on Carr, saying his comments were "shocking and abhorrent and unacceptable, not just because he was making fun on the basis of people who died in the most appalling circumstances but on the pain and suffering of many thousands of families".

That's not comedy. What Jimmy Carr did is not comedy," she said. The measures in the Bill would not cover the comments carried by the streaming giant but she said powers will be available to hold Netflix to account "very shortly.

In His Dark Material stand-up show, which Carr had introduced as being a "career ender", he said: "When people talk about the Holocaust, they talk about the tragedy and horror of six million Jewish lives being lost to Read more


MindMatters | Feb 04.2022

Company Listed: Social Media

In December, a bill was presented in the New York State Senate that would attempt to hold social media companies responsible for their role in circulating incitements to violence, incitements to self-harm, and misinformation.

Introduced by Democratic/Working Families Party Senator Brad Hoylman of Manhattan, the legislation would empower the state’s Attorney General to bring an action against any social media company that allows for the circulation of content that incites violence or that “includes a false statement of fact or fraudulent medical theory…”.

No person, by conduct either unlawful in itself or unreasonable under all the circumstances, shall knowingly or recklessly create, maintain or contribute to a condition in New York state that endangers the safety or health of the public through the promotion of content, including through the use of algorithms or other automated systems that prioritize content by a method other than solely by time.

Read more

Making social media safer needs a combination of measures

The Times | Feb 04, 2022

Company Listed: Social Media

This year promises to be a big one for social media regulation. The Online Safety Bill in the UK, and the Digital Services Act and Digital Markets Act in the EU, are moving forward. Last year’s revelations by whistleblowers including Frances Haugen have naturally prompted calls for further action.

New regulation is clearly needed to protect users and society. But regulation alone is insufficient and expecting governments to solve all the problems of the digital age is a losing proposition.

Instead, we need to look for more nimble solutions that engage the tech industry, civil society and researchers, and which are better geared towards today’s online challenges.

Read more

Why should we legislate against hurt feelings?

The Times | February 07 2022,

Company Listed: Social Media

When Captain Sir Tom Moore walked lengths of his garden to raise money for the NHS, the 99-year-old war veteran captured the nation’s locked-down hearts. Sadly, for every hero there is a loser just itching to pour forth vitriol and a social media platform ready to provide a receptacle. Upon learning of Captain Tom’s death, Glaswegian Joseph Kelly took to Twitter to inform the world: “The only good brit soldier is a deed one, burn auld fella, buuuuurn.”

Kelly’s tweet was undoubtedly moronic and obnoxious. He quickly deleted it, but not before screenshots were taken and he was reported to the police. Last week Kelly was convicted of sending a “grossly offensive” tweet under Section 127 of the Communications Act (2003). He will be sentenced.

Read more

T&S Policies & Regulations

Regulatory news and policy decisions impacting the T&S ecosystem.

Compare and review T&S Policies for dozens of companies here

Mark Zuckerberg could face jail time under new law, minister warns | Feb 06, 2022

Company Listed: Meta Facebook

Meta CEO Mark Zuckerberg and other Big Tech executives risk ending up in jail if their social media platforms do not block content deemed harmful under upcoming online safety laws, UK Culture Secretary Nadine Dorries has warned.

Speaking to Times Radio on Saturday, Dorries said Zuckerberg, who heads Meta, Facebook’s parent company, and other tech bosses could “absolutely” be put behind bars if they did not comply with the government’s draft Online Safety Bill. She expressed hope that the legislation would be a “notice to the online platforms to say here it is, we’re letting you know what it is now, so start doing what you need to do.”

Under the bill’s proposed ‘duty of care’ regime, communications regulator Ofcom’s powers could jail tech executives for up to two years for failing to remove illegal content, The Telegraph reported. The government had announced on Friday that several new criminal offenses had been added to the bill, including revenge porn, hate crime, fraud, the sale of illegal drugs or weapons, the promotion or facilitation of suicide, people-smuggling, and sexual exploitation.

Read more

Liberals to work with experts on revision of 'fundamentally flawed' online harms bill

Calgary Herald | Feb 03, 2022

Company Listed: Social Media

The Liberals won't meet the timeframe of tabling the legislation within the first 100 days of Parliament’s return, as promised in last year’s federal election. The Liberal government is revising its controversial online harms bill after a slew of criticism complaining that it would infringe privacy and breach Charter rights.

Experts, academics, Google, civil liberties groups and even research librarians took the draft legislation to task, warning the government the plan would result in the blocking of legitimate content, censorship, and violating Canadians’ constitutional and privacy rights. In a “what we heard” report released Thursday, the government outlined feedback it received in 422 different submissions. It still has not released those documents — the only submissions that are available publicly are those that participants released themselves.

The report said “only a small number of submissions from those stakeholders were supportive, or mostly supportive, of the framework as a whole.”

The bill aimed to target online posts in five categories — terrorist content, content that incites violence, hate speech, intimate images shared non-consensually, and child sexual exploitation content. Platforms would have been required to proactively monitor posts and take down illegal content within 24 hours of it being flagged. A new regulator called the Digital Safety Commissioner of Canada would be in charge of enforcement.

Read more

T&S Careers & Jobs

T&S jobs posted recently, often within the last 24 hours, looking for top talent.

Check out all the recent T&S job postings here.

Analytics Lead, Copyright Operations, YouTube Trust and Safety

Google | San Bruno, CA, USA

Posted: Feb 07 2022

  • Bachelor's degree or equivalent practical experience

  • 3 years of management experience leading or managing teams of analysts

  • Experience with risk, analytics, or abuse dynamics in online platforms

  • Experience with SQL across datasets

Lead Incident Manager, Trust and Safety

Google Inc. | Sunnyvale, CA, USA

Posted: Feb 07 2022

  • Bachelor's degree or equivalent practical experience

  • 8 years of experience in the technology industry or a related technical field

  • Experience in managing, coordinating, and ensuring resolution on executive-facing escalations, and incident response across multiple cross-functional teams

  • Ability to work non-standard hours on occasion to support an incident

Program Manager, Trust & Safety

Doordash | San Francisco, CA, USA

Posted: Feb 07 2022

  • You have demonstrated well-honed project management ability in previous work, and you have the ambition to build programs from the ground up

  • The role will require you to have the curiosity and ingenuity to design proof of concepts and analysis, while also working with leadership to build a long-term Safety strategy

  • You are a thoughtful and skilled relationship manager; able to build connections with internal stakeholders and outside safety organizations

  • We will need a self-starter with a can-do attitude who isn’t afraid to roll their sleeves up, can work in a rapidly changing industry, tolerate ambiguity, and demonstrate problem-solving with limited oversight

  • 6+ years focused on project/program management, consulting or corporate strategy Experience managing large cross functional programs with multiple milestones and stakeholders

  • Familiarity and experience working on projects focused on safety on a local, national or international scale

  • Experience working with product and engineering teams to implement change and drive results

Product Manager, Trust & Safety

Discord | New York, NY, USA

Posted: Feb 07 2022

We're looking for a Product Manager reporting to our Sr. Director of Product Management to join us and lead this important area. You will responsible for creating a vision, building systems and features, and ideating creative solutions to advance our mission towards Safety at Discord. What you'll be doing Drive the product philosophy, vision, and roadmap to detect and prevent abuse on Discord Define and own performance against key business metrics and proactively report progress against those goals to the relevant stakeholders. Work with a team of engineers, designers, data scientists, ML, security, legal, policy and trust and safety analysts to keep our users and communities safe from abuse (including spam). Advise product teams across Discord on how to ensure products can’t be used maliciously and that appropriate preventative measures are built from the start. Drive cross-functional execution with growth, security, anti-abuse and product teams to minimize impact of abuse on our users. This work spans machine learning solutions to heuristics to building delightful features in-app. Propose projects that anticipate upcoming product needs to stop abuse that will work at Discord scale and helping drive the vision for preventing abuse on Discord. What you should have Ability to thrive in ambiguous environments, excited about finding solutions to complex problems, and then executing on them Passionate about Discord and about keeping users safe from abuse (including spam) 5 years experience building and shipping great software, including responsibilities driving prioritization, trade-offs, and timelines. 3-5 years product management experience. Proven track record of shipping products from design to deployment. Strong product sense and pride in understanding Discord and our users Strong analytical ability to quickly organize and leverage data to make informed product decisions with cross-functional stakeholders. Sufficient technical domain expertise to drive alignment on technical requirements with Anti-Abuse, ML and Security stakeholders. Bonus Points Previous work in Spam, Abuse or Trust & Safety or passion in learning. BA/BS in Computer Science, Engineering, or relevant technical experience. Strong sense of delightful UI and UX design. Benefits and Perks - Eligible to Fulltime Employees Comprehensive medical insurance including Health, Dental and Vision (plus up to $20,000 for gender affirmation procedures) Mental health resources and quarterly wellness stipends 16 paid holidays, 4 weeks of PTO use-what-you-need sick days Paid parental leave (plus fertility, adoption and other family planning benefits) Generous stipends for headphones, your remote work setup, and lunch on a daily basis (while we’re all remote) Flexible long-term work options (remote and hybrid) Volunteer time off A diverse slate of Employee Resource Groups Plus commuter contributions and other perks for office-based employees About Us Discord is a voice, video and text app that helps friends and communities come together to hang out and explore their interests — from artists and activists, to study groups, sneakerheads, plant parents, and more. With 150 million monthly users across 19 million active communities, called servers, Discord has grown to become one of the most popular communications services in the world. Discord was built without selling ads or user data and instead, offers a premium subscription called Nitro that gives users special perks like higher quality streams and fun customizations.

Senior Trust and Safety Engineer – Java

Zoom Video Communications | Pittsburgh, PA, USA

Posted: Feb 07 2022

  • You earned a Bachelor's Degree in Computer Science, Computer Engineering, or related field

  • Minimum 7+ years of software development experience

  • You work with Java, Spring Boot, and Spring MVC

  • You hold in-depth experience with algorithms, data structures, and performance optimization techniques

  • You have distributed system architecture design knowledge or experience with high traffic, high concurrency system development

  • You built, deployed, and supported an enterprise-scale web applications ta ing into account cloud computing and secure development practices

  • You can partner with others to promote technical dependencies with other engineering teams, Product Managers, Designers, and Researchers

  • You have a working knowledge of relational and NoSQL databases (such as MySQL, Amazon DynamoDB, MongoDB)

  • You have some Front-End experience using JavaScript, Vue.js, or React

  • You can set goals, and take a logical approach to achieving them

  • 7 to 20+ years

Trust & Safety Ads Review Analyst

Genesis10 | Omaha, NE, USA

Posted: Feb 07 2022

  • 2+ years of experience with Ads review, Ads Targeting, content policy, fraud or anti-abuse operations

  • Experience of fraud trends in Digital Marketing

  • Able to work as a W2 employee of Genesis10 (no Corp-to-Corp)


What is T&S?

Great question (and one the industry hasn’t fully agreed upon). Think of Trust & Safety as the organization that protects social media and Big Tech companies and users from online abuse. As long as users are able to generate content online, time has told us that a minority of these users will create content that is offensive, scandalous, fraudulent, disingenuous, misinformative, hateful, spiteful, and harmful. T&S fights this with flexible policies, resilient operations, and informed detections.

Is T&S interesting?

That depends. If you enjoy stopping bad actors and keeping good people safe, then you’ll love T&S. It requires understanding new technologies and staying on top of breaking issues across society and the world. It also pays Big Tech salaries (no coding skills required).

How do you get into T&S?

That’s the tricky part. The short answer is: not easily. Most T&S orgs are part of Big Tech and (as a result) pay extremely well, so jobs are highly competitive. If you don’t know someone in the industry who can help refer you in, then you can learn more about T&S policies, current events, issues, regulations, and jobs at to improve your hiring chances and start doing meaningful work that helps people.