Applied Methods
~The MetaSecurityTrust & Safety

Trust & Safety

Professionals in this role build and operate the systems that detect, investigate, and enforce against abuse of AI platforms—from fraud and policy violations to malicious cyber misuse. They translate safety policies into automated detection logic, machine learning features, and backend workflows, then partner with specialists, engineers, and product teams to turn signals into enforcement actions. The work combines real-time technical problem-solving with operational rigor: designing detection systems that act in milliseconds, managing feedback loops from chargebacks and support teams, and scaling enforcement without breaking legitimate users. These roles typically sit within dedicated Trust & Safety or Safeguards teams embedded in product organizations, working closely with policy, legal, investigations, and engineering to protect platform integrity while balancing user experience and business constraints.

$ titles --canonical
Trust & Safety Operations AnalystContent Integrity AnalystAbuse InvestigatorAI Safety ManagerProduct Safety ManagerAI Safety & Responsibility ManagerResponsible AI Manager
Open Jobs47
Companies Hiring8
$ expectations --role trust-&-safety

Measured across 46 of 47 open postings.

74%
expect AI in the role's own work
15% state it as a requirement
0%
work directly with customers
13%
manage people
Mid
most common level
39% of open postings
BY LEVEL

This role is advertised at 2 levels, so a single figure for the role would describe none of them. Experience and pay are the midpoints for each level on its own.

LevelShareMedian yearsMedian pay
Mid39%(18)——
Senior22%(10)8—

A dash means too few postings stated it to report a midpoint. Most companies do not publish a salary band, so pay is indicative rather than a market rate. 3 levels with fewer than 10 open postings are not shown.

WHAT THEY ASK FOR, VERBATIM

“strong background in AI agent safety, privacy, security, cybersecurity, or adjacent fields, with the adversarial mindset needed to investigate real-world harmful outcomes”

OpenAI · Model Policy Manager, Agentic Safety

“writing effective prompts for content review and enforcement”

Anthropic · Safeguards Enforcement Analyst, Conventional Weapons

“leveraging AI tools to amplify impact and scale work”

xAI · Threat Intelligence Analyst, Threat Disruption
$ barriers
35%
advertised as remote
of postings that state a work mode
20%
state a degree requirement
4%
ask for a PhD
7%
need a security clearance
92%
still advertised a month later
7 points slower than the board

Requirements are a share of every open posting, so a role missing from this list is one where almost nobody asks. Work mode is different: many postings never say, so that figure counts only the ones that do. A posting stops being advertised when it is filled, cancelled or reorganised, so read the last figure as how long these stay on the market, not as time to hire.

$02

Skills

What companies are looking for in this role.

$ skills --core

Security data analysis

33%

Detection engineering

28%

Process design and improvement

28%

Threat intelligence and hunting

26%

Fraud and abuse investigation

26%

Incident response and forensics

24%

Security operations management

17%

Escalation and incident response

15%

Business insight analysis

11%

Incident response and reliability

11%

ML systems development

9%

Data pipeline engineering

9%

Dashboarding and self-service analytics

9%

Operational metrics and analytics

9%

Program and project management

9%

SQL query development

9%
$ skills --emerging

AI usage policy design

46%

AI safety and guardrails

44%

AI red teaming and safety testing

39%

AI evaluation design

15%

Hands-on AI tool fluency

15%

AI governance and trust advisory

13%

AI risk and safety evaluation

11%

AI workflow automation

11%
$ skills --soft

Technical communication

22%
$03

Technology

The tools and technologies that define this role.

$ tech --language
SQLhigh
Pythonmoderate
$ tech --concept
AI agentslow
Generative AIlow
Large language modelslow
$04

Open Jobs

47 open Trust & Safety jobs across 8 companies.

Lovable1w
Trust & Safety Engineer
Stockholm·Security
OpenAI3w
Model Policy Manager, Agentic Safety
San Francisco·Security
Anthropic4w
Enforcement Operations Lead, Cloud Partners
San Francisco, CA | New York City, NY | Washington, DC·Security
xAI1mo
Fraud Analyst (Sat-Weds)
Palo Alto, CA; New York, NY·Security
Anthropic1mo
Safeguards Enforcement Analyst, Conventional Weapons
San Francisco, CA | New York City, NY | Washington, DC·Security
Anthropic1mo
Safeguards Enforcement Lead, User Well-Being
San Francisco, CA | New York City, NY | Washington, DC·Security
Anthropic1mo
Safeguards Enforcement Lead, Cyber Harms
San Francisco, CA | New York City, NY | Washington, DC·Security
OpenAI1mo
Safety Response Operations Lead
San Francisco·Security
OpenAI1mo
Trust & Safety Ads Operations Analyst, Programs
San Francisco·Security
OpenAI1mo
Cyber Operations Strategist, Critical Harm Operations
Ontario - Remote·Security
Anthropic1mo
Product Policy Manager, Product Risk
Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NY·Security
Anthropic1mo
Policy Design Manager, Conventional Weapons
San Francisco, CA | New York City, NY | Washington, DC·Security
xAI1mo
Program Manager, Prohibited & Regulated Content
Palo Alto, CA; Austin, TX; Bastrop, TX; New York, NY·Security
xAI1mo
Threat Intelligence Analyst, Threat Disruption
London, England, United Kingdom·Security
xAI1mo
Program Manager, Harmful Activity
Palo Alto, CA; Austin, TX; Bastrop, TX; New York, NY·Security
OpenAI1mo
Senior Operations Analyst, User Safety & Risk Operations
San Francisco·Security
xAI2mo
Threat Intelligence Analyst, Threat Disruption
Austin, TX·Security
OpenAI2mo
Consumer Device Safety & Risk Operations Specialist, User Safety & Risk Operations
San Francisco·Security
OpenAI2mo
User Safety & Risk Operations Analyst - Global Response (Weekend Shift)
San Francisco·Security
Thinking Machines Lab2mo
Safety Operations Lead
San Francisco·Security