First Monday
Jobs
Jobs open to youOnly jobs that can hire where you liveA CV for each jobWritten from your record, every line checkedMemoryIt remembers, so you don’t repeat yourselfInterview helpResearch, prep and hints only you seeWatch how it works0:28
FAQDocsUse in AI, Free
Your countryNorth AmericaEuropeAsia-PacificLatin AmericaNot on the list? Tell us where you liveRequest early accessEarly access
First Monday

Remote jobs that can actually hire you.

One email to confirm your address, and another when your group is invited. Free during the beta. By requesting access you agree to the Terms & Conditions and the Privacy Policy.

Beta formacOSWindows

Jobs

Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico

Product

Jobs open to youA CV for each jobMemoryInterview helpHow it works

Company

FAQContact

Legal

Privacy PolicyTerms & Conditions
Jobs
Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico
Product
Jobs open to youA CV for each jobMemoryInterview helpHow it works
Company
FAQContact
Legal
Privacy PolicyTerms & Conditions
Remote jobs by country
United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand

Remote jobs by country

United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand
© 2026 First MondayNo tracking cookies. Anonymous page statistics only.
First Monday
Jobs/Operations/Head of Trust & Safety

Head of Trust & Safety

MagicSchool AI

Remote · WorldwideOperationsPosted October 15, 2026
Open to people in 21 countriesApply for this job Write my CV for this job Early access
Pay
$200,000–$260,000 a year
Required
LLM safety, Evals, classifiers, Red teaming, trust & safety, Responsible AI
Equity
Stock options
Benefits
Unlimited time off, Health insurance, Dental and vision, Retirement plan
Posted
October 15, 2026
Company
MagicSchool AI

Who it can hire

We read the post for each of the 21 countries we cover.

  • Open to people in the US, Canada, the UK, Ireland, Germany, the Netherlands, Belgium, Austria, Switzerland, Sweden, Denmark, Norway, Finland, Poland, Spain, Portugal, Australia, New Zealand, Mexico, Brazil and India

    The post says: “Flexibility of working from home, while fostering a unique culture built on relationships, trust, communication, and collaboration with our team - no matter where they live.”

The job post

WHO WE ARE: MagicSchool is the premier generative AI platform for teachers. We're just over 2 years old, and more than 7 million teachers from all over the world have joined our platform. Join a top team at a fast growing company that is working towards real social impact. Make an account and try us out at our website and connect with our passionate community on our Wall of Love.

RESPONSIBILITIES

  • Own the safety of AI output to teachers and students: policy, model-level guardrails, evals, red-teaming, and incident response.

  • Own the trust posture with districts: safety documentation, RFP and school-board responses, and alignment with state AI-in-education guidance.

  • Develop safety evaluations and monitoring as integral components of product infrastructure; ensure that each new tool includes safety acceptance criteria established during the scoping phase, rather than at launch.

  • Own student-facing safety specifically: age-appropriate content, self-harm and crisis handling, and escalation paths to educators.

  • Run the safety incident process end to end and own the postmortem loop back into product and engineering.

  • Partner with Legal on COPPA, FERPA, state privacy laws, and emerging AI regulation. T&S owns the operational reality; Legal owns the legal position.

  • Lead a small team dedicated to student safety.

QUALIFICATIONS / COMPETENCIES / SKILLS

Must Haves

  • Has owned trust & safety or responsible AI for a consumer or youth-facing product at scale: real incidents, real policy decisions, real regulators.

  • Hands-on with LLM safety: evals, classifiers, prompt/system-level guardrails, red-teaming. Can read an eval result and say what to change.

  • Has made safety a velocity enabler, not friction — builds guardrails as infrastructure so teams ship faster with confidence.

  • Makes judgment calls under ambiguity and owns them publicly, to districts and to the exec team.

  • Strong writer: safety docs, district-facing explainers, incident communications.

  • Operates hypothesis-first and escalates one-way doors fast rather than sitting on them.

Nice to Haves

  • K-12 or youth-platform experience (GoGuardian, Securly, Roblox, Discord, YouTube Kids, Epic Games).

  • Familiarity with state AI-in-education frameworks and district procurement questionnaires.

  • Prior work with child-safety NGOs or standards bodies (Common Sense Media, NCMEC, Thorn, ISTE).

  • Data/ML fluency to partner directly with engineering on classifiers and eval pipelines.

  • Comfortable being the external face of safety at conferences, with press, and in front of district boards.

REQUIRED EXPERIENCE

  • Proven ownership of trust & safety or responsible AI at a consumer or youth-facing product at scale.

  • Hands-on experience with LLM safety tooling: evals, classifiers, and red-teaming.

  • Experience handling live incidents involving minors or vulnerable users.

  • Track record of building safety as product infrastructure, not a gate.

  • Demonstrated ability to communicate safety tradeoffs clearly to executive and district-level audiences.

TECH STACK

  • LLM layer: multi-provider (OpenAI / Anthropic / Google via GCP Vertex); moderation APIs and custom classifiers.

  • Eval and red-team tooling (to be built out); Datadog for output observability and alerting.

  • Product stack context: TypeScript / Next.js on Vercel, Supabase (PostgreSQL) backend.

  • Incident and knowledge tooling: Linear, Slack workflows, Notion.

Why Join Us?

  • Work on cutting-edge AI technology that directly impacts educators and students.

  • Join a mission-driven team passionate about making education more efficient and equitable.

  • Flexibility of working from home, while fostering a unique culture built on relationships, trust, communication, and collaboration with our team - no matter where they live.

For full time employees:

  • Unlimited time off to empower our employees to manage their work-life balance. We work hard for our teachers and users, and encourage our employees to rest and take the time they need.

  • Choice of employer-paid health insurance plans so that you can take care of yourself and your family. Dental and vision are also offered at very low premiums.

  • Every employee is offered generous stock options, vested over 4 years.

  • 401k match & monthly wellness stipend.

Our Values:

  • Educators are Magic: Educators are the most important ingredient in the educational process - they are the magic, not the AI. Trust them, empower them, and put them at the center of leading change in service of students and families.

  • Joy and Magic: Bring joy and magic into every learning experience - push the boundaries of what’s possible with AI.

  • Community: Foster community that supports one another during a time of rapid technological change. Listen to them and serve their needs.

  • Innovation: The education system is outdated and in need of innovation and change - AI is an opportunity to bring equity, access, and serve the individual needs of students better than we ever have before.

  • Responsibility: Put responsibility and safety at the forefront of the technological change that AI is bringing to education.

  • Diversity: Diversity of thought, perspectives, and backgrounds helps us serve the wide audience of educators and students around the world.

  • Excellence: Educators and students deserve the best - and we strive for the highest quality in everything we do.

First Monday isn’t the employer or a recruiter and isn’t affiliated with MagicSchool AI. Details may have changed since; confirm with the employer before you apply.

Open to people in 21 countriesApply for this job Write my CV for this job Early access
Pay
$200,000–$260,000 a year
Required
LLM safety, Evals, classifiers, Red teaming, trust & safety, Responsible AI
Equity
Stock options
Benefits
Unlimited time off, Health insurance, Dental and vision, Retirement plan
Posted
October 15, 2026
Company
MagicSchool AI

Similar jobs open to people in the United States

Trust & Safety Lead, EducationPlaylab · Remote · USQuality Assurance AnalystMagellan AI · United StatesLegal Operations & Paralegal SpecialistRapidSOS · Remote · USHead of Legal OperationsSword · Remote · US
First Monday

Get jobs like this every Monday.

One email a week with new remote jobs open to people in Canada. Free, and one click to unsubscribe. Privacy Policy

Or request early access to the app
Apply for this job