Head of Trust & Safety

Role overview Lead trust and safety for an AI product used in educational settings, with responsibility for the safety of model outputs and the confidence of school communities. The role combines policy, technical safeguards, evaluations, incident response, and external communication, while building a small team and embedding safety into product development.

Responsibilities - Set policy and safeguards for AI outputs, including model evaluations, red-team exercises, monitoring, and incident response. - Establish safety acceptance criteria early in product planning and develop evaluations and monitoring as part of product infrastructure. - Define protections for student-facing use, including age-appropriate content, responses to self-harm or crisis situations, and escalation paths to educators. - Lead safety incident handling and postmortems, turning findings into improvements with product and engineering teams. - Prepare safety documentation and responses for school districts, procurement processes, and school boards; align operational practices with relevant education guidance. - Partner with legal counsel on privacy and emerging AI requirements, and build and lead a small trust and safety team.

Requirements - Proven ownership of trust and safety or responsible AI for a consumer or youth-facing product at scale, including real incidents and policy decisions. - Hands-on experience with large language model safety techniques such as evaluations, classifiers, system-level safeguards, and red-teaming. - Experience responding to live incidents involving minors or other vulnerable users. - Track record of building safety measures into product systems and workflows. - Strong judgment under uncertainty and clear communication of safety decisions to executive and district audiences. - Strong writing skills for safety documentation, external explanations, and incident communications.

Nice to have - Experience in K–12 or youth-focused products, familiarity with education AI frameworks or district procurement, or work with child-safety organizations. - Data or machine-learning fluency and comfort representing safety in public or district settings.

Benefits and work setup The role supports working from home. Full-time benefits include flexible paid time off, employer-paid health plan options, dental and vision coverage, equity, a 401(k) match, and a monthly wellness stipend.