AI Evaluation & Safety Engineer

Role overview Build backend systems that let AI agents plan tasks, use tools, retain context, and recover when work goes wrong. The role combines agent orchestration with evaluation and safety work, aiming to make agent performance measurable and behavior observable, interruptible, and safe.

Responsibilities - Design and implement agent orchestration and tool-calling systems. - Develop measurable evaluations to assess and improve task success rates. - Make agent behavior observable so its actions and outcomes can be assessed. - Build controls that allow agent activity to be interrupted safely. - Address failure modes that arise when models use tools.

Requirements - Experience building LLM-powered applications or agents for production use. - Strong backend engineering skills in TypeScript or Python. - Understanding of failure modes in tool-using models.