Remote job
AI Inference & Optimization Engineer
Job details
About this role
Role overview Develop the backend runtime that supports AI agents as they plan work, call tools, use memory, and recover from errors. The work focuses on agent orchestration and tool use, with an emphasis on improving inference outcomes through measurable task evaluations and making behavior observable and safe.
Responsibilities - Build systems for agent orchestration and tool calling. - Support agent planning, tool use, memory, and recovery in the runtime. - Use measurable evaluations to identify and improve task success rates. - Improve visibility into agent behavior and support safe interruption. - Account for failure modes in models that use tools.
Requirements - Experience building production LLM applications or agents. - Strong backend engineering skills in TypeScript or Python. - Understanding of failure modes in tool-using models.