AI Engineer

Role overview

An AI engineer role focused on advancing agentic capabilities inside an open-source TypeScript framework for building AI agents. The position blends research with product engineering, moving fluidly between benchmarks, experiments, and shipped code. The core mission is to give developers better tools for understanding how their agents behave, evaluating performance, and iterating on those agents over time.

Responsibilities

- Build developer-facing tooling that surfaces agent traces, evaluates behavior, and turns results into concrete improvements - Design and run experiments on core agent primitives to map where they perform well and where they break down - Apply experimental findings to refine agent configuration, memory, and overall behavior - Develop automated evaluation, suggestion, and rollout features that enable agents to self-improve without manual tuning - Benchmark primitives against industry-standard datasets and author new evaluation datasets where existing ones fall short - Translate evaluation work into reusable capabilities that external developers can adopt in their own applications

Requirements

- Demonstrated track record of shipping agents and agentic applications into production - Hands-on experience tuning agent behavior to improve accuracy and reliability - Ability to benchmark results against existing datasets, or to design and curate new datasets intelligently when none exist - Comfort working across the spectrum from experiments and benchmarks to product engineering

Benefits and work setup

- Fully remote position on a small, fast-shipping team - Collaboration primarily distributed across North American and European time zones