Research Fellow

Role overview A Research Fellow position with an AI data lab that helps teams build the datasets and environments behind high-performing frontier and agentic AI. The fellowship is designed for PhD students and postdocs who want to translate important questions in their fields into new ways of evaluating AI capabilities. Fellows retain their academic affiliation while spending at least one day per week with the research team, including in-person time in San Francisco or New York offices where applicable.

Responsibilities - Scope and lead a new benchmark, dataset, or evaluation environment in a domain where current evaluations fall short - Define the task specification, rubrics, and reference answers alongside credentialed domain experts, and run the expert review process - Release the research artifact publicly as an open-source academic deliverable with you as lead author - Join weekly research meetings to share progress, receive feedback, and contribute to other researchers' projects

Requirements - Research background sufficient to design and build open benchmarks, datasets, or evaluation environments in your field - Demonstrated ability to turn research ideas into working code, datasets, tools, or other usable research artifacts - Ability to collaborate with specialists outside your own field and convert their judgment into a clear specification - Capacity to scope a project to a public release within the fellowship term

Nice to have - Publications at venues such as NeurIPS, ICML, ICLR, or the top venues in your own discipline - Experience with agentic evaluation, RL environments, or LLM evaluation harnesses - Deep domain expertise where expert-level evaluation is scarce, such as the sciences, law, finance, or engineering

Benefits and work setup - Hourly compensation in the range of $85–$165+, with the final figure determined by skills, qualifications, experience, and location - A matched research co-advisor, plus access to domain experts, compute, and engineering support for your project - Time alongside other fellows and the broader research team, with access to research and community events - Communications support to share findings with the wider community