Remote job
Research Engineer, Takeoff Intel
Job details
About this role
Role overview
Build the evaluation and measurement systems used to understand how AI-assisted research is changing the pace and direction of model development. This generalist research engineering role combines evaluation infrastructure, large-scale data processing, analysis tooling, and rapid prototyping. The work is intended to produce reliable evidence for research prioritization and safety planning, rather than superficial reporting dashboards.
Responsibilities
- Design, implement, and operate evaluations of AI research and development capabilities. - Turn ambiguous research questions into working measurement instruments and prototypes. - Build data pipelines and analysis tools for large, complex datasets. - Develop internal telemetry and methods for estimating changes in AI-assisted development. - Iterate quickly with researchers across machine learning, economics, policy, and related disciplines. - Communicate findings clearly and prioritize accurate, decision-relevant results.
Requirements
- Strong software engineering ability and comfort working across research and infrastructure code. - Experience running experiments with large language models, not only processing model outputs. - Ability to handle messy, high-volume data without unnecessary over-engineering. - Comfort working from loosely defined questions and changing priorities. - Clear written and verbal communication, with a collaborative approach to research. - Willingness to prototype quickly, discard approaches that do not work, and focus on shipping useful tools.
Nice to have
- Experience building LLM evaluation harnesses, benchmark infrastructure, or reusable research tooling. - Background in large-scale machine learning or data infrastructure alongside ML experience. - Experience identifying and correcting weaknesses in AI-generated code.
Benefits and work setup
The role is remote-friendly but requires travel, with an expectation that staff spend at least 25% of their time in an office. Visa sponsorship may be available depending on the role and candidate.