Research Engineer / Scientist, Pre-training

Role overview Advance the research and engineering behind large language model pre-training, connecting experimental ideas with systems that can train models at scale. The work can span model design, data, optimization, infrastructure, and internal tools, with opportunities to lead focused projects and contribute to broader research efforts. The team’s stated research interests include developing capable systems while improving their safety, interpretability, and alignment with human values.

Responsibilities - Investigate and implement ideas in model architecture, training algorithms, data processing, and optimization. - Formulate, run, and analyze experiments that improve understanding of language models. - Lead small research projects and collaborate on larger initiatives. - Improve the efficiency, scale, and reliability of training infrastructure. - Build development tools that help research and engineering teams work effectively. - Contribute across the stack, from low-level performance work to high-level model design.

Requirements - Strong software engineering skills and experience building complex systems. - Proficiency in Python and experience with deep learning frameworks; PyTorch is preferred. - Familiarity with large-scale machine learning and language models. - Ability to balance research goals with practical engineering constraints. - Strong problem-solving, communication, and collaboration skills. - Interest in the societal effects of advanced AI.

Nice to have - An advanced degree in computer science, machine learning, or a related field. - Experience with high-performance, large-scale machine learning systems, GPUs, Kubernetes, or operating systems. - Experience in areas such as distributed training, dataset preparation, model interpretability, or AI safety research.

Benefits and work setup - Remote-friendly arrangement with regular travel; staff are generally expected to work from an office at least 25% of the time, with some roles requiring more. - Visa sponsorship may be available, depending on the role and candidate. - The listing gives an annual compensation range of $500,000–$850,000 USD.