Remote job
Research Engineer/Research Scientist, Pre-training
Job details
About this role
Role overview
Work on the research and engineering of large language model pre-training systems, from model architecture and optimization methods to data processing and training infrastructure. The role combines independent investigation with collaborative development of systems that are efficient, reliable, and aligned with practical safety goals. It offers scope across the stack, from low-level performance work to high-level model design and experimentation.
Responsibilities
- Investigate and implement improvements in model architecture, algorithms, data processing, and optimizers. - Lead focused research projects while contributing to larger team initiatives. - Design, run, and analyze experiments that improve understanding of language-model behavior and training. - Scale and optimize training infrastructure for greater efficiency and reliability. - Build or improve developer tools that increase research productivity. - Contribute across the technical stack, including performance-sensitive components and model-level systems.
Requirements
- Advanced training in computer science, machine learning, or a related field, or equivalent relevant experience. - Strong software engineering skills and a record of building complex systems. - Proficiency in Python and experience with a deep-learning framework such as PyTorch. - Familiarity with large-scale machine learning and language-model development. - Ability to balance scientific goals with engineering constraints and delivery needs. - Strong problem-solving, communication, and collaborative working skills, with attention to societal impact.
Nice to have
- Experience with high-performance ML systems, GPUs, Kubernetes, or operating-system internals. - Knowledge of transformer-based language modeling, reinforcement learning, or large-scale ETL. - Interest in pair programming, flexible ownership, and learning-oriented research environments.
Benefits and work setup
The role is remote-friendly but travel-required, with offices listed in San Francisco, Seattle, and New York City. Staff are generally expected to spend at least 25% of their time in an office, and visa sponsorship may be available depending on the role and candidate.