Remote job
Research Engineer, Language Models
Job details
About this role
Role overview Develop language models intended to deliver useful capabilities on everyday devices. The role connects model architecture, training data, and learning objectives with reasoning, tool use, and conversation, then works with systems engineers to make promising research perform under real deployment constraints.
Responsibilities - Design pre-training and post-training experiments to improve model capability, context use, and compute efficiency. - Build data preparation and training pipelines, investigating how data quality and sampling affect behavior. - Create evaluations for instruction following, reasoning, tool use, and multi-turn interactions, including checks for failures hidden by aggregate scores. - Use controlled experiments and ablations to distinguish repeatable gains from noise or evaluation changes. - Work with inference engineers to assess how compression and quantization affect model capabilities. - Document findings and turn successful work into checkpoints, evaluation tools, and reusable methods.
Requirements - Strong Python skills and practical experience with PyTorch or a comparable deep learning framework. - Experience training, adapting, or closely investigating language models, with work that can be discussed in depth. - Solid understanding of optimization, model architectures, and experimental design. - Ability to debug research code, investigate unexpected results, and explain decisions using evidence. - Careful engineering practices and willingness to work across research and deployment.
Nice to have - Experience with distributed training, data quality, distillation, or model compression. - Research in long-context modeling, preference learning, or adaptation to specific tasks or users.
Benefits and work setup Full-time position; location is San Francisco or remote.