Remote job
Strategic Project Lead - AI Post-Training (United States)
Job details
About this role
Role overview Lead delivery of data and evaluation programs that help improve advanced AI models. You’ll turn changing research goals into practical workflows, quality standards, and measurable project outcomes, working with clients and internal teams.
Responsibilities - Manage projects from planning through delivery, including scope, schedules, budgets, staffing, and risks. - Coordinate client communication, progress updates, planning, and escalations. - Convert model improvement goals into data specifications, workflows, evaluation plans, and rubrics. - Set acceptance criteria for preference data, model comparisons, and evaluation results; investigate quality issues and clarify ambiguous requirements. - Advise on data design, evaluation methods, and feasibility, and create reusable operating and quality guidelines. - Support project scoping and pilots, develop new capabilities, and mentor operations colleagues.
Requirements - At least 1–2 years of experience in AI data operations, project coordination, or delivery; experience with generative or frontier AI work is useful. - Familiarity with at least one model post-training or evaluation workflow. - Experience coordinating projects or workstreams, managing stakeholders, and communicating with clients. - Understanding of data quality, annotation workflows, and quality assurance. - Ability to turn evolving needs into clear processes, rubrics, and measurable standards. - Strong organization and troubleshooting skills, comfort managing multiple priorities, and interest in current AI developments.
Nice to have - Experience with RLHF, preference data, model response evaluation, rubric design, benchmarks, or model comparisons. - Experience judging responses for quality, accuracy, reasoning, or instruction following; exposure to AI labs or evaluation programs. - German or a Nordic language.