Remote job
Senior Product Manager - EMEA - Remote
Job details
About this role
Role overview
Own the product strategy and operating model for evaluating the quality of AI-generated advertising creative across video, adaptations, and multiple formats. The role turns a subjective creative standard into reliable measurement by connecting human review, automated judging, representative datasets, product decisions, and commercial evidence.
Responsibilities
- Define the charter, scope, roadmap, and success measures for evaluation and quality initiatives. - Establish and improve core metrics such as first-pass-right output, evaluation coverage, and regression detection. - Create creative-quality rubrics and maintain calibration between automated judges and human reviewers, including attention to inter-rater reliability. - Design a scalable human quality-control process and ensure reviewer judgments improve the automated evaluation layer. - Own a representative, versioned golden dataset covering relevant formats and client contexts. - Build reusable evaluation loops that product and engineering teams can adopt without specialist support, while managing the full lifecycle from discovery through post-launch review. - Develop a credible public-facing quality-evaluation product and provide evidence for customer proposals and creative enablement materials.
Requirements
- Product ownership experience for a quality, evaluation, or machine-learning measurement problem with its own users and roadmap. - Demonstrated ability to define quality in a subjective domain and keep measurement reliable as usage and scale increase. - Direct experience with golden datasets, rubric design, judge calibration, human review, and interpreting where measurement systems fail. - Evidence-based product judgment, including learning an unfamiliar domain, validating customer needs, and using metrics to influence decisions beyond one team. - Experience presenting or defending methodology to clients, buyers, or other external stakeholders. - An ownership-oriented, empathetic, pragmatic approach: moving quickly, simplifying complexity, designing reusable patterns, and caring about the final user experience.
Benefits and work setup
- Remote work from anywhere in the employee’s home country, with flexible working hours. - Twenty-five days of paid time off plus public holidays under a flexible time-off model. - Health or private medical coverage, a monthly wellness and learning stipend, and enhanced parental leave for birth, adoption, or surrogacy. - Access to an office in London is available for UK-based employees.