Manager, Applied AI Research

Role overview

Lead applied research that evaluates whether AI-enabled educational features are reliable, valid, and fair. The role combines research leadership and people management with the ability to turn rigorous evidence into practical guidance for product decisions and broader discussions of responsible AI in education.

Responsibilities

- Lead researchers producing defensible evidence about the reliability, validity, and fairness of AI-enabled features. - Design and oversee research and validation methods for automated scoring, algorithmic decision support, and emerging AI capabilities. - Set team priorities with senior research leadership and translate the research agenda into a workable plan across concurrent projects. - Partner with product, technology, learning and assessment design, and efficacy research teams to define questions and deliver timely findings. - Represent research in academic, industry, standards, customer, and policy forums, communicating evidence to varied audiences. - Hire, coach, and develop researchers, and manage external research partnerships with attention to quality and ethics.

Requirements

- Doctorate in psychometrics, quantitative psychology, educational measurement, statistics, data science, AI evaluation, or a related discipline. - At least eight years of experience in psychometric analysis, measurement science, AI research, data science, or a related technical area. - Two to three years managing complex research projects and leading individuals or a small team. - Experience designing or overseeing validation research for AI features, automated scoring, algorithmic decision support, or related innovations. - Strong knowledge of the AERA/NCME/APA testing standards and the policy and regulatory environment for educational assessment and AI. - Ability to communicate technical findings as clear, actionable guidance and keep multiple projects moving to deadline.

Nice to have

A record of peer-reviewed publications, conference presentations, or standards-body participation; experience establishing research documentation, quality standards, and validation processes; and experience managing university or third-party research partnerships.