Staff Data Scientist

Role overview Shape the behavior and quality of an AI voice and SMS agent that contacts homeowners on behalf of service professionals, qualifies jobs, and books them directly into the pro's calendar. As a Staff Data Scientist on a product team where conversation is the core behavior and outcomes are probabilistic, you will own agent improvement, evaluation systems, experimentation design, and production modeling that directly drives professional revenue. The first product in the agent suite is live and growing, with several additional agents planned.

Responsibilities - Lead improvements to agent conversation, qualification, and booking through conversation design, prompting, and campaign logic that move contact, engagement, appointment set, and job win rates. - Build the evaluation systems that make agent quality measurable, including automated checks over conversation traces, simulated conversations graded against expected outcomes, and model-based evaluation. - Analyze real conversations directly to identify where the agent succeeds and fails, producing a shared taxonomy of failure modes with measured rates and a prioritized improvement path. - Develop and take to production predictive models for qualification, appointment quality, homeowner engagement, and channel and timing selection, with the monitoring that implies. - Collaborate with engineers, product managers, designers, and operations partners from ideation through deployment. - Mentor junior team members and foster a culture of continuous learning and technical excellence in advanced data science.

Requirements - Master's or PhD in a quantitative field such as computer science, statistics, or mathematics, or equivalent practical experience. - 6+ years of experience in data science and machine learning, ideally within tech industry or marketplace environments. - Hands-on experience with non-deterministic systems such as LLM applications, conversational agents, or ranking and recommendation systems, including ways to measure their quality. - Expertise in statistical thinking and experiment design, comfortable with power and sample size, sequential and non-inferiority designs, and correlated data. - Comfort reading and categorizing large volumes of real customer interactions to surface what is actually happening. - Proven track record of taking highly impactful work into production environments and maintaining it there. - Proficiency in SQL and Python, plus experience with cloud ML solutions. - Strong communication skills with the ability to convey complex technical concepts to non-technical stakeholders.

Nice to have - Production experience with LLM applications including prompting, agent design, or evaluation tooling. - Experience with voice or telephony systems such as streaming speech recognition, turn taking, or call quality measurement. - Experience with workflow orchestration for long-running processes. - Background in home services, field service, or another operations-heavy marketplace.

Benefits and work setup - Salary band: $210,000 to $280,000, commensurate with experience and performance, with potential geographic variation. - Competitive year-end performance bonus and equity package. - Full medical, dental, and vision coverage. - Flexible vacation policy, pet discount plans, and 401(k) with company match.