Remote job
Senior Data Scientist
Job details
About this role
Role overview Help build an AI agent suite that automates how independent service professionals run their businesses. The first product in the suite is a live voice and SMS agent that contacts homeowners on a professional's behalf, qualifies the work, and books the appointment, with more agents planned. This is a senior data science role on a product whose core behavior is conversational and probabilistic, with impact measured directly in revenue for the professionals using it.
Responsibilities - Improve how agents converse, qualify, and book jobs through conversation design, prompting, and campaign logic - Build evaluation systems that make agent quality measurable, including automated checks over conversation traces, simulated conversations scored against expected outcomes, and model-based evaluation where human judgment is needed - Establish experimentation frameworks and design practices that decide what gets shipped - Read and analyze real conversations to identify failure modes, measure their rates, and prioritize improvements - Develop predictive models for qualification quality, appointment quality, homeowner engagement, and channel and timing selection, and take them into production with appropriate monitoring and testing - Collaborate closely with engineers, product managers, designers, and operations partners to integrate data-driven solutions end to end - Mentor junior team members and foster a culture of continuous learning and innovation
Requirements - Master's or PhD in a quantitative field such as computer science, statistics, or mathematics, or equivalent practical experience - 4+ years of data science and machine learning experience, ideally in tech or marketplace environments - Hands-on work with non-deterministic systems such as LLM applications, conversational agents, or ranking and recommendation systems, including ways to measure their quality - Strong statistical thinking and experiment design skills, including power and sample size, sequential and non-inferiority designs, and correlated data - Willingness to dig into raw customer interactions and categorize large volumes of conversations - Track record of taking impactful work into production and keeping it healthy there - Proficiency in SQL and Python, plus experience with cloud-based ML solutions - Ability to communicate complex technical concepts to non-technical stakeholders
Nice to have - Production experience with LLM applications, including prompting, agent design, or evaluation tooling - Experience with voice or telephony systems such as streaming speech recognition, turn taking, or call quality measurement - Experience with workflow orchestration for long-running processes - Background in home services, field service, or another operations-heavy marketplace
Benefits and work setup The salary band is $185,000 to $240,000, commensurate with experience and performance, with variation by location. The package includes a competitive year-end performance bonus and equity, full medical, dental, and vision coverage, a flexible vacation policy, pet discount plans, and a 401(k) with company match.