Sr. Staff SDET, Customer Engineering

Role overview Set the quality engineering direction for critical software systems while building shared platforms and remaining deeply involved in implementation. A central focus is applying AI across test creation, failure analysis, and release decisions, while also designing rigorous ways to evaluate AI-powered product behavior.

Responsibilities - Define quality architecture and long-term strategy in line with product and business needs, and build automation frameworks and test infrastructure used across teams. - Establish reusable testing standards and guardrails that reduce brittle, duplicated, or low-value checks and address reliability risks before they affect customers. - Develop an AI-assisted testing approach spanning test generation, test selection, failure triage, and self-healing, with safeguards against masking genuine regressions. - Integrate useful test signals and AI agents into CI/CD release decisions so teams can assess shipping risk. - Create evaluation suites for non-deterministic AI features, including reference datasets, scoring approaches, and checks for safety, hallucinations, and response consistency. - Lead technical discussions and mentor engineers while evaluating new tools against measurable quality outcomes.

Requirements - Senior technical leadership in software development and test engineering, with the ability to set direction across teams and still contribute hands-on. - Experience designing shared quality platforms, automation frameworks, and scalable test infrastructure. - Strong understanding of CI/CD and how testing evidence informs safe release decisions. - Ability to apply AI and agent-based workflows to testing thoughtfully, including defining guardrails and evaluating whether they improve signal. - Experience testing AI or machine-learning features, or the technical depth to build evaluation methods for probabilistic and non-deterministic behavior. - Clear communication and mentoring skills for working across engineering teams.

Nice to have - Experience with e-commerce, healthcare, or regulated environments; internationalization testing; or browser and device testing services. - Work building LLM or machine-learning evaluation systems, quality engineering communities, open-source projects, or public writing and talks.

Benefits and work setup The source describes flexible or remote work, salary and equity compensation for full-time roles, paid time off and company holidays, health and parental benefits, an employee stock purchase plan, retirement matching, and team retreats.