QA Automation Engineer

Role overview

Build the automated quality foundation that enables a small product team to release quickly without disrupting customer conversations. The role covers end-to-end web testing across multiple surfaces, partner integration validation, cross-browser and accessibility coverage, and the more nuanced challenge of evaluating AI responses whose correctness may be contextual rather than an exact text match.

Responsibilities

- Develop and maintain end-to-end tests for the dashboard, embedded widget, and public-facing site. - Design regression strategies for AI-generated responses using meaningful correctness criteria rather than fixed-string comparisons alone. - Exercise integrations in partner sandboxes and identify compatibility problems before they reach customers. - Include desktop, mobile, cross-browser, and accessibility checks in the release process. - Improve test execution speed, stability, and diagnostic value so the suite remains trusted by the team. - Reproduce, isolate, and document defects clearly enough to support efficient fixes.

Requirements

- At least three years of QA automation experience for web applications. - Practical experience with Playwright, Cypress, or a comparable browser automation framework. - Ability to read and write application code, not only test-specific scripts. - Methodical debugging and defect-isolation habits. - Sound judgment about which scenarios benefit from automation and which do not.

Nice to have

- Experience evaluating LLMs or other non-deterministic systems. - Accessibility auditing experience against WCAG. - Background in performance or load testing.