Remote job
QA Automation Engineer
Job details
About this role
Role overview Build the quality engineering foundation for a product area, enabling engineering teams to deliver reliable software with confidence. The role combines test architecture, automation frameworks, CI/CD quality controls, and post-release monitoring, while also applying structured evaluation and safeguards to AI-assisted testing and AI-powered features.
Responsibilities - Design reusable Playwright-based automation frameworks and quality infrastructure that engineers across teams can use. - Own the CI/CD test pipeline, including parallel execution, test stability targets, artifact collection, and post-deployment monitoring. - Define test strategy, coverage goals, risk-based priorities, test data practices, and isolated environments for dependable results. - Apply contract, performance, synthetic, or resilience testing where product risks warrant it; track test health and detection metrics. - Develop controlled AI-assisted testing workflows and evaluation and regression methods for features with variable outputs. - Improve release gates, lead quality reviews after incidents, and work with product, platform, and customer teams to address systemic issues.
Requirements - 4–7 years of software or test engineering experience and a bachelor’s degree in computer science, engineering, or a related field. - Demonstrated ability to design Playwright automation frameworks adopted by other engineers. - Experience owning CI/CD quality pipelines, including parallelization, flaky-test management, and post-release monitoring. - Ability to set a test strategy for complex systems using risk priorities and measurable quality indicators. - Practical AI skills: write specifications with acceptance checks, evaluate agent output against evidence, and track work outside an agent’s context. - Strong analytical and problem-solving skills.
Nice to have - Experience with agent-based testing harnesses, CI evaluation suites, and reusable checks based on prior failures. - Background in AI evaluation, contract testing, synthetic monitoring, chaos engineering, or performance and load testing. - Experience mentoring test engineers or improving quality practices across teams; familiarity with common issue-tracking or test-management tools.
Benefits and work setup The listing describes the position as remote.