Remote job
Senior Software Engineer (Agentic Search) - Web Access Engineer
Job details
About this role
Role overview
We are hiring a senior engineer to build the web access infrastructure behind a search system purpose-built for AI agents. The work blends deep browser and web-platform research with production engineering, translating findings about how modern sites interact with browsers into reliable, internet-scale systems that power Retrieval-Augmented Generation and real-time reasoning for downstream AI products.
Responsibilities
- Investigate how contemporary websites communicate with browsers across the full request lifecycle, from initial navigation through resource loading and rendering. - Research browser fingerprinting, client verification mechanisms, and emerging web technologies to enable dependable programmatic web access. - Build tooling for browser instrumentation, debugging, observability, and large-scale experimentation against the live web. - Translate research insights into production services that handle bursty workloads, multi-region traffic, and millions of daily requests. - Operate and evolve distributed infrastructure supporting caching, cache invalidation, and high-throughput data pipelines.
Requirements
- 5+ years of professional experience building production backend or infrastructure systems. - Deep expertise in several browser-technology areas, including Chromium internals, browser lifecycle and navigation, and Chrome DevTools Protocol (CDP). - Hands-on experience with browser automation frameworks such as Playwright, Puppeteer, or Selenium, plus browser instrumentation and debugging techniques. - Strong knowledge of the web platform: HTTP/1.1, HTTP/2, and HTTP/3, TLS, DNS, cookies, browser storage, caching, redirects, and session management. - Familiarity with JavaScript execution, client-side rendering, resource loading, page lifecycle, and browser networking. - Understanding of browser fingerprinting concepts and browser characteristics used for client identification.
Nice to have
- Prior work on browser engines or browser infrastructure, including reverse engineering browser or web application behaviour. - Experience designing and operating internet-scale distributed systems. - Proficiency in Go, C++, Rust, or Python, along with Kubernetes and cloud infrastructure.
Benefits and work setup
- Remote-friendly across Europe, the UK, Israel, and the Netherlands, with a small-team culture offering full ownership of infrastructure rather than a narrow slice. - Workload involves real scaling challenges including bursty scraping traffic, cache invalidation, and multi-region operations at millions of daily requests. - Engineering output directly powers AI agents used by leading teams across the industry. - Hiring process includes a coding interview.