Remote job
Own the Gateway. Own the proxy.
Job details
About this role
Role overview Own the production gateway that routes and observes customers’ AI traffic across providers. You will develop a network-level proxy and an agent registry, balancing reliable coverage, careful security boundaries, and low latency across a Rust service and its deployment chain.
Responsibilities - Build and operate a TLS-intercepting proxy designed to integrate into developer workflows, while defending a p99 latency target below 10 ms. - Develop a registry to improve visibility into AI agents running without a user present, and communicate clearly about coverage limits. - Contribute across an 11-crate Rust monorepo, including implementation, code review, and technical scope decisions. - Maintain production deployments and supporting services, using migration-first changes and routine smoke checks. - Investigate concurrency, certificate handling, and trust-boundary issues in production systems.
Requirements - Significant production experience with Rust and a web framework such as Axum or Actix at meaningful traffic levels. - Ability to reason about asynchronous Tokio code, concurrency hazards, and latency budgets. - Practical understanding of TLS, certificate handling, and security trust boundaries. - Ability to explain technically sensitive setup steps, such as installing a root certificate authority, in clear and reassuring terms. - Strong systems judgment: able to understand a broad codebase, make sound tradeoffs, and ship quickly.
Nice to have - Security or networking experience, or work on systems where failures could cause financial or reputational harm. - Experience shipping software on Apple Silicon and familiarity with MLX and ONNX.