Senior Software Engineer, Backend (AI Platform)

Role overview Build the shared backend platform that lets engineering teams develop, deploy, evaluate, and govern AI systems in production. The work spans model and tool gateways, agent execution, evaluation, identity, cost controls, reliability, and security, with responsibility from technical design through launch and on-call.

Responsibilities - Design and operate gateway, runtime, and evaluation services that move AI workloads from experiments into reliable production use. - Build controls for identity, quotas, model routing, caching, failover, and cost attribution. - Partner with security, infrastructure, and product engineering teams to establish safeguards and delegated identity for agent tool access. - Define service metrics and own monitoring, alerting, runbooks, and on-call health. - Set strong design and code review practices, share standards across teams, and mentor engineers. - Use AI tools and agentic workflows in daily engineering work and help improve how the team applies them.

Requirements - At least 4 years designing, building, and launching scalable backend systems, using languages such as Python or Kotlin. - Experience with highly available distributed systems and technologies such as AWS, MySQL, and Kubernetes. - Practical production experience with LLMs, agents, or AI frameworks, such as inference APIs, gateways, tool calling, evaluations, or agent runtimes. - Ability to plan and deliver significant system components with simple, extensible designs and maintainable code. - Experience making substantial changes in large codebases safely, and strong written and verbal communication skills. - A related bachelor’s degree or equivalent practical experience.

Benefits and work setup The role is remote-first within the country of employment, with occasional office needs and in-person onboarding. U.S. base pay is listed as $195,000–$255,000 in specified higher-cost states and $173,000–$233,000 in other states. Total compensation may also include equity and monthly spending stipends. Benefits include fully subsidized health coverage for employees and dependents, flexible time off, holidays, and an employee stock purchase plan.