Remote job
Staff Software Engineer, AI Foundations (Agent Optimization)
Job details
About this role
Role overview
Lead engineering work to help developers build AI agents that balance token usage and response time with the quality of their results. You’ll explore optimization methods such as model routing, multi-agent designs, caching, and context management, combining practical experimentation with strong systems design. The role also involves advising the developer community and shaping the practices and tools used across an AI-focused engineering team.
Responsibilities - Design and build agentic systems and mechanisms for improving agent efficiency while preserving output quality. - Work with customers to understand agent and coding use cases and advance practical approaches to agent development. - Track emerging AI application patterns and turn relevant techniques into useful product capabilities. - Own features end to end, coordinating with other teams to deliver reliable systems and a strong developer experience. - Serve as a technical resource on AI design patterns, sharing recommended practices and examples with field teams and developers. - Help diagnose complex community issues, gather feedback on APIs and features, and write public technical documentation. - Work across multiple programming languages, including Python, TypeScript, Java, and Go.
Requirements - At least eight years of professional experience. - Demonstrated experience optimizing AI systems using both machine learning and systems techniques, especially for agents or coding applications. - Ability to use generative AI to improve quality as well as productivity. - Fluency in multiple programming languages and willingness to learn others. - Deep understanding of concurrency, including safe use of mutexes, atomics, and related primitives. - Experience designing APIs and documenting publicly available libraries or modules. - Strong written and verbal technical communication in English. - Computer science degree or equivalent experience delivering production-grade software.
Nice to have - Familiarity with the platform’s programming model or experience building applications with it. - Open-source contributions, including work on third-party libraries. - Experience designing large-scale distributed systems or a background in machine learning, model training, data science, or ML systems. - Graduate degree in computer science.
Benefits and work setup - Occasional team travel is expected, generally for a week once or twice a year. Developer conference attendance may also arise.