Remote job
Senior Software Engineer, Applied AI
Job details
About this role
Role overview Build production AI features and services that use large language models, with an emphasis on reliability, scalability, and useful user experiences. This is an engineering-focused role covering the full feature lifecycle, from design and integration through deployment and monitoring, rather than a research-focused position.
Responsibilities - Design and deliver AI-powered services, adding validation, guardrails, error handling, caching, and fallback behavior to manage model failures. - Build long-running batch workflows that can resume safely, avoid duplicate effects, and continue when individual items fail. - Improve latency, throughput, and operating cost across AI services. - Integrate models and data feeds with business logic, APIs, front-end services, and persistent storage. - Define evaluations for output quality and implement unit, integration, and performance testing. - Own features from prototyping through production monitoring; improve existing data and feature pipelines and collaborate with product and engineering partners on delivery.
Requirements - Experience building, shipping, and maintaining AI-powered products, agents, or intelligent features in a commercial setting. - Hands-on experience bringing LLMs into production, including prompt engineering, vector databases, retrieval-augmented generation, and context-window management. - Strong Python skills for backend services and data processing. - Ability to design maintainable, well-tested software and scalable distributed systems, including APIs. - Skill in quickly understanding and working within unfamiliar codebases.
Nice to have - Experience fine-tuning or distilling smaller models, with sound judgment about when that is useful. - Familiarity with agent frameworks and their failure modes. - Experience deploying services with cloud platforms such as AWS, GCP, or Azure, and containers such as Docker or Kubernetes.
Benefits and work setup - Remote role based in the United States. - Listed annual pay range: $160,000–$200,000 USD.