Remote job
Backend Engineer, AI Systems
Job details
About this role
Role overview This backend engineering role supports AI-powered applications, including an agent-first mobile communication product designed to bring assistance into everyday conversations and coordination. You’ll build production services that connect language models, application features, and external tools, with an emphasis on responsive, reliable real-time interactions.
Responsibilities - Build and maintain backend services and APIs for AI-powered applications. - Develop inference orchestration that connects language models with application services and external tools. - Design APIs for streaming responses, asynchronous work, and real-time interactions. - Improve performance through caching, batching, concurrency, and database optimization. - Add production monitoring, logging, alerting, and error handling; investigate latency, failures, and traffic-related issues. - Collaborate with machine learning, frontend, and mobile engineers on API design, integration, and deployment.
Requirements - At least three years of backend engineering experience building production systems. - Strong skills in Python, Node.js, or a comparable backend language. - Experience designing and maintaining REST or gRPC APIs, databases, and distributed services. - Understanding of asynchronous processing, concurrency, caching, and message queues. - Experience building scalable services and optimizing latency, throughput, and resource use. - Familiarity with SQL or NoSQL databases, Docker, cloud infrastructure, and production debugging with logs, metrics, or distributed traces.
Nice to have - Experience integrating language model APIs, inference services, or AI applications. - Familiarity with model serving, streaming inference, or orchestration frameworks. - Experience with Kubernetes, PyTorch, vLLM, or open-source model deployment. - Background building real-time communication, messaging, or high-traffic systems.