Remote job
AI Platform Engineer
Job details
About this role
Role overview This senior engineering role builds and operates an internal AI platform that lets teams use language models and coordinate AI agents through shared services. You will own core platform architecture, including a model gateway, agent orchestration, developer SDKs, and the monitoring and governance needed for reliable production use. The work also includes partnering with internal teams to turn business needs into deployable AI solutions.
Responsibilities - Build and operate a model gateway with provider routing, rate limits, team quotas, cost tracking, and automated failover. - Create an agent control plane for agent setup, context handling, task execution, and workflow state. - Develop and maintain SDKs that make model integrations easier across internal technology stacks. - Implement monitoring, alerts, tracing, and evaluations for model and agent performance, usage, cost, and reliability. - Establish security and governance controls for model use and autonomous agents. - Work with internal teams to deliver production AI solutions and encourage platform adoption. - Assess build-versus-buy choices and integrate suitable open-source components.
Requirements - Five or more years of backend development experience. - Strong skills in Python or another modern backend language, with willingness to use Python as the primary platform language. - Solid understanding of distributed systems patterns such as queues, rate limiting, retries, circuit breakers, and failover. - At least one year of practical work with AI or language-model solutions, including APIs, streaming, tool use, context handling, and rate limits. - Experience building agents or agent-based workflows. - Knowledge of observability, containers, Kubernetes, and AWS or Google Cloud. - Intermediate or higher English and advanced Ukrainian; strong ownership and initiative.
Nice to have - Experience with developer platforms, internal tools, API gateways, or SDKs. - Familiarity with MCP, retrieval-augmented generation, vector databases, or LLM evaluation and observability tools. - A relevant computer science or software engineering degree, or experience using AI tools to automate workflows.
Benefits and work setup Remote work is available. Listed benefits include 20 days of paid vacation, 10 sick days, medical insurance, and budgets for professional education, language learning, and wellness.