Remote job
Senior AI Platform Engineer
Job details
About this role
Role overview Build and operate the backend and infrastructure that lets open-weight language models run reliably in private, customer-controlled production environments. This is a hands-on senior engineering role focused on Python services, model serving, and cloud infrastructure, with ownership across design, delivery, and operations.
Responsibilities - Develop and maintain production Python APIs and services using FastAPI or a similar framework. - Build microservices and event-driven systems with Kafka and MongoDB. - Deploy containerized workloads on Azure and support private AI deployments subject to security and compliance needs. - Run open-weight or local language models and provide inference APIs that return structured outputs. - Manage model versions and evaluation, and work with GPU and CPU inference environments. - Improve observability, performance, monitoring, and infrastructure resource use.
Requirements - At least seven years of professional software engineering experience, including strong production Python work. - Experience building production APIs or services with FastAPI or a comparable framework. - Hands-on experience with Kafka, event-driven architecture, and MongoDB. - Experience with Azure and containerized deployments. - Experience deploying open-weight or local language models and building model-serving or inference APIs. - Familiarity with model versioning, language-model evaluation, GPU or CPU inference, observability, and performance tuning.