Remote job
AI/ML Engineer
Job details
About this role
Role overview Build and improve the evaluation and safety systems used to measure AI agents in production. You’ll develop model assessment methods and tooling, fine-tune models that judge agent quality, and help turn research findings into reliable systems that balance performance, latency, and cost.
Responsibilities - Build and optimize evaluation, safety, and automated rating systems for AI agents. - Create machine learning pipelines for collecting and processing data and benchmarking models. - Develop tools and methods for prompt engineering, fine-tuning, and quality assessment. - Explore model routing, task complexity prediction, and quality estimation. - Monitor production behavior and improve model quality, speed, and cost. - Work with engineering teams to validate and deploy research; share findings through publications or presentations.
Requirements - A degree in computer science, machine learning, applied mathematics, or a related field. - At least three years of relevant professional experience in AI/ML engineering, data science, or research. - Strong Python skills and experience with a machine learning framework such as PyTorch or TensorFlow. - Experience with natural language processing and deep learning systems. - Familiarity with cloud platforms, ML infrastructure, and model deployment, monitoring, and evaluation, including LLM-as-a-judge methods. - Strong analytical, problem-solving, and communication skills.
Nice to have - Experience with prompt engineering, model evaluation, or production ML systems at scale. - Knowledge of transformer architectures, modern NLP, MLOps, distributed computing, or large-scale experiments. - AI/ML research publications or other substantial research contributions. - Experience in an AI/ML startup or research lab.
Benefits and work setup Full-time role with Zurich on-site or remote work options. The offer includes competitive compensation and equity, along with access to computing and tooling resources and the opportunity to shape product direction.