Customer Reliability Engineer

Role overview Help customers keep large AI training and inference workloads running reliably on GPU clusters. You’ll investigate issues across Linux and Kubernetes, coordinate fixes with infrastructure providers, and build monitoring and automation that catch recurring problems earlier. The role includes customer communication and participation in a 24/7 on-call rotation.

Responsibilities - Own customer issues from reproduction and diagnosis through resolution, escalation, and follow-up. - Troubleshoot Linux processes, networking, storage, kernel logs, resource contention, and service management. - Investigate Kubernetes scheduling, pod, node, and resource problems, as well as GPU-related failures. - Respond to incidents, assess severity, coordinate the right responders, and keep customers updated. - Determine whether faults originate with the customer, platform, or external provider, then pursue provider fixes. - Write Python or Bash scripts, improve health checks and alerts, and turn incident findings into runbooks or lasting fixes.

Requirements - Practical command-line Linux troubleshooting skills across logs, processes, networking, and storage. - Working knowledge of Kubernetes resources and how to investigate failures. - Ability to automate repetitive checks with Python or Bash. - Clear, considerate technical writing and customer communication, including during incidents. - Sound judgment under pressure, including knowing when to escalate and how to keep others informed. - Willingness to join a 24/7 on-call rotation.

Nice to have - Production experience with NVIDIA GPUs, drivers, CUDA, DCGM, or Kubernetes device plugins. - High-performance networking, NCCL, HPC, or schedulers such as Slurm. - Customer-facing technical support experience and familiarity with monitoring tools such as Prometheus, Grafana, or Datadog. - Infrastructure-as-code experience with Terraform, Ansible, or Helm.

Benefits and work setup - Remote role in APAC; full-time. - Healthcare, dental, and vision coverage for employees and dependents; 401(k); and unlimited paid time off. - Compensation and equity are described as competitive.