Remote job
GPU Cluster Architect
Job details
About this role
Role overview A high-impact, hands-on architecture role defining how tens of thousands of GPUs are interconnected, cooled, powered, and optimized across multiple data center sites. The position drives end-to-end architectural decisions across compute, networking, and storage, ensuring the platform meets the scale, performance, and reliability requirements of modern AI workloads such as large-model training and inference. Remote work from the United States is welcome.
Responsibilities - Architect scalable GPU cluster topologies, including compute nodes, interconnect fabric, storage, and control planes. - Analyze AI/ML workloads to inform design tradeoffs across latency, bandwidth, and GPU density. - Validate low-latency, high-throughput interconnects such as InfiniBand HDR/NDR and RoCEv2 at POD and data center scale. - Work with storage teams to optimize performance for training datasets, checkpointing, and other I/O-heavy operations. - Analyze signals from monitoring systems to detect flaws in design and inform reliability improvements. - Partner with site reliability, networking, storage, and data center engineering teams to operationalize and scale the architecture.
Requirements - 5+ years of experience designing clusters. - Deep understanding of modern GPU architecture, including NVIDIA and AMD platforms. - Experience with HPC interconnects such as InfiniBand and RoCE. - Solid background in systems architecture, networking, and hardware reliability. - Experience scripting for automation and telemetry pipelines in Python, Go, or similar languages.
Benefits and work setup - US-specific compensation range of $184K to $318K OTE, including base salary and performance bonus, with RSUs potentially available at certain salary grades. - 100% company-paid medical, dental, and vision coverage for employees and families. - 401(k) plan with up to 4% company match and immediate vesting. - 20 weeks paid parental leave for primary caregivers and 12 weeks for secondary caregivers. - Remote work reimbursement up to $85/month for mobile and internet. - Company-paid short-term, long-term, and life insurance coverage. - Hybrid working arrangements and a dynamic, collaborative environment.