Senior AI Infrastructure Systems Engineer (R&D / GPU / AI)

Role overview

Investigate difficult hardware and platform failures in high-performance GPU systems, using evidence to determine whether the cause lies in the GPU, host, firmware, interconnect, cooling, or physical hardware. The role combines Linux-based systems debugging, performance and stability analysis, and the creation of repeatable troubleshooting methods for issues that may not have an established procedure.

Responsibilities

- Form and test hypotheses by examining system logs, hardware data, and targeted diagnostic results. - Isolate failures across GPU servers, Linux hosts, firmware, PCIe and other interconnects, power, and cooling. - Analyze GPU diagnostics and fabric behavior, and run tests such as DCGM diagnostics and NCCL benchmarks. - Investigate PCIe topology and errors, connecting protocol-level symptoms to potential link or signal-integrity problems. - Benchmark system performance, stability, power use, thermal behavior, and workload characteristics. - Document root causes and turn findings into repeatable troubleshooting procedures; automate investigations with scripts.

Requirements

- At least five years of hands-on systems engineering experience involving Linux, server hardware, firmware, PCIe, and GPU or high-performance computing platforms. - Extensive Linux troubleshooting experience, including knowledge of the kernel and kernel-level debugging. - Strong understanding of modern server architecture and NVIDIA GPU systems, including relevant diagnostics, drivers, and interconnects. - Deep PCIe knowledge, including enumeration, topology, link behavior, and error types. - Experience with platform firmware such as BIOS/UEFI, BMC, programmable logic, GPU firmware, and NIC firmware. - Practical ability to investigate hardware, software, and networking issues; use low-level interfaces such as I²C, SMBus, or PMBus; and automate work with Python or Go.

Benefits and work setup

The listed benefits include employer-paid medical, dental, and vision coverage for employees and families; a retirement plan with up to a 4% employer match and immediate vesting; paid parental leave; a monthly reimbursement of up to $85 for mobile and internet; and employer-paid disability and life insurance. The source lists a salary range of $179,500–$224,300 plus quarterly performance bonuses.