NVIDIA

Senior System Software Engineer – Data Center GPU Compute Diagnostics

NVIDIA  •  $224k - $357k/yr  •  Durham, NC (Onsite)  •  8 days ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

We are seeking a senior system software engineer to work on next-generation Data Center GPU diagnostics for rack-scale AI supercomputer systems. Our charter is to build applications and compute workloads that test and heavily stress GPU compute engines, HBM memory, cache hierarchy, PCIe/NVLinkinterfaces, power delivery, andthermalbehavior, and to use those applications in silicon/system bring-up along with packaging such tools formanufacturingand customer use. The best candidates will have strong experience writing low-level diagnostic, performance, or stress software for complex hardware systems, ideally including experience with GPUs, CUDA kernels, GEMM-style workloads, NCCL communication patterns, CPUs,NICsor high-speed interconnects such as PCIe.

Excellent interpersonal skills arerequiredas this role will involve mentoring other engineers and collaborating with hardware architecture, silicon validation,manufacturingand field teams. In addition, the engineer will extensively use their knowledge of operating systems, computer architecture, GPU memory, voltage/frequency behavior,thermallimits, high-speed buses, and modern AI development and analysis tools to efficientlyvalidateand test next-generation processorsand systems. Join an exciting,rewardingand fast pacedenvironment!

Whatyou'llbe doing:

  • Working closely with hardware architecture, driver,manufacturingand field teams through product development lifecycle of rack-scale AI systems.

  • Responsible for crafting CUDA/C++ diagnostic workloads and software infrastructurerequiredfor new chip development, validation,productization, and field triage.

  • Designing and implementing GPU compute tests that stress Tensor Cores, SMs, L2/cache hierarchy, HBM memory, and related power/thermaloperating points.

  • Developing and tuning GEMM-style diagnostic workloads, including tests combined withadditional loadin NVLink,PCIe or CPU subsystems.

  • Developing and integrating higher-level AI workload tests, includingPyTorch-based large model workloads to stress GPUs, memory,interconnects,thermals, and system software under realistic rack-scale AI use cases.

  • Assessing new hardware features and architectingmanufacturingand field diagnostic tests using pre-beta GPU drivers, low-level diagnostic software, and systemtelemetry

  • Debugging failures involving ECC, HBM behavior,thermallimits, voltage/frequencymarginingandPCIe/NVLinkerrors

What we need to see:

  • BS or MS degree in Electrical Engineering, Computer Engineering, Computer Science, or equivalent experience.

  • 12+ years of system software, GPU software, embedded software, or hardware validation experience.

  • Experience driving technical work across multiple engineers, mentoring others, or leading development of a complex softwarecomponent

  • Experience writing diagnostics and stress tests thatinterface tolow-level hardware drivers and hardware registers.

  • Strong C/C++ and Python programming skills.

  • Experience with Linux device drivers, CUDA kernels, GPU compute workloads, or related accelerator programming is strongly preferred.

  • Understanding ofmemory systems, ECC behavior, cache hierarchy, bandwidth bottlenecks, and hardware failure signatures.

  • Understanding of GEMM-style workloads and how workload shape, precision,runtime, and verification affectcomputestress, power, memory, andthermalbehavior.

  • Experience with voltage/frequency characterization,thermaltesting, power stress, or related silicon validation concepts such asVminFmaxandP-state testing

  • Background with PCIe,NVLink, ornetworkingtechnologies such as InfiniBand and Ethernet.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 224,000 USD - 356,500 USD.

You will also be eligible for equity and benefits

Applications for this job will be accepted at least until May 22, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

NVIDIA

About NVIDIA

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Industry
Hardware & Semiconductors
Company Size
10,000+ employees
Headquarters
Santa Clara, CA
Year Founded
1993
Social Media