Software Engineer, SRE, Production Engineering – DGX Cloud

NVIDIA · via Get Backend Jobs

💰 $184,000 - $287,500/yr 🌎 Remote 📍 Remote, California ⏰ Full Time ⌛ Posted 5 days ago

Build automation for bare-metal provisioning, hardware validation, firmware and software upgrades, repair, and cluster lifecycle management
Build tools using BMC and Redfish interfaces to assess hardware health, regulate server state, and facilitate recovery workflows
Manage and enhance NVIDIA NVL72 systems and BlueField-3 or later DPUs within cloud partner and on-premises environments
Diagnose failures across servers, DPUs, GPU systems, CPU systems, networking, Linux, and Kubernetes; turn recurring issues into automated detection and repair
Define validation and handoff criteria so new capacity enters production safely and consistently
Take part in on-call duties, incident response, root-cause analysis, and ensure permanent resolutions are implemented
Collaborate with hardware, networking, platform, data center operations, and partner teams to resolve issues across ownership boundaries

8+ years building software for or operating production infrastructure, including substantial hands-on bare-metal experience
Strong Go or Python skills, with a record of delivering production automation and services
Direct experience working with BMC and Redfish for server provisioning, health inspection, power control, or fault diagnosis
Practical experience working directly with NVIDIA GPU hardware, including NVL72 systems, and BlueField-3 or later DPUs
Experience with Linux, firmware and driver management, network boot, and the server lifecycle from initial provisioning through repair
Experience managing production reliability via on-call duties, incident handling, observability, and durable solutions
Ability to debug failures across hardware, host operating systems, networking, and distributed services
Clear communication and demonstrated ownership of problems that span multiple teams
BS/MS in Computer Science or equivalent experience in a related field
Experience operating BlueField DPUs in DPU mode, including host-to-DPU connectivity and lifecycle debugging, or equivalent experience
Background with NVLink, InfiniBand, Spectrum-X, or GPU cluster performance validation
Experience building safe, repeatable workflows for rack-scale bringup, firmware upgrades, hardware replacement, and customer handoff
Background with Kubernetes, GitOps, Argo CD, SLOs, and fleet-wide automation