Senior Production Engineer – DGX Cloud

Job Description:

• Build and operate production software, automation, and tooling for control plane services, model deployments, and inference and agentic workloads across DGX Cloud environments
• Improve the reliability of inference and agentic platforms and services, including NVIDIA Cloud Functions, SGLang- and vLLM-based endpoints, and inference services built with NVIDIA Dynamo
• Improve endpoint availability, inference routing, capacity management, and service health
• Use infrastructure as code and GitOps to deploy, configure, validate, upgrade, and recover services consistently across environments
• Build workflows for service enablement, model releases, handoff, deprecation, and ongoing operations
• Define and instrument SLIs and SLOs for inference and control plane services and use error budgets to guide reliability improvements
• Participate in on-call and incident response, troubleshoot failures, and turn recurring issues into automation and durable fixes
• Collaborate with model, platform, storage, networking, security, and GPU infrastructure teams to design and operate services safely at scale

Requirements:

• 8+ years of experience building or operating production services and large-scale distributed systems, including hands-on automation
• Strong programming skills in Python, Go, or a comparable language
• Experience developing tools for production operations
• Experience with infrastructure as code, configuration management, or GitOps
• Experience building automation for repeatable service deployments and changes
• Strong knowledge of Linux, Kubernetes, containers, cloud infrastructure, distributed systems, and networking fundamentals
• Ability to diagnose failures in production
• Understanding of SRE principles, including SLIs, SLOs, error budgets, incident response, and reducing operational toil
• Experience instrumenting services and using metrics, logs, and traces to understand system behavior and improve reliability
• Clear technical communication and ability to work across engineering teams
• BS/MS in Computer Science or equivalent experience

Benefits:

• Equity
• Benefits