Director, Rack Scale Software Architecture

NVIDIA is seeking a highly technical, motivated manager to lead the team responsible for rack-scale system software architecture, including firmware, kernel drivers, operating systems, networking, fabrics, and user mode drivers. The role involves working with component leads and engaging with hyperscalers and cloud providers.

Location: Canada, United States

Salary: $320,000–$488,750/yr

Responsibilities

• Drive the software end-to-end architecture for NVIDIA's rack-scale products
• Maintain deep understanding of the product portfolio and roadmap; translate forward-looking plans into clear, formal software requirements that anchor execution across the organization.
• Ensure high quality & reliable software; serving as a trusted architectural partner to teams requiring guidance or oversight.
• Work directly with major customers to understand their requirements and work to align their roadmap with NVIDIA’s roadmap.
• Using strong communication skills, present the team vision to senior NVIDIA and external leaders.
• Provide technical leadership and career mentorship to the team.
• Make key technical decisions even when faced with ambiguity.

Requirements

• BS or MS degree in Computer Engineering, Computer Science, or related degree or equivalent experience.
• 15+ overall years of experience in the area of System architecture and design with 8+ yrs of proven experience in management.
• Deep experience in designing architecture for scalable and performant server systems, particularly at the SW/HW interface.
• Proven leadership skills and strong ownership on past projects involving a large scale sophisticated code base.
• Previous experience working with complex system software for accelerators such as GPUs, DPUs, or FPGAs.
• Possess strong managerial, problem solving and critical thinking skills.
• Comfortable operating in highly matrixed organizations while holding a leadership position.
• Known for your strong interactive, verbal and written communications skills.

Benefits

• You will also be eligible for equity and benefits.

Additional Information

• Applications for this job will be accepted at least until June 2, 2026.
• This posting is for an existing vacancy.
• NVIDIA uses AI tools in its recruiting processes.
• NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer.