NVIDIA Logo

NVIDIA

Senior Software Engineer, NeMo Helix Core Platform

Reposted 16 Days Ago
In-Office or Remote
Hiring Remotely in Canada
Senior level
In-Office or Remote
Hiring Remotely in Canada
Senior level
Build and lead development of NVIDIA’s open-source NeMo Core Platform for executing, evaluating, deploying, and optimizing agentic AI systems across local, Docker, Kubernetes, Slurm, on-premises, and air-gapped environments. Responsibilities include designing platform APIs, plugin architecture, job orchestration, SDKs, reliability and observability capabilities, testing, performance improvements, technical leadership, code reviews, mentoring, and cross-team problem solving.
The summary above was generated by AI

We are looking for a Senior Software Engineer to help build NeMo Helix, NVIDIA’s product for developing, evaluating, deploying, and operating AI systems at scale. This role is for a senior engineer/architect for our Core team which owns and ships an open source plugin-based AI platform for running and optimizing Agents targeting multiple compute backends (local/docker, Kubernetes, Slurm, etc.).
As AI systems become more autonomous and more deeply integrated into real workflows, teams need robust APIs and orchestration systems for running, monitoring, and optimizing Agents at scale. Increasingly, the users of these systems are themselves autonomous or semi-autonomous Agents. The NeMo Helix group is building a sophisticated agent execution framework to enable agents to automatically run hundreds of experiments in parallel to find the most efficient agent architectures for our customers. This is important product engineering research for making agents more sustainable. AI systems are not yet nearly as efficient as they can be, and systems like NeMo Helix will allow large scale AI consumers to automatically tune their agents to use fewer tokens and rely on more efficient models with better throughput.
What you'll be doing:

  • Working in a product research environment where we place big bets on where the future is heading, adapting in real time as we build alongside an industry that is constantly evolving with us. This means fast iteration, high ownership, pragmatic decisions, and performance-minded implementation under production constraints
  • Designing an Agentic Execution system that are flexible enough to work in many environments (local, k8s, Slurm, on prem / air-gapped)
  • Provide senior technical leadership through design reviews, code reviews, mentoring, and ownership of ambiguous cross-component problems
  • Building and maintain our Core Platform APIs for running jobs, storing data, entities, secrets, and RBAC and Auth
  • Extending our flexible Plugin Architecture that makes it easy for many teams and external customers to install new capabilities into our system
  • Building in the open in our OSS repo, keeping up the high standards that the open source community demands
  • Shipping code at the speed of light with an unlimited token budget using best in class agentic coding tools
  • Improving reliability, observability, debuggability, and performance across NeMo Helix, SDKs, plugins, jobs, and developer workflows
  • Building strong test coverage across unit, integration, E2E, Docker, and Kubernetes workflows

What we need to see:

  • BS, MS, or equivalent experience in Computer Science, Computer Engineering, or a related technical field
  • 10+ years of professional software engineering experience building production systems
  • Comfort working in a very fast and ambiguous environment
  • Exceptional communication, both verbal and written. This includes the ability to produce and review high quality architectural RFCs, and to discuss them clearly with the right level of technical detail for the right people (Engineer, Product, Marketing, etc.)
  • Strong system design skills, with a pragmatic flexibility and phenomenal instincts to invent robust systems quickly without over-complicating. Strong understanding of reliability, scalability, security, and performance tradeoffs in production infrastructure
  • Experience with distributed systems, cloud-native services, containers, Kubernetes, and job orchestration
  • Excellent Python engineering skills, including API design, typing, testing, debugging, performance analysis, and maintainable software design
  • Experience designing SDKs, libraries, plugins, CLIs, or other developer-facing interfaces
  • Ability to work independently, define technical scope, break down ambiguous problems, and drive work across team boundaries

Ways to stand out from the crowd:

  • Experience building, deploying, and iterating on production agentic AI systems at scale in Kubernetes
  • Experience with sophisticated plugin architectures
  • Strong ability to connect technical evaluation work to business outcomes, product quality, user experience, reliability, or operational efficiency
  • Experience with enterprise AI systems where measurement, regression testing, observability, governance, and continuous improvement are required for production deployment

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:
170,000 CAD – 220,000 CAD for Level 4; and 225,000 CAD – 275,000 CAD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 3, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

Similar Jobs

Yesterday
Remote or Hybrid
Québec, QC, CAN
Entry level
Entry level
Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
Performs on-site safety and non-safety certification inspections, quality-system audits, field evaluations, testing, equipment calibration checks, and compliance reviews. Analyzes test results, identifies nonconformities, supports corrective actions, documents findings, communicates with manufacturers and authorities, and performs engineering calculations across electrical, mechanical, chemical, and fire-protection disciplines. Requires local and regional travel, remote work, customer interaction, and bilingual French-English communication.
Top Skills: AmmetersIndustrial Control PanelsMicrometersSchematic DiagramsUl 508AUl StandardsVoltmeters
Yesterday
Remote or Hybrid
Senior level
Senior level
Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
This role involves leading technical due-diligence for energy projects, performing financial assessments, managing client relationships, and mentoring junior staff.
Top Skills: Energy StorageFinancial ModelsHybrid Renewable PortfoliosProject ContractsSolar + StorageTechnical Due-Diligence
Yesterday
Easy Apply
Remote or Hybrid
Canada
Easy Apply
Entry level
Entry level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Generate and qualify enterprise sales opportunities for Samsara’s SaaS products by conducting approximately 50 daily cold calls, mapping accounts, engaging executives, and building product demand. The role requires resilience, curiosity, collaboration, and the ability to learn technical concepts and use AI in daily workflows. Successful representatives may advance to closing sales roles within two years.
Top Skills: Artificial Intelligence (Ai)Internet Of Things (Iot)Linkedin Sales NavigatorSalesforceZoominfo

What you need to know about the Vancouver Tech Scene

Raincouver, Vancity, The Big Smoke — Vancouver is known by many names, and in recent years, it has gained a reputation as a growing hub for both tech and sustainability. Renowned for its natural beauty, the city has become a magnet for professionals eager to create environmental solutions, and with an emphasis on clean technology, renewable energy and environmental innovation, it's attracted companies across various industries, all working toward a shared goal: advancing clean technology.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account