Teams at Modular

Design and optimize AI runtimes across CPU and GPU hardware, improve performance through cross-stack optimization, port runtimes to new platforms, and develop benchmarking and performance-analysis systems. Collaborate with compiler, kernel, serving, model, infrastructure, tooling, and customer-success teams to support diverse AI workloads and customer requirements.

The Cloud Inference Engineer is responsible for building and maintaining a scalable LLM inference platform, focusing on distributed systems and machine learning technologies while collaborating across teams to optimize performance.

Drive the product vision for Modular's cloud compute platform, collaborating with teams to enhance AI service capabilities and customer engagement.