The ML Engineer will integrate model architectures, optimize deployment workflows, maintain CI/CD pipelines, and ensure reliability of inference services across large-scale systems.
About Luma AI
Luma’s mission is to build multimodal AI to expand human imagination and capabilities.
Role & Responsibilities
Background
Example Projects
Tech stackMust have
Compensation
Luma's mission is to build multimodal AI to expand human imagination and capabilities. We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable and useful systems, the next step function change will come from vision. So we are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change.
Luma’s mission is to build multimodal AI to expand human imagination and capabilities.
We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable and useful systems, the next step function change will come from vision. We are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to affect change. We know we are not going to reach our goal with reliable & scalable infrastructure, which is going to become the differentiating factor between success and failure.
- Ship new model architectures by integrating them into our inference engine
- Collaborate closely across research, engineering and infrastructure to streamline and optimize model efficiency and deployments
- Build internal tooling to measure, profile, and track the lifetime of inference jobs and workflows
- Automate, test and maintain our inference services to ensure maximum uptime and reliability
- Optimize deployment workflows to scale across thousands of machines
- Manage and optimize our inference workloads across different clusters & hardware providers
- Build sophisticated scheduling systems to optimally leverage our expensive GPU resources while meeting internal SLOs
- Build and maintain CI/CD pipelines for processing/optimizing model checkpoints, platform components, and SDKs for internal teams to integrate into our products/internal tooling
- Strong Python and system architecture skills
- Experience with model deployment using PyTorch, Huggingface, vLLM, SGLang, tensorRT-LLM, or similar
- Experience with queues, scheduling, traffic-control, fleet management at scale
- Experience with Linux, Docker, and Kubernetes
- Bonus points:
- Experience with modern networking stacks, including RDMA (RoCE, Infiniband, NVLink)
- Experience with high performance large scale ML systems (>100 GPUs)
- Experience with FFmpeg and multimedia processing
- Create a resilient artifact store that manages all checkpoints across multiple versions of multiple models
- Enable hotswapping of models for our GPU workers based on live traffic patterns
- Build a robust queueing system for our jobs that take into account cluster availability and user priority
- Architect a e2e model serving deployment pipeline for a custom vendor
- Integrate our inference stack into an online reinforcement learning pipeline
- Regression & precision testing across different hardware platforms
- Building a full tracing system to trace the end-to-end lifetime of any inference workload
- Python
- Redis
- S3-compatible Storage
- Model serving (one of: PyTorch, vLLM, SGLang, Huggingface)
- Understanding of large-scale orchestration, deployment, scheduling (via Kubernetes or similar)
- CUDA
- FFmpeg
The base pay range for this role is $187,500 – $395,000 per year.
About LumaLuma’s mission is to build unified general intelligence that can generate, understand, and operate in the physical world.
We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable and useful systems, the next step function change will come from vision. So, we are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change.
Similar Jobs
Artificial Intelligence • Hardware • Software • Semiconductor
Integrate, validate, and productionize cross-stack inference features across AI frameworks, runtime, compiler, kernels, distributed systems, and hardware. Drive zero-to-one projects, debug system-wide failures, manage accelerated timelines, and improve automation, diagnostics, and repeatable integration practices while collaborating across software and hardware teams.
Top Skills:
Ai FrameworksC++Cloud InfrastructureCluster OrchestrationCompilersContainersDistributed SystemsGoHigh-Performance ComputingKernelsLlmsMicroservicesObservabilityPerformance DebuggingProfilingPythonRuntimes
Artificial Intelligence • Hardware • Software • Semiconductor
Build, productionize, and optimize a GPU-based inference stack combining GPU prefill with Cerebras decode. Implement and operate model-serving APIs, vLLM/PyTorch/ROCm runtimes, deployment and reliability practices, performance profiling and optimization, cross-layer debugging, numerical validation, and benchmarking/infrastructure for production inference at scale.
Top Skills:
C++Ci/CdContainersCudaKubernetesLinuxPythonPyTorchRdmaRocmSglangTensorrt-LlmTriton Inference ServerVllm
Big Data • Fintech • Mobile • Payments • Financial Services
Lead product strategy for Affirm's 1:Many distribution partnerships, owning partner portfolio and building repeatable integration capabilities. Define roadmaps, prioritize features, develop success metrics/OKRs, and partner with commercial, design, analytics, and engineering to launch and scale platform partner integrations that drive merchant growth.
Top Skills:
Figma
What you need to know about the Vancouver Tech Scene
Raincouver, Vancity, The Big Smoke — Vancouver is known by many names, and in recent years, it has gained a reputation as a growing hub for both tech and sustainability. Renowned for its natural beauty, the city has become a magnet for professionals eager to create environmental solutions, and with an emphasis on clean technology, renewable energy and environmental innovation, it's attracted companies across various industries, all working toward a shared goal: advancing clean technology.
