Arena (arena.ai) Logo

Arena (arena.ai)

Software Engineer - ML Infrastructure

Reposted One Month Ago
In-Office or Remote
Hiring Remotely in CA
Senior level
In-Office or Remote
Hiring Remotely in CA
Senior level
Design and develop scalable, high-performance data and API infrastructure for real-time processing. Mentor engineers and collaborate with teams to enhance AI model evaluations.
The summary above was generated by AI
About Arena Intelligence

Arena is the platform for evaluating how AI models perform in the real world. Founded by researchers from UC Berkeley's SkyLab, we're on a mission to measure and advance the frontier of AI for real-world use, and to build the foundation for everyone to understand, shape, and benefit from it.


Tens of millions of people use Arena each month to evaluate how frontier systems handle the work they actually do. The preferences they share power the most transparent, rigorous, and human-centered evaluations in AI. Leading AI labs, enterprises, and independent researchers rely on our work and open datasets to understand how models behave in real workflows: agentic coding, creative generation, professional productivity, and beyond. We go beyond leaderboards and decompose what human experience reveals about AI, so models advance toward the work people actually do.


We're a team of researchers, academics, builders, and creatives from UC Berkeley, Google, Stanford, and DeepMind. We seek truth, move fast, and value craftsmanship, curiosity, and impact over hierarchy. We're building a company where thoughtful, curious people from all backgrounds can do their best work together, in an office culture that radiates excellence, energy, and focus.

About the Role

Arena Intelligence is seeking an ML Infrastructure Software Engineer to lead the design and development of scalable, low-latency model inference infrastructure, high-performance post-training infrastructure for reinforcement learning (RL), distributed ML training job execution, and comprehensive model evaluation frameworks. In this role, you’ll architect systems that execute complex training, inference, and evaluation workloads at scale, powering the insights that help researchers and developers build the world’s most advanced AI models. Working in close partnership with ML researchers, your contributions will be foundational to surfacing trustworthy, transparent, and timely evaluation and training signals across the platform. This role is ideal for someone who thrives in fast-moving environments, cares deeply about performance and reliability, and wants to build systems that advance state-of-the-art AI capabilities.

You’ll
  • Architect, scale, and optimize LLM post-training infrastructure tailored for reinforcement learning (RL) alongside with low-latency model inference services

  • Design and maintain robust job execution systems for large-scale distributed ML training and fine-tuning workloads

  • Build comprehensive, automated model evaluation frameworks to deliver rapid, reliable feedback signals to ML researchers

  • Ensure high availability, low latency, and fault tolerance across GPU clusters and distributed event streams

  • Collaborate cross-functionally with AI researchers, product leaders, and infrastructure teams to support evolving training and evaluation needs

You’ll have
  • 5+ years of experience in software engineering, with a focused background in ML infrastructure, distributed systems, or large-scale data platform engineering

  • Hands-on experience with PyTorch, model serving engines, and distributed training frameworks

  • Solid background in reinforcement learning (RL) post-training infrastructure, RLHF, or automated model evaluation pipelines

  • Proven ability to design and operate low-latency, high-throughput, and fault-tolerant distributed services at scale

  • Strong foundation in systems design, GPU cluster utilization, and performance tuning

  • Thrive in a fast-paced, high-ownership environment working closely with ML researchers

What we offer
  • We offer competitive compensation aligned to the markets where our team members are based. The compensation range for each role is listed on its posting and will depend on the candidate's experience and work location.

  • Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs.

  • The opportunity to work on cutting-edge AI with a small, mission-driven team

  • A culture that values transparency, trust, and community impact

Come help build the space where anyone can explore and help shape the future of AI.

Arena Intelligence provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity, or gender expression. We are committed to a diverse and inclusive workforce and welcome people from all backgrounds, experiences, perspectives, and abilities.

Similar Jobs

An Hour Ago
Easy Apply
Remote
Canada
Easy Apply
Senior level
Senior level
Big Data • Fintech • Mobile • Payments • Financial Services
Own the operational health of strategic merchant integrations through monitoring, troubleshooting, SLA delivery, root-cause analysis, and technical inquiry resolution. Design custom API integration solutions, lead cross-functional technical initiatives, influence product roadmaps, develop playbooks and runbooks, manage strategic accounts, and mentor other Technical Account Managers.
Top Skills: ChronosphereHTMLHTTPJavaScriptJIRANotionPostmanPythonRestful ApisSnowflakeSQLWebhooks
An Hour Ago
Easy Apply
Remote
CAN
Easy Apply
Senior level
Senior level
Artificial Intelligence • Edtech • Machine Learning • Software
Own and scale QuillBot’s global affiliate program by recruiting and activating partners, managing contracts and commissions, optimizing performance, and improving CAC, ROAS, ROI, attribution, and revenue quality. The role analyzes partner data, runs incentive and conversion experiments, oversees tracking and fraud controls, manages budgets, and collaborates with Creative, Product, Data, Engineering, Finance, and Legal teams.
Top Skills: ImpactPartnerstack
2 Hours Ago
Easy Apply
Remote or Hybrid
CA
Easy Apply
Senior level
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Architect and own marketing data infrastructure, including Databricks pipelines, Gold Layer tables, semantic models, and trusted analytics foundations. Lead cross-functional data initiatives, translate ambiguous business needs into scalable solutions, improve reliability and quality, and mentor engineers. Build and monitor production LLM and agent systems, automate workflows with AI, and deliver high-quality Python and SQL while validating AI-generated code. Partner with Marketing, Sales, BI, Data Science, and R&D teams.
Top Skills: Ai AgentsBigQueryClaude CodeCursorData WarehousesDatabricksDbtEtl/EltLakehousesLlmsMarketing AutomationMartechPythonSalesforceSemantic LayersSnowflakeSQLStreamlitWeb Analytics

What you need to know about the Vancouver Tech Scene

Raincouver, Vancity, The Big Smoke — Vancouver is known by many names, and in recent years, it has gained a reputation as a growing hub for both tech and sustainability. Renowned for its natural beauty, the city has become a magnet for professionals eager to create environmental solutions, and with an emphasis on clean technology, renewable energy and environmental innovation, it's attracted companies across various industries, all working toward a shared goal: advancing clean technology.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account