We’re at a pivotal moment for AI and energy. Demand for compute is skyrocketing, but power constraints are becoming a critical bottleneck. Emerald AI sits at the intersection of these two worlds, enabling AI data centers to scale without overwhelming the grid.
Our Emerald Conductor software platform makes data centers flexible and responsive, allowing them to adjust power usage dynamically. This unlocks massive AI growth without major new infrastructure, while also strengthening the grid and supporting the expansion of renewable energy.
We’re a team of experts across AI, cloud, software, and energy—on a mission to scale AI sustainably. We’re backed by leading investors and partners including Radical Ventures and NVIDIA.
Learn more about our vision, team, and backers at https://www.emeraldai.co/.
About the RoleWe are looking for a Software Engineer with a strong background in AI/ML systems to design and build intelligent orchestration models that drive automated decision-making across compute infrastructure. You will work at the intersection of systems engineering and applied machine learning, developing models and pipelines that optimize workload placement, resource scheduling, and power-performance tradeoffs in large-scale datacenter environments.
Key ResponsibilitiesDesign and implement approaches for orchestration of AI/ML workloads considering factors such as resource allocation, load balancing, data management and performance.
Contribute to the design and implementation of performance monitoring of various optimization strategies.
Plan and conduct experiments with training and inference workloads using state-of-the-art AI models, such as LLMs.
Contribute to the design and development of mechanisms for power optimization and control with your deep knowledge of AI systems design.
Develop models for forecasting various parameters of data center compute jobs and demand.
Bachelors / Masters in Computer Science, Computer Engineering or Electrical Engineering with 5+ years of experience or a PhD degree in relevant field with 2+ years of industry experience.
3+ years of experience in systems engineering or backend infrastructure
Strong programming skills in more than one language (Python, Go, Rust, C++, etc.) with a focus on high-performance and reliable systems
Experience with ML workflows and tools (e.g., PyTorch, scikit-learn), particularly for modeling system behavior
Deep understanding of distributed systems, resource scheduling, and telemetry instrumentation
Familiarity with platforms such as Kubernetes, Slurm, Ray, or similar schedulers
Experience applying ML to systems problems (e.g., load prediction, anomaly detection, reinforcement learning for scheduling)
Knowledge of workload characteristics in AI/ML pipelines (training, inference, batch vs. real-time)
Familiarity with observability stacks (Prometheus, Grafana, OpenTelemetry) and data infrastructure (Kafka, Parquet, etc.)
Contributions to open-source infrastructure projects
Make an impact. Solve the AI power bottleneck and shape how data centers scale sustainably.
Join a world-class team of AI, cloud, software, and energy experts in a collaborative, low-ego environment.
Build from 0→1. Influence strategy, GTM, org design, and customer/investor engagement from day one.
Competitive pay + equity. Stock options let you share in the value you help create.
Comprehensive benefits, including medical, dental, vision, and 401(k) matching.
Flexible location. Work from D.C., Boston, or the Bay Area, with 1 WFH day/week.
Backed by top investors, including Radical Ventures and NVIDIA.
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability, and any other protected ground of discrimination under applicable human rights legislation.
Emerald AI strives to respect the dignity and independence of people with disabilities and is committed to giving them the same opportunity to succeed as all other employees.
Inclusiveness is core to our culture at Emerald AI, and we strive to ensure you get the most from your interview experience. Emerald AI makes reasonable accommodations for applicants with disabilities. If a reasonable accommodation is needed to participate in the job application or interview process, please reach out to the Talent team.
