OpenPhone Logo

OpenPhone

Staff Backend Engineer, AI

Posted 6 Days Ago
Remote
2 Locations
Expert/Leader
Remote
2 Locations
Expert/Leader
As a Staff Backend Engineer, you will lead AI feature architecture, manage scalable systems, and collaborate on AI innovations to enhance customer communication and experience.
The summary above was generated by AI

For millions of teams working in dozens of industries, day-to-day business gets done on the phone. So why — despite the huge leaps we've taken in design and usability — does most business phone software still look, feel, and act like it was born in the 90s? OpenPhone is changing that.

We’re a new type of business phone with a mission to help people communicate better and be more productive.

We’re backed by Y Combinator and some of the best venture firms around including Tiger Global, Craft Ventures, Slow Ventures, and others. We take pride in providing an exceptional customer experience and a product people love, which is why we’re excited that our customers have rated us the #1 VoIP Provider on G2.

OpenPhone is the modern, sophisticated answer to the clunky, outdated phone systems that have been slowing down businesses for years. With thousands of happy customers and several rounds of funding in just five years, it's safe to say we're onto something big.

About the Role

OpenPhone’s AI capabilities power everything from intelligent call assistants to automated workflows that help thousands of businesses communicate better. As a Staff Backend Engineer, you will own the technical strategy for how we design, build, and operate AI features across the product. You’ll partner closely with leaders across engineering, product, and security to translate ambitious product ideas into scalable, dependable systems. Your architectural choices will shape how every customer experiences AI inside OpenPhone—from the very first trial call to fully deployed agents—and you’ll be trusted to balance cutting-edge innovation with rock-solid reliability.

Things you’ll do:

  • Own the long-term architecture for AI orchestration frameworks, agent-based workflows, and model lifecycle management.
  • Lead cross-functional delivery of AI features from proof of concept to production rollout, coordinating engineering, product, design, and CX.
  • Establish best practices for prompt engineering, evaluation, versioning, observability, and incident response for AI services.
  • Design and optimize low-latency streaming pipelines for speech and other real-time data when the customer experience demands it.
  • Drive continuous cost, performance, reliability, and security improvements for models and infrastructure.
  • Mentor engineers through design reviews, code reviews, and technical coaching, raising the bar for excellence across teams.
  • Partner with security and platform leaders to ensure data privacy, compliance, and operational excellence.
  • Stay current on advances in LLMs, agent architectures, and emerging tooling, translating insights into actionable roadmap proposals.

Tech Stack & Tools:

  • Our backend is built on Node using Typescript.
  • Our AI Infrastructure uses temporal.io, vector DBs, libraries like Langchain and top-tier llm models.
  • We use Kubernetes on AWS to orchestrate our infrastructure setup and deployment.
  • The overall architecture is event-driven microservices with RabbitMQ at the center of it.
  • We use a variety of databases for different purposes: Postgres, Mongo, Elastic, and Redis.
  • We have the following clients - Web (React), Android and iOS.
  • We use Kong as our public API Gateway.
  • Observability Tools: Datadog
  • Other Tools: Figma, Linear, Notion, and Slack
About You:
  • 10+ years of backend or platform engineering experience, including LLM-driven systems in production.
  • Proven success leading architecture for business-critical services, balancing innovation with operational pragmatism.
  • Deep knowledge of LLM integration patterns, prompt design, vector search, and agent frameworks.
  • Expertise in event-driven and streaming architectures; you can reason about concurrency, ordering, and back-pressure under load.
  • Track record of driving cost optimization, observability, and incident response for AI workloads.
  • Excellent written and verbal communicator who aligns diverse stakeholders and produces clear, thorough design docs.
  • Collaborative leader who mentors others, fosters psychological safety, and elevates the entire engineering organization.
  • Comfortable with ambiguity, you break down complex problems, make informed trade-offs, and deliver iterative value quickly.
  • Empathetic and customer-focused, you balance technical decisions with user experience and business impact.
Compensation

The annual base salary range for this position is as follow, plus equity and benefits:

SF Bay Area, Los Angeles, Seattle, Portland, Boston, New York, and Washington, DC Metro: $211,000 - $234,000 USD 
All other US Locations: $188,000 - $208,000 USD
Canada: $215,000 - $237,000 CAD

The ranges displayed reflect the target for new hire salaries, and within each range, individual pay is determined by your skills and experience, as well as relevant education. Your recruiter can share more and answer questions about the specific salary range during the hiring process.

Salary is just one component of OpenPhone’s total compensation package. Your total rewards package will include equity, extensive medical coverage, a monthly lifestyle stipend, and a flexible PTO policy.

Who we are

As a fully remote company, we thrive asynchronously as a team. We are curious, ambitious, and dedicated to our work. We value trust above all else, and have a strong bias for action. If you're looking for a place to do your life's work, please get in touch. We'd love to hear from you.

And remember, there's no such thing as a 'perfect' candidate. We're looking for optimists with grit and determination, who are excited to face the challenges of a growing startup. OpenPhone is the type of company where you can grow, and we encourage you to apply for this role even if you don't think you meet all the requirements.

We are committed to creating an inclusive and diverse work environment. It is important that you are able to bring your authentic self to work every day. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. #LI-Remote

Top Skills

Api Gateway
AWS
Datadog
Elastic
Figma
Kong
Kubernetes
Langchain
Linear
Mongodb
Node.js
Notion
Postgres
RabbitMQ
React
Redis
Slack
Temporal.Io
Typescript
Vector Dbs

Similar Jobs

17 Hours Ago
Remote
Canada
Senior level
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
The Senior Machine Learning Engineer will develop, implement, and optimize machine learning models, collaborating across teams to enhance products.
Top Skills: Machine LearningPythonScikit-LearnTensorFlow
21 Hours Ago
Remote
Canada
Senior level
Senior level
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
As a Senior Software Engineer, you will design and build scalable backend services for crypto products, ensuring high reliability and performance. Collaborate with cross-functional teams to turn technical visions into reality while maintaining and scaling backend systems, and deliver well-tested code to meet customer needs.
21 Hours Ago
Remote
Canada
Senior level
Senior level
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
The Senior Software Engineer will develop user-facing features on the Risk Platform, mentor team members, and architect scalable systems using modern frontend technologies.
Top Skills: JavaScriptJestReactReact NativeReact NavigationTypescriptWebpack

What you need to know about the Vancouver Tech Scene

Raincouver, Vancity, The Big Smoke — Vancouver is known by many names, and in recent years, it has gained a reputation as a growing hub for both tech and sustainability. Renowned for its natural beauty, the city has become a magnet for professionals eager to create environmental solutions, and with an emphasis on clean technology, renewable energy and environmental innovation, it's attracted companies across various industries, all working toward a shared goal: advancing clean technology.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account