Perplexity Logo

Perplexity

Research Scientist/ML Engineer - Answer Quality

Posted 8 Days Ago
7 Locations
Mid level
7 Locations
Mid level
As a Machine Learning Engineer/Research Scientist, you will develop evaluation methodologies for AI models, design evaluation systems, collaborate with product and data teams, conduct innovative research, and enhance answer quality through tools and culture. This role requires a strong background in machine learning and experience in evaluating models and conducting experiments.
The summary above was generated by AI

We are hiring for a Machine Learning Engineer / Research Scientist – Evals to join our AI team. As an early member of our Answer Quality group, you will play a pivotal role in developing and refining the evaluation methodologies that measure the quality, safety, and impact of our AI models. Your work will be central to ensuring that our search engine delivers high-quality answers that drive user engagement and reduce churn.

Responsibilities

  • Design and Build Evaluation Systems, ensuring our evaluation metrics are reliable, scalable, and actionable. Design, implement, and analyze experiments (such as A/B tests) to validate hypotheses regarding answer quality.
  • Integration with Product and Data Teams: Collaborate closely with our PM and AI teams to define common evaluation standards and integrate eval results into our product feedback loop.
  • Research and Innovation: Conduct research into state-of-the-art evaluation methods and contribute to the long-term vision for a centralized, scalable evaluation platform.
  • Drive Answer Quality via Culture and Tooling: As Perplexity ships new products, build the tools and establish organizational norms to drive answer quality up for each of the new products (Deep Research, Pro Search, Vertical Search, Enterprise, etc.)

Qualifications

  • Have 4+ years of experience as an ML Engineer or Research Scientist, with a strong background in designing and running experiments in a fast-growing technology environment
  • Solid understanding of Bayesian statistics, and various tools and methodologies for evaluating uncertainty in a way that is specific to the given product being shipped
  • Possess deep knowledge in machine learning, including evaluation methods, statistical testing, and algorithm development
  • Proficiency in Python and have hands-on experience with ML frameworks (e.g., TensorFlow, PyTorch) and data processing tools

Bonuses:

  • Prior experience in evaluating large language models (LLMs) or building evaluation systems for consumer search products
  • Exposure to research methodologies in ranking, retrieval, or natural language processing
  • Experience in a startup or early-stage company environment

The cash compensation range for this role is $200,000 - $280,000.

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine in 2022. We've grown from answering 2.5 million questions per day at the start of 2024 to around 20 million daily queries in December 2024. We also offer Perplexity Enterprise Pro, which counts leading companies like Nvidia, the Cleveland Cavaliers, Bridgewater, and Zoom as customers.

To support our rapid expansion, we've raised significant funding from some of the most respected technology investors. Our investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Daniel Gross, Naval Ravikant, Tobi Lutke, and many other visionary individuals. In 2024, our employee base grew nearly 300%, and we're just getting started.

 

Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.

 

Equity: In addition to the base salary, equity is part of the total compensation package.

Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.

 

 

Top Skills

Python
PyTorch
TensorFlow

Similar Jobs

4 Hours Ago
Easy Apply
Remote
Hybrid
Canada
Easy Apply
Senior level
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
The role involves developing predictive models, enhancing account identification, collaborating with marketing and sales teams, and driving data-driven insights for strategic decisions.
Top Skills: PythonRSQLTableau
4 Hours Ago
Easy Apply
Remote
Hybrid
Canada
Easy Apply
Senior level
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
The Senior Applied Scientist will develop and optimize multimodal ML models using large datasets, collaborating across teams to create AI solutions.
Top Skills: C++GoJavaPythonPyTorchSparkSQLTensorFlow
4 Hours Ago
Easy Apply
Remote
Hybrid
Canada
Easy Apply
Mid level
Mid level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
The Marketing Analytics Manager will develop dashboards, analyze trends, and provide insights to optimize sales and marketing performance, focusing on data visualization and strategic guidance.
Top Skills: DatabricksGoogle SheetsSQLTableau

What you need to know about the Vancouver Tech Scene

Raincouver, Vancity, The Big Smoke — Vancouver is known by many names, and in recent years, it has gained a reputation as a growing hub for both tech and sustainability. Renowned for its natural beauty, the city has become a magnet for professionals eager to create environmental solutions, and with an emphasis on clean technology, renewable energy and environmental innovation, it's attracted companies across various industries, all working toward a shared goal: advancing clean technology.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account