Perplexity Logo

Perplexity

AI Software Engineer - Data Platform - SF

Posted 2 Days Ago
8 Locations
Senior level
8 Locations
Senior level
Build and maintain a scalable AI data platform, collaborating with teams to ensure optimal data lifecycle management and infrastructure for machine learning applications.
The summary above was generated by AI

Perplexity is seeking an experienced Software Engineer focusing on building the next-gen AI Data Platform to help revolutionize the way people search and interact online. In this role, you'll help build Perplexity’s end-to-end AI data stack and flywheel which powers all AI products, ML use cases and language models.

Perplexity is rapidly scaling both in number of use cases and number of users. Perplexity’s data stack powers scalable, personalized and fast answers for millions of people worldwide.

Tech Stack: Spark | AWS Data Stack (S3, RDS, DynamoDB, Docker, EKS, Kinesis) | Pytorch | Docker | Databricks | Snowflake 

Responsibilities

  • Collaborating closely with AI Product, Applied ML, Post-Training and Data Science teams to design, build, and maintain scalable data pipelines and data lakes
  • Developing, deploying, and monitoring entire data lifecycle for ingestion, transformation, streaming and storage at high scale
  • Implementing tools and abstractions on top of data infrastructure for a variety of analytics, recommendations, AI product and post-training use cases
  • Working closely with product and AI teams to develop reusable data resources and design patterns

Qualifications

  • Extensive programming and data engineering skills, with proficiency in open source & distributed data processing (AWS, Spark, Flink, Iceberg)
  • Familiarity with cloud-based data services (e.g., AWS, RDS, DynamoDB), containerized infrastructure (e.g., EKS, Docker), and data streaming (Flink, Spark streaming, CDC
  • Strong quantitative and engineering skills with experience in estimating performance at high scale
  • Experience supporting various ML/AI engineering teams to build scalable platforms to accelerate R&D for frontier models and AI products
  • Self-motivated with a strong sense of ownership of systems and designs
  • 5+ years of industry experience in distributed systems or AI infrastructure

The cash compensation range for this role is $200,000 - $280,000.

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine just over a year ago. Our AI-powered search assistant has amassed 10 million monthly active users as of early 2024, with our mobile apps installed over 1 million times across iOS and Android devices. In 2023 alone, we served over 500 million queries from users around the globe.

To support our rapid expansion, we've raised significant funding from some of the most respected investors in technology. In January 2024, we raised $73.6 million in a Series B round led by IVP, with participation from NVIDIA, Jeff Bezos' investment fund, NEA, Databricks, and other prominent firms. We followed that up with a $62.7 million Series B1 round in April 2024 led by Daniel Gross, valuing Perplexity at over $1 billion.
Our prominent investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Naval Ravikant, Tobi Lutke, and many other visionary individuals.
 
Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.
 
Equity: In addition to the base salary, equity is part of the total compensation package.
Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.
 
 

Top Skills

Aws Data Stack
Databricks
Docker
DynamoDB
Eks
Kinesis
PyTorch
Rds
S3
Snowflake
Spark

Similar Jobs

32 Minutes Ago
Easy Apply
Hybrid
Toronto, ON, CAN
Easy Apply
Senior level
Senior level
Artificial Intelligence • Marketing Tech • Software
Lead the data engineering team to design and implement data models, optimize data pipelines, and mentor engineers to enhance data quality and governance.
Top Skills: Amazon RedshiftApache AirflowDbtOpenmetadataPythonSnowflakeSQLTableau
9 Hours Ago
Easy Apply
Remote
Hybrid
10 Locations
Easy Apply
Senior level
Senior level
Fintech • HR Tech
The Principal Applied AI Scientist will design, build, and evaluate AI products, collaborating closely with product engineers and managing the AI development lifecycle.
Top Skills: Agentic Ai FrameworksLlmsMulti-Agent FrameworksPython
14 Hours Ago
Calgary, AB, CAN
Mid level
Mid level
Big Data • Information Technology • Software • Analytics • Energy
The Analyst will conduct data analysis, develop economic models, collaborate with teams, and communicate insights to clients, driving actionable solutions.
Top Skills: AccessEnverus PrismExcelPower BIPythonSpotfireSQLTableauVBA

What you need to know about the Vancouver Tech Scene

Raincouver, Vancity, The Big Smoke — Vancouver is known by many names, and in recent years, it has gained a reputation as a growing hub for both tech and sustainability. Renowned for its natural beauty, the city has become a magnet for professionals eager to create environmental solutions, and with an emphasis on clean technology, renewable energy and environmental innovation, it's attracted companies across various industries, all working toward a shared goal: advancing clean technology.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account