The role involves building and maintaining data processing tools on Google Cloud Platform, collaborating to improve the data ecosystem, and ensuring scalability for Spotify’s data needs.
The Data Infrastructure product area enables Spotify to solve complex and critical data engineering problems by providing the infrastructure and tools for engineers to build and manage planet-scale data pipelines. The teams that operate in this space are a group of versatile engineers that build the foundational data processing and management elements of that infrastructure. The products that we own are used by data practitioners across the company to create some of our most beloved consumer products such as Discover Weekly and Wrapped.
We are looking for an experienced software engineer that shares our common interest in building, maintaining and expanding our data processing technology offering while ensuring their scalability meets Spotify’s ever growing data needs. You’ll help build the tools that empower teams across the company to process data at scale that solves their critical business needs, shaping the developer experience for data engineers and anyone working with data at the company. Due to the swift progress of AI and agents, this emerges as an incredibly captivating field.
What You'll Do
- Build large-scale batch and real-time data processing tools on Google Cloud Platform, aiming to improve developer experience and standardize workflows with the goal to eventually move to a monorepo for data.
- Collaborate with product owners, engineers and other squads to build features and drive improvements in the data processing ecosystem.
- Expand the data processing product and technology offering for Spotify to meet the dynamic and ever changing needs of our customers.
- Enable the data practitioner community by improving and evolving our data engineering ecosystem at Spotify through support, best-practices and standards.
Who You Are
- You have 2+ years of professional data engineering experience.
- You have strong coding skills in a modern programming language and a solid understanding of systems design, data structures and algorithms.
- You are passionate about developer experience and building products that help users efficiently solve their use cases
- You know how to work with high-volume, heterogeneous data, preferably with distributed systems in the cloud.
- You have experience with Python at least one JVM-based data processing framework such as Spark, Flink, Dataflow, Storm, etc.
- You employ sound engineering practices such as continuous delivery, defensive programming and automated testing and care about shipping high-quality code.
- You are comfortable with change and love working in an environment where you experiment, iterate quickly and take ownership of projects from ideation to production.
- Bachelor’s degree or higher in Computer Science or related fields is a plus.
Where You'll Be
- This role is based in Toronto.
- We offer you the flexibility to work where you work best! There will be some in person meetings, but still allows for flexibility to work from home.
Spotify is an equal opportunity employer. You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens.
At Spotify, we are passionate about inclusivity and making sure our entire recruitment process is accessible to everyone. We have ways to request reasonable accommodations during the interview process and help assist in what you need. If you need accommodations at any stage of the application or interview process, please let us know - we’re here to support you in any way we can.
Spotify transformed music listening forever when we launched in 2008. Our mission is to unlock the potential of human creativity by giving a million creative artists the opportunity to live off their art and billions of fans the chance to enjoy and be passionate about these creators. Everything we do is driven by our love for music and podcasting. Today, we are the world’s most popular audio streaming subscription service.
Top Skills
Dataflow
Flink
Google Cloud Platform
Python
Spark
Storm
Similar Jobs
3D Printing • Artificial Intelligence • Information Technology • Internet of Things
Design and manage distributed data systems for processing and transforming datasets for AI model training, ensuring data quality and scalability.
Top Skills:
AirflowAWSAzureDagsterDaskFlinkGCPKubernetesPrefectPythonRayS3SparkSQLTerraform
Artificial Intelligence • Consumer Web • Digital Media • Machine Learning • Software
This role involves designing and implementing scalable data architectures, optimizing data systems, and collaborating with various teams on data-related projects.
Top Skills:
AWSHivePythonSparkSQLTrino
Cloud • Legal Tech • Software
As a Senior Data Engineer, you will build and maintain data pipelines, collaborate with teams on best practices, and implement data ingestion techniques using AWS technologies.
Top Skills:
AirflowAWSDatabricksKafkaPythonRubyScalaSparkSQLTerraform
What you need to know about the Vancouver Tech Scene
Raincouver, Vancity, The Big Smoke — Vancouver is known by many names, and in recent years, it has gained a reputation as a growing hub for both tech and sustainability. Renowned for its natural beauty, the city has become a magnet for professionals eager to create environmental solutions, and with an emphasis on clean technology, renewable energy and environmental innovation, it's attracted companies across various industries, all working toward a shared goal: advancing clean technology.
