The Data Engineer at Butter Payments will architect data systems, ensure high-quality data ingestion and transformation, and collaborate with ML teams to optimize workflows.
About Butter Payments:
At Butter Payments, we’re on a mission to eliminate involuntary churn and make recurring payments seamless. Every year, billions of dollars are lost due to failed payments. Butter leverages machine learning, deep financial data partnerships, and behavioral insights to ensure the right payments go through at the right time—without friction. We're backed by world-class investors like Atomic, Norwest Venture Partners, SpringTride, Transpose Platform, and we're growing fast.
The Problem Statement:
You will work closely with Software Engineering, Machine Learning Engineers and Data Analysts. You help ingest, organize and enable Butter to continue to deliver value on the data we collect. We make sure it arrives in a timely manner, is organized and usable, and is of a high quality. Key to all the work Butter does.
Problem Expanded:
We ingest 3rd-party data from multiple payment providers, such as Stripe, clean it and normalize it for our schema and machine learning pipelines.
We're seeking to build transformation and validation layers as far upstream as possible to ensure a smooth flow of data through our system. The transformation layer will make the data easier to work with for our reporting products and ML models, while the validation layer will ensure the data conforms to our expectations. For example: Is it null, NULL, or 'null'? Is 342 a valid country abbreviation code?
As we expand our product offering and ingest data from additional companies and 3rd-party providers the complexity of the challenge will evolve over time, keeping the problem fresh.
Scope:
You'll get to architect our system and lay the foundation for the future from both a technology and a system design perspective.
No longer will data show up without being tested and structured, as you'll create a system that checks its worst tendencies. You'll work closely with our ML and Eng team to ensure the design meets their requirements and that data properly flows through the system.
Philosophies:
- You strongly believe that action creates information.
- You want to work on a small team and have lots of responsibility.
- You look forward to being scrappy and enjoy overcoming challenges.
Requirements:
- 5+ years of experience delivering value through data at an early stage, high growth startup (ideally within the payments industry)
- Prior experience with cloud environments such as AWS or GCP
- Strong Data Modeling experience, and familiarity with different approaches (Intermediate and up)
- Strong SQL skills
- Strong Python skills
- Prior experience with workflow orchestration tools (Prefectm, Airflow, Dagster)
- Experience with distributed systems workflows (Temporal, AWS Step functions)
- Experience with cloud OLAP providers and optimization (Snowflake, Redshift, BigQuery)
- Experience with Kafka pub/sub patterns and data ingestion
- Experience with data transformation patterns and common tools (dbt)
We are focused on building a diverse and inclusive workforce. If you’re excited about this role, but do not meet 100% of the qualifications listed above, we encourage you to apply.
--------
Butter Payments is an Equal Opportunity Employer and considers applicants for employment without regard to race, color, religion, sex, orientation, national origin, age, disability, genetics or any other basis forbidden under federal, state, or local law. Butter considers all qualified applicants in accordance with the San Francisco Fair Chance Ordinance.
Please review our CCPA policies here.
Top Skills
Airflow
AWS
BigQuery
Dagster
Dbt
GCP
Kafka
Prefect
Python
Redshift
Snowflake
SQL
Temporal
Similar Jobs
Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
As a Mid-Market Account Executive at Coupa, you'll drive business growth, engage with stakeholders, and close deals while establishing Coupa as a preferred partner for mid-market clients.
eCommerce • Software • Design
The Senior Brand Designer at Webflow will shape brand identity through campaigns, events, and experiences, focusing on design excellence and collaboration across teams. Responsibilities include managing creative deliverables, developing brand guidelines, and experimenting with digital and motion design.
Top Skills:
Adobe Creative SuiteFigmaWebflow
eCommerce • Software • Design
This role involves designing and launching partner acquisition programs, driving freelancer and agency engagement, and collaborating cross-functionally to align strategies with broader business goals.
Top Skills:
AIData Analysis
What you need to know about the Vancouver Tech Scene
Raincouver, Vancity, The Big Smoke — Vancouver is known by many names, and in recent years, it has gained a reputation as a growing hub for both tech and sustainability. Renowned for its natural beauty, the city has become a magnet for professionals eager to create environmental solutions, and with an emphasis on clean technology, renewable energy and environmental innovation, it's attracted companies across various industries, all working toward a shared goal: advancing clean technology.
