Two Circles Logo

Two Circles

Lead Data Engineer

Posted Yesterday
Be an Early Applicant
In-Office
Vancouver, BC, CAN
Senior level
In-Office
Vancouver, BC, CAN
Senior level
Design, build and maintain Redshift data warehouse and dbt ETL pipelines. Implement dbt projects, tests, macros and documentation. Optimize Redshift/SQL performance, enforce data modelling best practices, CI/CD and version control, and ensure high-quality, test-driven development for big data pipelines.
The summary above was generated by AI
Who we are

We are Two Circles. We are a Sports & Entertainment Marketing business. We grow audiences and revenues. We do that by knowing fans best. We work with clients to help them understand & influence what their fans are doing – the way fans spend their money, the events that fans attend, the channels fans respond to, the content fans watch and more. And we use the understanding this gives us to help our clients grow. Grow their audiences and grow their revenues - both direct to consumer and business to business revenues. Our platforms and services are trusted by over 900 clients globally, including the English Premier League, Red Bull, UEFA, VISA, the NFL, Nike and Amazon. We are almost 1000 people, based out of 14 offices, and we deliver work for sports and entertainment businesses of all shapes and sizes all over the world.

Responsibilities:

*Redshift Experience is essential for this role

*Experience working with Big Data Essential

  • Create and maintain data warehouses and associated ETL processes using DBT models in Redshift
  • Implement and maintain DBT projects, including creating macros, tests, and documentation for data pipelines.
  • Conduct performance tuning for Redshift queries and DBT models to optimize resource utilization.
  • Develop and enforce best practices for data modelling with big data sets, version control, and CI/CD pipelines.
  • Ensure high quality development by building robust tests into each model developed.

Requirements

The ideal background and skills we are looking for include:  

  • Hands-on experience designing and implementing DBT models, tests, and documentation in a data warehousing environment.
  • Strong knowledge of Amazon Redshift architecture, SQL, and performance optimization techniques.
  • Familiarity with version control systems like Git and CI/CD workflows
  • Excellent communication skills with an ability to clearly articulate both end user value and technical implementation..
  • Passion for technology and an eagerness to learn
  • Ability to work in a fast-paced, constantly-changing environment while maintaining a strong eye for detail 

Experience with the following would also be beneficial:

  • AWS technologies such as Step function, AWS Glue jobs & Data Catalogues, Lambda Functions (Python based) and Athena.
  • Experience in development using Python and Pyspark
  • Experience of, or a keen interest in, the business of sport

Why Join Us?

  • Professional Growth: Work on a variety of projects, enhancing your testing skills across different applications and technologies.
  • Impactful Work: Play a key role in delivering high-quality solutions that shape the future of the sports and entertainment industries.
  • Collaborative Environment: Be part of a team that values ideas, fosters a supportive atmosphere, and encourages continuous learning and improvement.
  • Innovative Culture: Join a company committed to revolutionizing fan and stakeholder engagement through cutting-edge technology.

Similar Jobs

Yesterday
In-Office
Vancouver, BC, CAN
Senior level
Senior level
News + Entertainment • Sports
Lead Data Engineer responsible for designing, implementing, and maintaining large-scale, reliable data pipelines and cloud infrastructure. Collaborate with product, stakeholders, and cross-functional teams to deliver a SaaS data platform, ensure data quality, apply development best practices, contribute to DevOps and production operations, and support ongoing platform maintenance.
Top Skills: .NetAirflowAPIsAWSC#DockerMs Sql ServerNew RelicPytestPythonSnowflakeSQL
Yesterday
In-Office
Vancouver, BC, CAN
Senior level
Senior level
News + Entertainment • Sports
Design, build, and optimize scalable data lakehouse solutions on Azure using Databricks and Python. Develop reliable data pipelines, implement CI/CD, collaborate with product and marketing to deliver data products and insights, and continuously improve data workflows and performance.
Top Skills: AzureAzure Data Factory (Adf)Azure DevopsAzure Function AppsData LakehouseDatabricksPysparkPythonSQL
Yesterday
In-Office
Vancouver, BC, CAN
Senior level
Senior level
News + Entertainment • Sports
Hands-on Lead Data Engineer designing, building, and scaling data ingestion and processing pipelines for a customer data platform (Helix). Own end-to-end delivery on AWS (S3, EMR, ECS, Lambda) using Scala and Spark, mentor engineers, enforce engineering best practices, and optimize ETL/ELT, data modeling, identity resolution, and data warehousing with PostgreSQL/Redshift.
Top Skills: Amazon RedshiftAPIsAws EcsAws EmrAws LambdaAws S3Ci/CdEtl/EltJavaPostgresPythonS3-Based Data LakeScalaSpark

What you need to know about the Vancouver Tech Scene

Raincouver, Vancity, The Big Smoke — Vancouver is known by many names, and in recent years, it has gained a reputation as a growing hub for both tech and sustainability. Renowned for its natural beauty, the city has become a magnet for professionals eager to create environmental solutions, and with an emphasis on clean technology, renewable energy and environmental innovation, it's attracted companies across various industries, all working toward a shared goal: advancing clean technology.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account