Build and maintain scalable data pipelines and lakehouse solutions using Databricks, Spark, Python/PySpark, Scala, SQL, Delta Lake, and Azure Data Factory. Develop analytical data models, orchestration, testing, governance, monitoring, and recovery processes. Optimize performance, reliability, scalability, and cost efficiency while supporting machine learning data feeds. Collaborate with technical and business partners, document solutions, troubleshoot production issues, and contribute to platform improvements.
Come join Pattison Food Group Ltd., a Jim Pattison business, and Canada’s largest Western-based provider of food and health products.
Pattison Food Group Ltd. consists of Save-On-Foods and other well-known grocery banners. With nearly 300 retail locations, we proudly employ more than 30,000 team members.
We have an exciting opportunity for a full-time Data Engineer to join our IT team in Langley, BC.
Reporting to the Team Lead, Data & Analytics, you will be responsible for working with one of the largest, most comprehensive datasets in Canada while delivering and pioneering solutions that will disrupt the retail industry using the latest tools and technologies.
You will be responsible for:
- Building and maintaining scalable, well-structured data solutions using Medallion Architecture in modern delta lake/lakehouse platforms
- Designing and developing, high-performance, scalable data pipelines using Databricks, Spark, Python/PySpark and SQL
- Developing dimensional and analytical data models, including fact and dimension tables, slowly changing dimensions, incremental processing, change data capture, and reusable curated datasets.
- Writing production Python/Scala scripts in a Spark/Databricks environment to support the data pipelines that feed Machine Learning models
- Orchestrating data ingestion, transformation, scheduling, monitoring, and recovery processes using ADF / Databricks Automation Bundles
- Applying data-quality, testing, documentation, security, and governance standards throughout the development lifecycle.
- Optimizing data pipelines and models to improve performance, scalability, reliability, and cost efficiency. Identifying opportunities to simplify processing and improve overall solution design.
- Using version control, code reviews, CI/CD, and established release-management practices.
- Working with business and technical partners to understand requirements and translate them into practical data solutions.
- Troubleshooting production issues and contributing to ongoing platform and process improvements.
You have:
- A Bachelor’s degree in a STEM discipline at minimum, a Master’s is preferred.
- A minimum 2 years of experience building and supporting production data pipelines in a cloud-based environment
- Strong SQL and Python/PySpark skills, with experience working with large datasets.
- Experience with Databricks, Spark, Delta Lake, or a comparable modern data platform.
- Experience with data pipeline orchestration using Azure Data Factory, Databricks Jobs, or similar tools.
- Knowledge of modern data architecture, ETL/ELT, data modelling, incremental processing, data quality, and production support.
- Familiarity with Git-based version control, automated testing, and CI/CD practices.
- The ability to communicate clearly, document solutions, and work effectively with technical and non-technical partners.
You are:
- A practical problem solver with an ownership mindset.
- Detail-oriented and committed to delivering reliable, supportable solutions.
- A collaborative communicator who works well across teams.
- Curious and adaptable, with an interest in modern data technologies and continuous improvement.
What we offer
In addition to a highly competitive salary, we offer a great range of benefits, a company pension plan, free parking, exclusive team member offers, and opportunities for development and career progression.
If you’re looking to join a team that puts people first, you’re in the right place. Apply online today!
IND6
Compensation Details:
$85,062.00 - $106,328.00The compensation offered for this position will take into consideration location, education, skills, experience and other factors.
Pattison Food Group Langley, British Columbia, CAN Office
19855 92A Ave , Langley, BC, , Canada, V1M3B6
Similar Jobs
Aerospace • Hardware • Robotics • Software
Own and evolve a portable data platform infrastructure across commercial cloud, government cloud, and on-premises environments. Responsibilities include infrastructure as code, security and compliance, observability, SLOs, incident response, capacity planning, backups, upgrades, deployment tooling, and runbooks. The role will establish SRE practices, support regulated customer deployments, collaborate with distributed systems engineers, and mentor a future SRE hire.
Top Skills:
Aws GovcloudCi/CdKubernetesTerraform
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Own Treasury’s data architecture and technical roadmap, personally building and operating a Snowflake liquidity datamart with source integrations, data models, reconciliation, controls, and data contracts. Partner with machine learning engineers on forecasting datasets and lead the Treasury Management System build-versus-buy recommendation. The role requires production reliability, automation, incident response, stakeholder management, and translating ambiguous financial business problems into adopted systems.
Top Skills:
Ai AgentsAirflowCloud Data WarehousesDbtMachine LearningPrefectPythonSnowflakeSQL
Blockchain • Fintech • Mobile • Payments • Software • Financial Services
Own Treasury’s data architecture and hands-on development of a Snowflake liquidity datamart. Build integrations, data models, reconciliation logic, data quality controls, forecasting datasets, and production pipelines. Partner with Treasury, Accounting, and machine learning engineers; lead Treasury Management System build-versus-buy recommendations; and operate reliable, controlled data systems through adoption. The role also includes automation, monitoring, incident response, and reducing manual reconciliation and investigation.
Top Skills:
AirflowDbtPrefectPythonSnowflakeSQL
What you need to know about the Vancouver Tech Scene
Raincouver, Vancity, The Big Smoke — Vancouver is known by many names, and in recent years, it has gained a reputation as a growing hub for both tech and sustainability. Renowned for its natural beauty, the city has become a magnet for professionals eager to create environmental solutions, and with an emphasis on clean technology, renewable energy and environmental innovation, it's attracted companies across various industries, all working toward a shared goal: advancing clean technology.
