Top Data Engineer Jobs in Vancouver

As a Principal Data Engineer, you will design and implement LLM, AI-powered security data platforms, mentor engineers, and drive the adoption of data solutions across teams.

Work with de-identified EMR data to develop and maintain ETL, data extraction logic, transformation workflows, and backend repositories. Implement automated data-quality tests, apply ML techniques for data optimization, troubleshoot and maintain shared codebases, provide secure environment support, document changes, and coordinate semi-annual EMR data extraction operations.

Design, build, and maintain SparkSQL/PySpark data pipelines in the central data lake to ingest IoT, product, and unstructured data (video/audio). Produce reliable computed tables for analytics, model training, and dashboards; integrate external datasets; ensure high data quality and uptime; and collaborate with Data Science, ML, and cross-functional teams.

Design, build, and operate scalable data ingestion, replication, and lakehouse infrastructure to move petabytes of data into a Delta Lake on S3. Improve reliability, observability, security, and developer experience for Spark/Databricks processing. Develop internal libraries and tooling (Go/Python), collaborate with cross-functional teams, and help shape long-term data platform and AI-ready infrastructure.

Design, build, and operate large-scale Spark/PySpark data pipelines and the enterprise data platform. Implement data integrations, transformations (Python/SQL), monitoring, and data quality. Build MCP servers and AI-enabled tooling, optimize performance, mentor engineers, and lead cross-functional data projects to enable analytics and automation.

The Staff Software Engineer will lead the development of backend services and data pipelines for real estate MLS data, mentor teams, and work on AI integration.

Lead AI engineering on the Data Platform: build Databricks Apps deployment paths, construct an AI layer over the Medallion Architecture and semantic layer, enable LLM/NLP systems and agentic workflows, embed AI tooling in the developer lifecycle, enforce guardrails for production safety, define metadata/modeling patterns, and mentor engineers to accelerate AI adoption.

The Senior Software Development Engineer will design and implement scalable backend services, lead team projects, and mentor junior engineers while ensuring system scalability and reliability.

The Software Development Engineer II will design and build backend services and APIs, improve system quality, and support onboarding of new engineers in a distributed systems environment.

Provide Tier 4 production support for Snowflake, Databricks, Azure Data Factory, Azure Data Lake and SQL-based data platforms. Triage and resolve incidents, perform root cause analysis, maintain runbooks, improve monitoring/automation, collaborate on releases, and support operational readiness and data quality for scalable, secure, AI-ready data solutions.

Design, build, and operate production ML systems that generate trusted signals for ranking, retrieval, recommendations, propensity/churn/LTV, and next-best-action decisioning. Define signal/data contracts, own feature and candidate generation through serving, experimentation, monitoring, and feedback loops, and evaluate long-term business impact, trust, fairness, and compliance. Partner across product, data, modeling, risk, and compliance and apply AI/agents to accelerate engineering and operations.

The Data Engineer will assist clients with SAP security design, implement SAP security, develop authorization profiles, and conduct security reviews.

The Senior Software Engineer will manage data systems, develop scalable pipelines, ensure data security, and build self-service applications for users at Coinbase.

Design and maintain data architecture and pipelines to support compliance and risk teams. Build and optimize data models, standardize metrics, and create data dictionaries. Implement data quality, lineage monitoring, AI-driven agents for false-positive reduction and automation, and participate in on-call rotations to ensure SLAs are met.

Lead design and optimization of data models and pipelines for compliance and risk; standardize metrics and documentation; build data quality, lineage, and monitoring (including AI agents for automation); manage ETL scheduling, on-call pipeline support, and collaborate with product and non-technical partners to translate business needs into automated, production-ready data solutions.

The Senior Staff Software Engineer will architect Affirm's lakehouse analytics platform, implement data governance, mentor engineers, and collaborate cross-functionally to optimize data infrastructure and solutions.

Design, build, and operate production ML signal systems—ranking, retrieval, recommendations, propensity, and next-best-action—covering feature/candidate generation, serving, experimentation, monitoring, and feedback. Define signal contracts (freshness, provenance, confidence), evaluate long-term impact (trust, fairness, compliance), and partner across product, data, and risk teams to deliver reusable customer-intelligence capabilities.

Design, build, and scale Snowflake ingestion pipelines and ML/LLM systems. Create agentic tooling to generate, test, and maintain pipelines. Collaborate with analysts, data scientists, and product teams to deliver reliable, high-performance data infrastructure and operationalize models for an AI-first e-commerce platform.

Ensure health, stability, and performance of production data platform: respond to incidents, monitor and alert, manage pipelines and APIs, enforce data validation and quality checks, optimize processing performance, collaborate on AWS infrastructure, maintain runbooks/documentation, and support downstream data consumers across multiple business data sources.

Build and operate scalable data ingestion, transformation, and connector frameworks; design and maintain a knowledge-graph-based data fabric; normalize and vectorize enterprise data for LLM/AI workflows; implement governance, lineage, access controls, and secure APIs to serve ML/agent pipelines.

Design, build, and maintain scalable data pipelines and ML systems at petabyte scale using Databricks/Spark. Partner with data science to productionize models, implement testing/monitoring, ensure compliance, and optimize ETL/ELT for merchant identity and fraud-risk applications.

Lead design and implementation of shared, reusable data models and a certified metrics layer. Standardize pipeline patterns, CI/CD, and governance; modernize orchestration and observability; partner with Data Science, Infrastructure, and Product to deliver reliable analytics pipelines and enable AI-native data development.

The Guidewire Data Engineer will design schemas in Snowflake, develop ETL processes, optimize SQL queries, and integrate Guidewire with data platforms.

Design, build, and optimize cloud-based data platform components: ingest and transform varied datasets, create metadata-driven pipelines and data APIs, support AI/ML infrastructure, implement monitoring and metrics, and improve data processes to enable analytics and operational systems.

As an Intermediate Data Engineer, you will develop data infrastructure and products, collaborate with diverse teams, and enhance technical quality across the data team.