Top Data Engineer Jobs in Vancouver

Design, build, deploy, and operate full-stack software across frontend applications, backend Java services, data pipelines, databases, and cloud infrastructure. Develop Vue.js, TypeScript, and React applications; build APIs and event-driven services; manage AWS infrastructure; create data pipelines with Python, SQL, dbt, and Databricks; and maintain testing, CI/CD, monitoring, and production reliability. Partner with cross-functional teams to deliver scalable customer-facing and internal solutions.

Build and operate reliable data pipelines transforming flight test, simulation, and operational data into versioned, traceable ML training datasets. Responsibilities include ingestion, normalization, time alignment, validation, dataset lineage, anomaly mining, labeling workflows, deployment feedback loops, monitoring, and data coverage analysis. Collaborate with flight test and operations teams on instrumentation and data access. The role is on-site in Boston and requires production data engineering experience supporting machine learning pipelines.

Design, build, and operate scalable data ingestion, replication, and lakehouse infrastructure to move petabytes of data into a Delta Lake on S3. Improve reliability, observability, security, and developer experience for Spark/Databricks processing. Develop internal libraries and tooling (Go/Python), collaborate with cross-functional teams, and help shape long-term data platform and AI-ready infrastructure.

Design, build, and operate large-scale Spark/PySpark data pipelines and the enterprise data platform. Implement data integrations, transformations (Python/SQL), monitoring, and data quality. Build MCP servers and AI-enabled tooling, optimize performance, mentor engineers, and lead cross-functional data projects to enable analytics and automation.

Lead end-to-end data and ML pipelines for onboarding and fraud decisions: ingest streaming and batch sources, build feature platform and entity resolution, productionize ML models, enforce PII/data governance, and set technical direction while mentoring engineers and ensuring low-latency, reliable serving.

Design and own scalable data pipelines, warehousing architecture, and dbt transformation layers from ingestion through analytics and incentive payouts. Lead data-platform architecture, including OLake, Iceberg, and Snowflake workflows. Establish performance, cost, quality, lineage, observability, and schema-drift standards. Partner with engineering and analysts on telematics accuracy and driver incentive reporting while using AI coding tools to accelerate development.

Own production-grade analytics pipelines from design through maintenance, build dbt-based analytical models using Kimball dimensional modeling, and deliver reliable data features. Partner with Product, Engineering, and Data Science teams to translate retail signals into business insights. Establish standards for monitoring, documentation, reproducibility, and code quality. Use AI tools to accelerate development and prototype conversational data experiences for natural-language retail data exploration.

Own and scale the company’s analytics infrastructure, including BigQuery data warehouses, dbt data marts, external data exchange, DataOps, data quality, governance, security, and cloud cost optimization. Partner with application database teams, analytics engineers, and data scientists to enable reliable metrics and scalable client data delivery.

The Guidewire Data Engineer will design schemas in Snowflake, develop ETL processes, optimize SQL queries, and integrate Guidewire with data platforms.

Lead the architecture and scaling of Overstory’s data platform for AI-powered vegetation analysis. Design and operate large-scale geospatial and temporal data pipelines, orchestration systems, event-driven workflows, service-oriented architecture, data quality frameworks, and observability practices. Drive architectural standards, system design, scalability, reliability, and traceability while mentoring engineers and collaborating with data, ML, and product teams.

Design, build, and optimize scalable batch and real-time data pipelines and ETL/ELT workflows. Partner with analytics, data science, and business stakeholders to create governed customer data models, identity resolution, and customer 360 capabilities. Enforce data quality, governance, privacy, and security, mentor junior engineers, and improve platform reliability and performance for CDP and customer data products.

Build and maintain production-grade dbt data models and pipelines across ingestion, transformation, and visualization. Partner with Finance, Engineering, Sales, Product, and Marketing to deliver reliable data for reporting and decision-making. Improve manual workflows, validate data accuracy, and design scalable solutions using modern data modeling practices. Support financial and revenue-related analytics, including ARR and revenue recognition, while balancing immediate fixes with long-term architecture.

Design, build, and optimize cloud-based data platform components: ingest and transform varied datasets, create metadata-driven pipelines and data APIs, support AI/ML infrastructure, implement monitoring and metrics, and improve data processes to enable analytics and operational systems.

Design, build, and scale real-time and batch data infrastructure and pipelines (Kafka, Databricks, Snowflake) to power analytics, reporting, and AI-powered data experiences. Drive data modeling, governance, observability, and best practices while partnering with cross-functional teams and mentoring engineers.

Lead Data Engineer responsible for designing, implementing, and maintaining large-scale, reliable data pipelines and cloud infrastructure. Collaborate with product, stakeholders, and cross-functional teams to deliver a SaaS data platform, ensure data quality, apply development best practices, contribute to DevOps and production operations, and support ongoing platform maintenance.

Designs, builds, and maintains scalable batch and real-time data pipelines supporting an IoT safety ecosystem. The role manages ETL/ELT processes, data lakes, warehouses, lakehouses, orchestration, monitoring, data quality, and observability. It partners with product, engineering, analytics, and data science teams to deliver reliable data services, productionize models, and shape long-term data platform architecture using AWS and modern infrastructure practices.

Design and build durable, distributed data-streaming infrastructure that decouples process data from Camunda’s live execution engine. Develop customer-facing integrations such as Kafka connectivity, support analytics data consumption at scale, and make architecture decisions around consistency, durability, and storage. Participate in production support and on-call rotations while collaborating with Product, Data Layer, Distributed Systems, QA, SRE, and Support teams. Lead ambiguous, cross-functional engineering initiatives from design through delivery.

Build and maintain Camunda 8 backend data-layer services spanning relational databases and Elasticsearch/OpenSearch. Design scalable storage, query, retention, and streaming systems; improve performance, indexing, and production tooling. Lead engineering initiatives from solution design through delivery, collaborate across teams, provide L3 support, and participate in on-call rotations. Investigate production data issues and contribute to schema evolution, workflow automation, and CI improvements.

Design and maintain scalable batch and real-time data pipelines, build governed data models for a CDP, ensure data quality and security, support identity resolution and customer 360, mentor junior engineers, and collaborate with analytics and business stakeholders to deliver actionable customer insights.

Lead the design and evolution of the data platform, including real-time and batch CDC pipelines, Snowflake warehouse architecture, infrastructure as code, reporting infrastructure, data quality monitoring, and scalable data models. Establish standards for incremental processing, late-arriving data, and schema evolution while mentoring engineers and making technical architecture decisions.

Build and maintain production-grade data processing systems and foundational infrastructure for enterprise AI. Collaborate with researchers and engineers, deliver end-to-end implementations, transform unstructured data into performant datasets, and use distributed processing frameworks and modern analytics tooling to inform products and strategy.

The AI-Native Data Engineer will build data pipelines, architect databases, design GCP infrastructure, and automate workflows for energy management using AI.

The role involves designing and building data pipelines for analyzing user feedback on AI models, ensuring data quality and infrastructure scalability.

Design and implement secure, resumable cloud pipelines to ingest multi-terabyte medical imaging data; build GPU-accelerated orchestration with strong retry semantics and cost controls; define data lifecycle and retention; implement HIPAA/PHI security and compliance controls; and deliver operational tooling (monitoring, alerting, runbooks) for a device fleet.

Designs and operates scalable security logging infrastructure, data lakes, ingestion pipelines, and multi-tier storage for enterprise-scale observability. Responsibilities include architecting ELK and OpenSearch environments, optimizing ingestion and queries, implementing infrastructure as code, developing APIs and integrations, managing retention and costs, capacity planning, and supporting disaster recovery. The role partners with security leadership on platform strategy and mentors engineers while enabling analytics and detection engineering across cloud environments.