Design, develop, test, and support enterprise ETL/ELT data integration and pipeline solutions using Talend and relational databases. Build mappings, transformations, reconciliation, and reusable components; optimize SQL; administer Talend tooling; integrate REST APIs via Azure API Management; monitor and troubleshoot production pipelines; support data quality, governance, metadata, lineage, security, and SDLC processes while collaborating with stakeholders and using AI/automation tools for productivity.
This is a remote position.
A public sector organization is seeking an experienced Data Engineer to support a large-scale initiative modernizing environmental and natural resource regulatory processes.
The Data Engineer will design, develop, maintain, and support enterprise data integration, ETL/ELT, and data pipeline solutions using Talend, SQL, Azure, and relational databases.
Requirements
- Design, develop, test, and support enterprise data integration and ETL/ELT solutions using Talend.
- Build data mappings, transformations, reconciliation processes, and reusable integration components.
- Develop and optimize SQL queries, stored procedures, and database processes using SQL Server, Oracle, or PostgreSQL.
- Administer and support Talend Management Console (TMC) and Talend Remote Engine.
- Schedule, monitor, troubleshoot, and resolve production data pipeline and integration issues.
- Develop scalable batch and near-real-time data pipelines.
- Design and integrate REST APIs using Azure API Management.
- Support data quality, governance, metadata, lineage, security, and data privacy requirements.
- Work across development, testing, and production environments following established SDLC practices.
- Collaborate with data engineers, architects, business stakeholders, platform teams, and vendors.
- Leverage AI and automation tools for code generation, testing, data analysis, documentation, and pipeline optimization.
- Post-secondary degree, diploma, or certificate in Computer Science, Engineering, or a related field.
- 3+ years of experience designing, developing, testing, and supporting enterprise data integration solutions.
- 3+ years of experience with Talend Management Console/Talend Administration Center.
- 3+ years of experience installing, configuring, supporting, and troubleshooting Talend Remote Engine.
- 2+ years of production support experience for enterprise integration solutions.
- 4+ years working within a mature Software Development Lifecycle (SDLC).
- 1+ year of experience using AI for code generation, data analysis, automation, or development productivity.
- 6+ years of experience in business/data requirements analysis.
- 6+ years of strong Microsoft SQL Server experience.
- Experience building scalable ETL pipelines, implementing data quality, and working with cloud platforms.
- 3+ years of experience integrating RESTful APIs.
- 3+ years of experience with message queuing technologies.
- Experience with ServiceNow and Azure-based data management integrations.
- Experience with data governance, metadata management, data classification, and data lineage.
Similar Jobs
Artificial Intelligence • Marketing Tech • Software
Build and operate high-volume event streaming pipelines and analytical databases. Write production Elixir/Python services, integrate legacy pipelines, enforce event schemas and data quality, and provide monitoring, alerting, and SLA-driven observability for event data products.
Top Skills:
Apache FlinkAWSCloudFormationColumnar/Olap DatabasesDatabricksElixirGCPKafkaKinesisPulsarPythonSQLTerraform
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Design, build, and operate production AI systems and marketing data infrastructure. Develop retrieval pipelines, agent orchestration, CDP integrations, ETL/ELT pipelines, and analytics. Automate workflows with AI, ensure data quality and reliability, partner with stakeholders, ship Python and SQL code, mentor engineers, and drive requirements to production.
Top Skills:
Agent OrchestrationBigQueryClaude CodeCursorCustomer Data Platform (Cdp)Data WarehouseDatabricksDbtEtl/EltHightouchLlmsMarketing AutomationPythonSalesforceSegmentSnowflakeSQLWeb Analytics
Artificial Intelligence • Marketing Tech • Software
Design, build, and operate a unified data platform: ingesting, processing, and exposing large volumes of data. Develop scalable ingestion pipelines, storage layers, observability, SLIs/SLOs, multi-tenant models, and metadata/ governance to enable secure cross-product data access and migrations from legacy systems.
Top Skills:
AirflowApache FlinkAWSClickhouseCloudFormationDatabricksDockerElixirGCPKafkaKubernetesOlapOltpRedshiftSQLTerraform
What you need to know about the Vancouver Tech Scene
Raincouver, Vancity, The Big Smoke — Vancouver is known by many names, and in recent years, it has gained a reputation as a growing hub for both tech and sustainability. Renowned for its natural beauty, the city has become a magnet for professionals eager to create environmental solutions, and with an emphasis on clean technology, renewable energy and environmental innovation, it's attracted companies across various industries, all working toward a shared goal: advancing clean technology.
