Provectus Logo

Provectus

Senior Data Engineer (AWS)

Posted 11 Days Ago
Remote
2 Locations
Senior level
Remote
2 Locations
Senior level
The Senior Data Engineer will design and maintain data pipelines, collaborate with data scientists, and develop scalable APIs while overseeing data governance and transformations.
The summary above was generated by AI

We are seeking a talented and experienced Data Engineer to join our team at Provectus. As part of our diverse practices, including Data, Machine Learning, DevOps, Application Development, and QA, you will collaborate with a multidisciplinary team of data engineers, machine learning engineers, and application developers. You will encounter numerous technical challenges and have the opportunity to contribute to Provectus’ open source projects, build internal solutions, and engage in R&D activities, providing an excellent environment for professional growth.

Requirements

  • Experience in data engineering;
  • Experience working with Cloud Solutions (preferably AWS, also GCP or Azure);
  • Experience with Cloud Data Platforms (e.g., Snowflake, Databricks);
  • Proficiency with Infrastructure as Code (IaC) technologies like Terraform or AWS CloudFormation;
  • Experience handling real-time and batch data flow and data warehousing with tools and technologies like Airflow, Dagster, Kafka, Apache Druid, Spark, dbt, etc.;
  • Proficiency in programming languages relevant to data engineering such as Python and SQL;
  • Experience in building scalable APIs;
  • Experience in building Generative AI Applications (e.g., chatbots, RAG systems);
  • Familiarity with Data Governance aspects like Quality, Discovery, Lineage, Security, Business Glossary, Modeling, Master Data, and Cost Optimization;
  • Advanced or Fluent English skills;
  • Strong problem-solving skills and the ability to work collaboratively in a fast-paced environment.

Nice to Have:

  • Relevant AWS, GCP, Azure, Databricks certifications;
  • Knowledge of BI Tools (Power BI, QuickSight, Looker, Tableau, etc.);
  • Experience in building Data Solutions in a Data Mesh architecture;
  • Familiarity with classical Machine Learning tasks and tools (e.g., OCR, AWS SageMaker, MLFlow, etc.).

Responsibilities:

  • Collaborate closely with clients to deeply understand their existing IT environments, applications, business requirements, and digital transformation goals;
  • Collect and manage large volumes of varied data sets;
  • Work directly with Data Scientists and ML Engineers to create robust and resilient data pipelines that feed Data Products;
  • Define data models that integrate disparate data across the organization;
  • Design, implement, and maintain ETL/ELT data pipelines;
  • Perform data transformations using tools such as Spark, Trino, and AWS Athena to handle large volumes of data efficiently;
  • Develop, continuously test and deploy Data API Products with Python and frameworks like Flask or FastAPI.

Top Skills

Airflow
Apache Druid
AWS
Aws Cloudformation
Azure
Dagster
Databricks
Dbt
Fastapi
Flask
GCP
Kafka
Python
Snowflake
Spark
SQL
Terraform

Similar Jobs

4 Hours Ago
Remote
4 Locations
Mid level
Mid level
eCommerce • Food • Software
The role involves defining team direction, creating analytical frameworks, translating data into narratives, and identifying growth opportunities.
Top Skills: SQL
7 Hours Ago
Remote
Hybrid
7 Locations
Senior level
Senior level
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Design and implement machine learning models to mitigate fraud and risks, ensuring compliance and working closely with cross-functional teams.
Top Skills: AWSGCPMySQLNumpyPandasPythonPyTorchSklearnSnowflakeTableauTensorFlowXgboost
7 Hours Ago
Remote
Hybrid
8 Locations
Senior level
Senior level
Blockchain • Fintech • Mobile • Payments • Software • Financial Services
Design and implement machine learning models to prevent fraud and mitigate risk in Cash App, collaborating across teams to ensure effective solutions.
Top Skills: AWSGCPMySQLNumpyPandasPythonPyTorchSklearnSnowflakeTableauTensorFlowXgboost

What you need to know about the Vancouver Tech Scene

Raincouver, Vancity, The Big Smoke — Vancouver is known by many names, and in recent years, it has gained a reputation as a growing hub for both tech and sustainability. Renowned for its natural beauty, the city has become a magnet for professionals eager to create environmental solutions, and with an emphasis on clean technology, renewable energy and environmental innovation, it's attracted companies across various industries, all working toward a shared goal: advancing clean technology.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account