Shift4 Logo

Shift4

Director, Data Engineering

Posted 22 Days Ago
Remote
8 Locations
Expert/Leader
Remote
8 Locations
Expert/Leader
The Director of Data Engineering will lead a team to design data architecture, oversee pipeline development, enforce data quality, and drive innovation in data management.
The summary above was generated by AI
Overview

Shift4 (NYSE: FOUR) is boldly redefining commerce by simplifying complex payments ecosystems across the world. As the leader in commerce-enabling technology, Shift4 powers billions of transactions annually for hundreds of thousands of businesses in virtually every industry. For more information, visit www.shift4.com.


Director of Data Engineering


Overview:


Shift4 is expanding globally and building out our data engineering team, seeking an experienced Director of Data Engineering with a minimum of 10 years of overall experience, 3 years of management to spearhead our data architecture, pipeline development, and data lake / data warehousing efforts. This role involves not just technical expertise but also leadership in guiding data strategies that empower our business decisions and initiatives.


Responsibilities:

  • Data Architecture: Design, implement, and manage our data infrastructure, ensuring scalability, efficiency, and security. This includes defining data schemas, data pipelines, and data storage solutions.
  • Leadership & Mentorship:
    • Lead a team of ~10 data engineers, setting standards for data handling, integration, and warehousing.
    • Mentor junior team members, fostering a culture of continuous learning and improvement.
  • Pipeline Development:
    • Develop robust ETL (Extract, Transform, Load) processes to ingest, process, and transform data from various sources.
    • Optimize data flow and storage for speed, scalability, and reliability.
  • Data Quality and Governance:
    • Establish and enforce data quality standards and governance policies.
    • Implement data validation processes to ensure data integrity.
  • Analytics and Reporting:
    • Collaborate with data scientists and analysts to tailor data solutions that meet analytical requirements.
    • Support the creation of BI tools, dashboards, and reports by providing clean, structured data.
  • Innovation:
    • Research and recommend new technologies and tools to improve data management and processing.
    • Drive the adoption of best practices in data engineering, like data lake architectures, streaming data, and real-time analytics.
  • Project Management:
    • Oversee data-related projects from conception to completion, including planning, execution, and delivery.
    • Ensure project timelines, quality, and objectives are met.
  • Cross-functional Collaboration: Work closely with business stakeholders, product
    managers, and other engineering teams to align data strategy with business goals.

Qualifications:

  • Education: Bachelor's or Master's degree in Computer Science, Data Science, Information Technology, or related field or experience in lieu of a degree may be considered. 
  • At least 10 years of experience in data engineering or a similar discipline.
  • At least 3 years of experience in managing data engineers or a similar discipline.
  • Experienced conducting 1:1s, fostering growth plans, and managing engineering velocity.
  • Proficiency in SQL and experience with big data technologies (e.g., Hadoop, Spark).
  • Strong coding skills in languages like Python, Java, Scala, Node JS, Golang, etc…
  • Experience with cloud services (AWS, Azure, Google Cloud) for data solutions.
  • Knowledge of data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).
  • Familiarity with data modeling, ETL tools, and data pipeline orchestration tools (e.g., Airflow, Luigi).
  • Understanding of machine learning pipelines and feature engineering is a plus.
  • Excellent analytical and problem-solving skills.
  • Strong communication skills to effectively articulate complex data concepts to non-technical stakeholders.
  • Certifications: AWS Certified Big Data - Specialty, Google Professional Data Engineer, or similar.

#LI-BN1


We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity and/or expression, status as a veteran, and basis of disability or any other federal, state or local protected class.


Top Skills

Airflow
AWS
Azure
BigQuery
Go
GCP
Hadoop
Java
Luigi
Node Js
Python
Redshift
Scala
Snowflake
Spark
SQL

Similar Jobs

Yesterday
Remote
5 Locations
Senior level
Senior level
Cloud • Legal Tech • Software
The Director of Data Engineering leads the team to build internal and external data infrastructure, mentor engineers, and develop data strategy, while fostering collaboration across departments.
Top Skills: AirflowDatabricksInfrastructure-As-Code
4 Days Ago
Remote
4 Locations
Senior level
Senior level
Security • Software • Cybersecurity
Lead McAfee’s Enterprise Data Analytics team, overseeing data curation and governance, while managing a high-performing team to ensure data quality and reliability.
Top Skills: BoomiCloud Data ManagementData EngineeringData GovernanceData LakehouseData MeshData PipelinesDatabricksFivetranInformaticaKafkaPower BITableau
12 Hours Ago
Remote
Hybrid
7 Locations
Senior level
Senior level
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Design and implement machine learning models to mitigate fraud and risks, ensuring compliance and working closely with cross-functional teams.
Top Skills: AWSGCPMySQLNumpyPandasPythonPyTorchSklearnSnowflakeTableauTensorFlowXgboost

What you need to know about the Vancouver Tech Scene

Raincouver, Vancity, The Big Smoke — Vancouver is known by many names, and in recent years, it has gained a reputation as a growing hub for both tech and sustainability. Renowned for its natural beauty, the city has become a magnet for professionals eager to create environmental solutions, and with an emphasis on clean technology, renewable energy and environmental innovation, it's attracted companies across various industries, all working toward a shared goal: advancing clean technology.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account