Index Exchange Logo

Index Exchange

Director, Data Engineering

Posted 3 Days Ago
Be an Early Applicant
Hybrid
Toronto, ON
Senior level
Hybrid
Toronto, ON
Senior level
The Director of Data Engineering will lead data platforms, streaming pipelines, and machine learning pipelines, ensuring system integrity and quality while mentoring a world-class engineering team.
The summary above was generated by AI

At Index Exchange, we’ve spent the last 20 years revolutionizing the way digital advertising works. Our pioneering global team coupled with our owned and operated infrastructure has allowed us to scale to processing over half a trillion auctions daily operating one of the largest ad exchanges in the world at true Internet scale. Our exchange allows for low latency matching of buyers and sellers to create a seamless and efficient marketplace where every millisecond counts.


We enable the world’s largest media owners to maximize every advertising dollar spent in support of delivering their high-quality streaming television, content and Internet services. Our mission is to achieve total market efficiency, delivering digital advertising at a lower cost, and higher relevancy through planet-scale infrastructure, data systems, and machine learning - ultimately keeping the Internet a vibrant and largely free resource for everyone's benefit.


About the role

The Director of Data Engineering is responsible for Data Platforms, Streaming Pipelines and Machine Learning Pipelines.  Our datasets are in the 10s of petabytes and have a daily ingest of 2+ petabytes.   Data systems are at the center of the company and enable almost every function including analytics, machine learning, billing, customer insights among others.  We are building the next generation platform for 10x scale.


The ideal candidate will have experience at scale, capable of leading a world class engineering team and be responsible for end to end production. 


What You’ll Be Doing

Vision: Have a deep understanding of Index and its products and processes and stay informed on the latest technology in the industry. Drive initiatives that produce positive outcomes across the company. 


Leadership: We need someone who can help us scale.  That means hiring the right people, helping people grow both technically and personally, helping teams improve the way they work, creating a strong sense of ownership at the individual and team level, mentoring junior leaders and identifying and developing new leaders. We need you to have proven leadership ability and experience leading and managing multiple cross-functional teams and both individual contributors and first-line managers.  


Data Engineering: Lead the transformation of the next generation of big data solutions at Index Exchange with real-time streaming and batch analytical capabilities. Collaborate and service to both internal and external customers and partners for their reporting and analytics as well as machine model training needs. 

 


What We’re Looking For 

Technical Leadership: You have gained experience and skills that enable you to chart a technical path for products, systems, and architectures. You are happy to be hands-on in the code, but your biggest impact is leading from the front and guiding others. Your role is to represent the technical health and future of the products you support while applying industry best practices towards designs and implementations. 


People Leadership: You know how to work with and lead a distributed team of data and software engineers. You have demonstrated mentorship skills and set a technical vision to challenge your team in a way that empowers them to have incredible impact. You empower teams, who in turn build intricate systems that deliver great outcomes. 


Handler of Broad Scope: You thrive in environments where multiple projects and initiatives are under your ownership at different maturity levels. Specifically, when the number of initiatives is larger than the resources. You can manage your own and prioritize your team’s time in each project to achieve the highest impact for the organization. You take sequencing of projects and tasks into consideration and proactively report progress and delays to drive coordination. 


Driver of Outcomes: You are intentional in your path, establishing a vision or hypothesis, setting a direction, and guiding your team through execution. You use data to inform pivots or to validate assumptions, and partner with the Product team to set a roadmap, establish goals and forecasts to achieve both technical and business outcomes. 


End-to-End Owner: You take great pride in the platforms and products that your teams own and deliver, and take full responsibility for their quality, health, and outcomes. You lead your teams in ensuring services remain healthy and that technical debt is regularly paid down. When issues arise, you lead your team in responding, mitigating, and addressing the issues to learn from them for the future. 


Organizational Coordinator: You are the first point of contact for your team, your platforms, your products, and your delivery plan. You foster a collaborative approach to delivery and leverage those relationships to unblock dependencies. You are a strong communicator and collaborator, responsive when issues arise, and celebrate successes by representing your team's achievements to the rest of the organization. 


Here's What You Need 

  • A Bachelor’s or post-graduate degree in Computer Science, Engineering, or equivalent
  • Setting the agenda for multiple teams across a high performing Engineering organization and driving through to significant outcomes
  • Deep understanding of design principles of distributed systems with streaming data platform and analytical frameworks and technologies
  • Extensive experience in partnering with Product Management and other internal stakeholders on developing roadmaps, deliverables and timelines
  • Extensive experience leading partnership with external/client stakeholders
  • Experience with big data stack including Kafka, Hadoop, Spark, Flink, Scala, and Airflow, as well as data warehouse technologies such as Druid, Starrocks, Vertica 
  • Experience with data modeling, data warehousing, ETL processes, and business intelligence reporting tools  
  • Experience working in on-premise environments
  • Knowledge of BI tools like Looker, Superset and/or Redash will be very helpful 
  • Experience with Docker and Kubernetes is a plus


Why You’ll Love Working Here

  • Comprehensive health, dental, and vision plans for you and your dependents
  • Paid time off, health days, and personal obligation days plus flexible work schedules
  • Competitive retirement matching plans
  • Equity packages
  • Generous parental leave available to birthing, non-birthing, and adoptive parents
  • Annual well-being allowance plus fitness discounts and group wellness activities
  • Commuter benefits and discounts, where available
  • Employee assistance program
  • Mental health first aid program that provides an in-the-moment point of contact and reassurance
  • One day of volunteer time off per year and a donation-matching program
  • Bi-weekly town halls and regular community-led team events
  • Multiple resources and programming to support continuous learning
  • A workplace that supports a diverse, equitable, and inclusive environment – learn more here


Notification

Index Exchange is aware that there have been recent scams directed toward candidates regarding job interviews and offers.

Please be vigilant and do not accept interview requests, job offers, or other hiring-related documents from anyone other than our dedicated recruitment team, from the domain of @indexexchange.com. Our interview process consists of several steps, including phone screens and video interviews. We do not conduct interviews via an email questionnaire or request money at any point in the process.

We remain dedicated to resolving this matter and we appreciate your support.

Equal employment opportunity

At Index Exchange, we believe that successful products are built by teams just as diverse as the audience who uses them. As such, we are committed to equal employment opportunities. We celebrate diversity of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or expression, or veteran status. Additionally, we realize that diversity is deeper than any status or classification—diversity is the human experience. For those who show grit, passion, and humility—Index will welcome you.

Accessibility for applicants with disabilities

Index Exchange welcomes and encourages individuals with disabilities to apply to work with us. 

If you require an accommodation, please share the details of your request and any information how we can assist you with the hiring recruiter when they contact you. Index Exchange will make reasonable efforts to ensure accommodation requests are met throughout the recruitment process.

Index Everywhere, Index Anywhere

Our corporate headquarters are in Toronto, with major offices in New York, Montreal, Kitchener, London, San Francisco, and many other global cities. As a major global advertising exchange, we are committed to operating as a tightly knit global team and embracing and empowering talent wherever our colleagues may be. 


#LI-ONSITE

#LI-MB1

Top Skills

Airflow
Docker
Druid
Flink
Hadoop
Kafka
Kubernetes
Looker
Redash
Scala
Spark
Starrocks
Superset
Vertica

Similar Jobs

Yesterday
Toronto, ON, CAN
Senior level
Senior level
Big Data • Cloud • Digital Media • Machine Learning • Mobile • Software • Industrial
The Director of People Insights & Data Science Engineering leads a team in optimizing people analytics, providing technical guidance, enhancing data processes, and developing predictive models to inform talent management strategies.
Top Skills: AWSData VisualizationPower BIPythonRSQLTableau
17 Days Ago
Remote
5 Locations
Senior level
Senior level
Cloud • Legal Tech • Software
The Director of Data Engineering leads the team to build internal and external data infrastructure, mentor engineers, and develop data strategy, while fostering collaboration across departments.
Top Skills: AirflowDatabricksInfrastructure-As-Code
18 Days Ago
Remote
4 Locations
Senior level
Senior level
Security • Software • Cybersecurity
Lead McAfee’s Enterprise Data Analytics team, overseeing data curation and governance, while managing a high-performing team to ensure data quality and reliability.
Top Skills: BoomiCloud Data ManagementData EngineeringData GovernanceData LakehouseData MeshData PipelinesDatabricksFivetranInformaticaKafkaPower BITableau

What you need to know about the Vancouver Tech Scene

Raincouver, Vancity, The Big Smoke — Vancouver is known by many names, and in recent years, it has gained a reputation as a growing hub for both tech and sustainability. Renowned for its natural beauty, the city has become a magnet for professionals eager to create environmental solutions, and with an emphasis on clean technology, renewable energy and environmental innovation, it's attracted companies across various industries, all working toward a shared goal: advancing clean technology.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account