The Associate Principal Engineer, Big Data will be responsible for designing and implementing complex data pipelines, ETL processes, and data integrations. This role requires strong expertise in Snowflake, SQL Server, and Python, as well as experience working with major cloud providers, specifically AWS. Excellent problem-solving and communication skills are also essential.
Company Description
We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (15000+ experts across 26 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That is where you come in!
Job Description
Must have Skills : Snowflake, SQL Server, Python (Strong), SQL (Strong),
Total Experience : 10+ years of experience
Qualifications:
- Bachelor's degree in Computer Science, Engineering, or related field;
- Master's degree is a plus.
- Minimum of 10 years of hands-on experience in data engineering.
- 5+ years commercial experience with MSSQL
- 2+ years commercial experience with major cloud provide, preferably AWS
- Experience in embedded DBA /DBM role working directly with developers
- Proven experience in designing and implementing complex data pipelines, ETL processes, and data integrations.
- In-depth knowledge of Snowflake architecture, features, and best practices for performance optimization.
- Proficiency in SQL, Python, or other relevant programming languages for data manipulation and transformation.
- Excellent problem-solving skills and the ability to troubleshoot and resolve complex data engineering challenges.
- Strong communication skills and the ability to work collaboratively in a team environment.
- Data engineering certifications, are a plus.
Similar Jobs
Artificial Intelligence • Fintech • Machine Learning • Social Impact • Software
As a Senior Data Platform Engineer at Upstart, you'll expand developer tools for data validation and quality checks, build frameworks for data lineage and governance, and improve data infrastructure's uptime and observability. Collaborating with various teams, you'll ensure architecture alignment with business goals and mentor junior members while enhancing platform performance and security.
Top Skills:
AirflowAWSDatabricksDbtDockerKafkaKubernetesPostgresPythonSparkSQL
Artificial Intelligence • Information Technology • Machine Learning • Software • Virtual Reality • Analytics
The Associate Principal Engineer, Big Data will design and implement self-service data architectures, enabling business users to access and analyze data independently while ensuring quality, governance, and security. Responsibilities include data architecture design, tool selection, governance standards establishment, data modeling, and user training.
Artificial Intelligence • Fintech • Machine Learning • Social Impact • Software
As a Data Platform Engineer at Upstart, you'll build user-friendly tools for data teams, expand self-serve ETL frameworks, manage a data catalog, and ensure data discovery and governance. You'll collaborate with various product teams, monitor platform performance, and stay updated on best practices in data engineering.
Top Skills:
AirflowAWSDatabricksDbtDockerKafkaKubernetesPostgresPythonSparkSQL
What you need to know about the Vancouver Tech Scene
Raincouver, Vancity, The Big Smoke — Vancouver is known by many names, and in recent years, it has gained a reputation as a growing hub for both tech and sustainability. Renowned for its natural beauty, the city has become a magnet for professionals eager to create environmental solutions, and with an emphasis on clean technology, renewable energy and environmental innovation, it's attracted companies across various industries, all working toward a shared goal: advancing clean technology.
