As a Senior Software Engineer in Detection, you will architect and deploy backend ETL jobs, manage data pipelines, collaborate with ML and Data Science teams, and mentor junior engineers to enhance our Detection Engine's capabilities.
About the Role
Abnormal Security is looking for a Senior Software Engineer to join the Detection Team. The Detection Division is focused on building the world’s most advanced technology for identifying and stopping email and cloud-based attacks that were previously undetectable and help make the world a safer place. As a Data Engineer focused on building systems for Detection’s Signal Platform, you will be responsible for making feature development at Abnormal a fast, responsive, stable, and confident experience for our ML and Data Science team.
The ideal candidate would have the following qualities:
- A first principles approach to building scalable, customer-centric solutions
- A drive to solve meaningful & pragmatic problems for real-world people
- An ownership and impact oriented outlook on your efforts and growth
- An ability to iterate in real-time-solving novel problems, quickly and autonomously
- An ability to iterate in real-time - solving novel problems, quickly and autonomously
What you will do
- Architect, design, build, and deploy backend ETL jobs and infrastructure that support a world-class Detection Engine
- Ownership projects that enable us to meet ambitious goals for, such as building the plan to scale components of Detection’s Data Pipeline by 10x
- Own real-time, near real-time streaming pipelines and online feature serving services
- Collaborate closely with MLE and Data Science teams, by distilling feedback, correlating it to our strategy, and executing
- Coach and mentor junior engineers via 1on1s, pair programming, high quality code reviews and design reviews
Must Haves
- 5+ years of experience as a data engineer or in a similar role, with hands-on experience in building data-focused solutions.
- Expertise in ETL, data pipeline design, and data engineering tools and technologies (e.g., Apache Spark, Hadoop, Airflow, Kafka)
- Experience with maintaining real-time and near real-time data pipelines or streaming services at high scale
- Experience with maintaining large scale distributed systems on cloud platforms such as AWS, GCP, or Azure, including a strong grasp of best practices in cloud-based data engineering.
- A background in implementing data quality frameworks including validation, monitoring, and anomaly detection to ensure data accuracy, consistency, and reliability. You know how to design checks and alerts to maintain data integrity and quickly respond to potential issues.
- Proven ability to collaborate effectively with cross-functional teams, including data scientists, machine learning engineers, product managers, and other stakeholders. You’re able to translate requirements into actionable technical tasks, communicate progress clearly, and adapt to feedback.
- Excellent problem-solving skills and the ability to work independently in a fast-paced environment. You’re capable of breaking down complex challenges into manageable steps and iterating on solutions, balancing immediate needs with long-term scalability.
Nice to Have
- Familiarity with machine learning workflows and requirements to support data science teams effectively.
- Experience with streaming data architectures and real-time processing.
- Knowledge of security and compliance frameworks as they relate to data engineering and data privacy.
#LI-RT1
Top Skills
Airflow
Spark
Hadoop
Kafka
Similar Jobs
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Lead engineering projects for Square's mobile applications, focusing on building remote settings and configuration management systems. Collaborate with design and product teams to enhance user experience, ensure high availability in systems, and respond to customer feedback for product improvement.
Top Skills:
Objective-CSwift
Blockchain • Fintech • Mobile • Payments • Software • Financial Services
As a Staff Software Engineer, you will enhance the quality and efficiency of Cash App's mobile applications through automation and tooling, collaborating with teams to improve testing frameworks, conduct debugging, and mentor peers while ensuring high engineering standards.
Top Skills:
JavaJavaScriptKotlinPythonRuby
Artificial Intelligence • Machine Learning • Software
As a Technical Account Manager at mabl, you will manage technical relationships with strategic customers, ensuring optimal experiences with the AI-powered testing platform. Responsibilities include guiding implementations, troubleshooting issues, advocating for customer success, and representing mabl at events. This role combines technical knowledge with customer engagement to drive successful outcomes.
Top Skills:
JavaScript
What you need to know about the Vancouver Tech Scene
Raincouver, Vancity, The Big Smoke — Vancouver is known by many names, and in recent years, it has gained a reputation as a growing hub for both tech and sustainability. Renowned for its natural beauty, the city has become a magnet for professionals eager to create environmental solutions, and with an emphasis on clean technology, renewable energy and environmental innovation, it's attracted companies across various industries, all working toward a shared goal: advancing clean technology.