Radiant Security Logo

Radiant Security

Senior Software Engineer (Data Lake)

Posted 18 Days Ago
Be an Early Applicant
7 Locations
Senior level
7 Locations
Senior level
As a Senior Software Engineer, you will architect and maintain enterprise data lake infrastructure, develop ingestion frameworks, optimize performance, and implement security controls. You will work with cutting-edge AI technologies and be part of a dynamic team focused on transforming security operations.
The summary above was generated by AI

Join the Future of Cybersecurity with Radiant Security’s AI Revolution

Are you ready to dive into the world of Generative AI and be part of the team that’s transforming how security operations are done? At Radiant Security, we’re not just creating tools—we’re pioneering the industry’s first AI SOC Analyst, built to think and act like a top-tier security expert. Here, you’ll have the unique opportunity to learn and grow with cutting-edge AI technology. Our AI uses advanced algorithms to analyze security alerts, performing hundreds of dynamic tests in just minutes to deliver detailed incident reports, root cause analysis, and custom response plans. By the time an alert reaches a human analyst, the heavy lifting is done—they know whether it’s real, what caused it, and how to fix it.

As part of the Radiant team, you’ll work directly with this groundbreaking technology, learning how to harness its power to transform SOC workflows. Whether you’re looking to expand your skills in AI-driven automation, decision-making, or cybersecurity as a whole, Radiant Security is the place to grow and thrive

This is a hybrid position and we are attending the offices 3 times a week. We have offices in Pleasanton, California and São Paulo, Brazil.

About the Role:

As a Senior Software Engineer at Radiant Security in the Fabric Services team, you will be responsible for architecting and maintaining our enterprise data lake infrastructure. You'll work on building robust data lake solutions that enable efficient data ingestion, processing, and analytics at petabyte scale. Your focus will be on developing cloud-native data lake architectures that support both batch and real-time processing while ensuring data governance, security, and accessibility.

Key Responsibilities:

  • Design and implement modern data lake architectures using technologies like Apache Iceberg, Delta Lake, or Apache Hudi for efficient data management and ACID transactions
  • Develop data lake ingestion frameworks supporting multiple data formats (Parquet, ORC, Avro) and implementing medallion architecture (bronze, silver, gold layers)
  • Build automated data quality and governance solutions for data lake environments, including metadata management, data cataloging, and lineage tracking
  • Optimize data lake performance through partitioning strategies, compaction policies, and query optimization techniques
  • Implement data lake security controls including fine-grained access control, encryption, and audit logging

Skills and Qualifications:

  • Advanced programming skills with experience building large-scale data processing applications and ETL pipelines (we use NodeJS, Golang, and Python)
  • Extensive experience with data lake technologies including Apache Iceberg, Delta Lake, or Apache Hudi, and modern lakehouse architectures
  • Expertise in cloud data platforms including AWS Lake Formation, Azure Data Lake Storage, or GCP, along with their respective query engines (Athena, Synapse Analytics, BigQuery)
  • Strong background in data processing frameworks such as Apache Spark, Apache Flink, or Apache Beam, with experience in both batch and streaming architectures
  • Proven experience with data governance and optimization, including implementing data quality frameworks, metadata management, access controls, and performance tuning strategies

Nice to Have:

  • Hands-on experience in containerization and orchestration (Docker, Kubernetes) for deploying scalable data services.
  • Previous work orchestrating deployments of new infrastructure using IaC in terraform

Why Join Us?

Beyond the challenging data and platform engineering problems and working with a high-caliber engineering team, working at Radiant is major opportunity to impact security teams by reducing their workload and mitigating security incidents quickly. Come help shape a future where people can sleep more easily due to a smaller blast radius of cyber threats.

The process:

  • People team interview
  • Coding interview
  • Architecture Testing
  • Virtual On Site: Leadership interviews


Radiant Security participates in E-Verify for US employees. We will provide the US Social Security Administration and the US Department of Homeland Security with information from each new employee’s Form I-9 to confirm work authorization. Please note that we do not use this information to pre-screen job applicants.

Top Skills

Go
Node.js
Python

Similar Jobs

2 Days Ago
Toronto, ON, CAN
Junior
Junior
Transportation
As a Software Engineer in Data Pipelines at Lyft, you'll monitor and optimize production infrastructure, build automation tools, and support large-scale distributed systems. Responsibilities include maintaining metrics, developing tools for reliability and efficiency, and participating in on-call rotations.
Top Skills: GoPython
10 Days Ago
10 Locations
Junior
Junior
Fintech • Payments
WEX is seeking a Software Engineer to join their Data team to design and implement data products and systems. The role involves collaborating with stakeholders, using big data technologies, managing cloud infrastructure, and developing CI/CD automation. Candidates will engage in problem-solving and contribute to building scalable data platforms and tools.
Top Skills: C#GoJavaPython
16 Days Ago
Remote
Vancouver, BC, CAN
Mid level
Mid level
Information Technology • Consulting
As a Software Engineer on the Data Platform team, you will develop and maintain an enterprise data platform, create and enhance statistical and machine learning models, and collaborate with your team to promote best coding practices. You will work on various datasets, participating in the full software development lifecycle while sharing knowledge and contributing to innovative location intelligence solutions.
Top Skills: C#JavaPythonSQLTypescript

What you need to know about the Vancouver Tech Scene

Raincouver, Vancity, The Big Smoke — Vancouver is known by many names, and in recent years, it has gained a reputation as a growing hub for both tech and sustainability. Renowned for its natural beauty, the city has become a magnet for professionals eager to create environmental solutions, and with an emphasis on clean technology, renewable energy and environmental innovation, it's attracted companies across various industries, all working toward a shared goal: advancing clean technology.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account