The role involves designing and building event-driven data services on AWS, focusing on real-time streaming, microservices, and integration with various AWS data services, ensuring scalability and quality.
About the Role
Our client is seeking a Senior AWS DataHub Developer to design and build real-time, event-driven data services on AWS. This role is developer-first (application-side) rather than infrastructure-led. You will architect and deliver Kafka-based streaming pipelines and serverless data applications that ingest, transform, and serve data at scale.
You’ll collaborate with architects, data engineers, and product teams to deliver secure, resilient, observable, and highly scalable solutions that power enterprise-grade analytics and event-driven applications.
What You’ll Do (Key Responsibilities)
- Design & Deliver Event-Driven Pipelines: Build serverless data flows using AWS Lambda, Step Functions, EventBridge, SNS, SQS, API Gateway.
- Real-Time Streaming: Develop Kafka (Apache Kafka/Amazon MSK) consumers/producers for high-throughput, low-latency streaming and decoupled microservices.
- Microservices & APIs: Build and optimize TypeScript (preferred) or Python services/APIs for data ingestion, transformation, and delivery.
- AWS Data Services Integration: Work with S3, DynamoDB, Glue, Athena, CloudWatch for storage, metadata, querying, and observability.
- Quality & Reliability: Implement idempotency, retries, dead-letter queues, exactly-once/at-least-once semantics where appropriate, and schema evolution strategies.
- CI/CD & Testing: Use Git-based workflows and CI/CD (e.g., GitHub Actions, Jenkins) with automated tests (unit/integration/load) and infrastructure deployments.
- IaC (Developer View): Define application-layer infrastructure using AWS CDK, Terraform, or CloudFormation—with strong emphasis on developer productivity and repeatability.
- Agile Collaboration: Contribute to technical design, story sizing, peer reviews, and continuous improvement.
Ideal Candidate Profile
- You are a cloud-native, application-side developer who thinks in events, streams, and services—not servers. You design for resiliency, observability, and scale, and you’re comfortable pairing Kafka with AWS serverless to deliver business outcomes.
Similar Jobs
.png){kind=logo}
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Design high-level systems that integrate ML models into production, enable ML–rendering engine interaction, build language-agnostic APIs/wrappers and microservices, evaluate build-vs-buy options, coordinate cross-functional integration requirements, and decompose product vision into scalable ML-enabled architecture.
Top Skills:
APIsC#C++ContainerizationDeep LearningGitMessage BrokersMicroservicesModel DeploymentModel Fine-TuningPythonReal-Time Rendering EngineReinforcement LearningUnix Shell
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Develop and optimize C++ systems implementing machine learning, computer vision, and (inverse-)procedural 3D modeling algorithms. Collaborate with leadership to translate product vision, manage code with Git, deploy and test on cloud platforms, work with large-scale geospatial datasets, and operate in Unix (bash) environments.
Top Skills:
BashC++Cloud PlatformCmakeGitLinuxmacOSMercurialUnix ShellUnreal Engine
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Design and implement high-performance C++ systems for machine learning, computer vision, and 3D/procedural modeling. Apply research, optimize code for speed and scalability, collaborate with leadership, use Git, deploy and test on cloud with large-scale geospatial datasets, and operate in a Unix shell environment.
Top Skills:
3D ModelingC++Cloud PlatformCmakeComputational GeometryComputer GraphicsComputer VisionGeospatial Data ProcessingGitLinuxMachine LearningmacOSMercurialPythonUnix Shell/BashUnreal Engine
What you need to know about the Vancouver Tech Scene
Raincouver, Vancity, The Big Smoke — Vancouver is known by many names, and in recent years, it has gained a reputation as a growing hub for both tech and sustainability. Renowned for its natural beauty, the city has become a magnet for professionals eager to create environmental solutions, and with an emphasis on clean technology, renewable energy and environmental innovation, it's attracted companies across various industries, all working toward a shared goal: advancing clean technology.
