Design and architect large-scale distributed Big Data solutions using Java, Spark, and Hadoop/Cloudera. Lead global teams to build high-volume data processing and analytics pipelines, ensure robust testing (JUnit), and apply scripting for automation and data analysis.
Qualifications
- Minimum 15+ years of relevant experience in applications development
- Architect and design large-scale, distributed big data solutions using Java and big data technologies to handle high-volume data processing and analytics.
- Expertise in Bigdata ecosystem (Cloudera Distribution) using spark and Map Reduce
- Java (core) 1.8 or above - Hands-on experience (advanced concepts of data structures, memory management and design patterns)
- Apache Spark - Hands on (preferable on Java spark)
- Bigdata ecosystem (Good understanding of Hadoop, preferable cloudera distribution), exposure to Hive, Impala, Yarn, Kafka
- Good Data analysis and programing skills and understanding of large datasets (no sql joins)
- Good knowledge of Java and spark architecture and design principles
- Good experience in Junit/Testing frameworks
- Unix/Python shell scripting experience is a big plus
- Experience managing global technology teams
- Working knowledge of industry practices and standards
- Good communication skills
Photon Vancouver, British Columbia, CAN Office
900-885 W Georgia Street , , Vancouver, BC , Canada, V6C 3H1
Similar Jobs
Big Data • Fintech • Mobile • Payments • Financial Services
Lead a team that defines and executes operations enablement strategy, delivering cross-functional programs to scale servicing operations. Own roadmaps, stakeholder governance, risk management, change management, training, knowledge management, and measurable outcomes in a regulated fintech environment.
Top Skills:
Ai-Enabled Knowledge ToolsDesign ThinkingLean Six SigmaProject Management
Cloud • Security • Software • Cybersecurity • Automation
Design and implement backend and real-time features in the GitLab monolith for portfolio planning at scale. Optimize PostgreSQL performance, evolve APIs (GraphQL/REST), build capacity planning and work-item hierarchies, create proofs of concept, maintain automated tests, support safe rollouts with feature flags and observability, mentor contributors, and participate in on-call and production troubleshooting.
Top Skills:
ClickhouseElasticsearchFeature FlagsGitlabGraphQLGraphql SubscriptionsPostgresPythonRestful ApisRubyRuby On Rails
Big Data • Fintech • Mobile • Payments • Financial Services
Lead product strategy for Affirm's 1:Many distribution partnerships, owning partner portfolio and building repeatable integration capabilities. Define roadmaps, prioritize features, develop success metrics/OKRs, and partner with commercial, design, analytics, and engineering to launch and scale platform partner integrations that drive merchant growth.
Top Skills:
Figma
What you need to know about the Vancouver Tech Scene
Raincouver, Vancity, The Big Smoke — Vancouver is known by many names, and in recent years, it has gained a reputation as a growing hub for both tech and sustainability. Renowned for its natural beauty, the city has become a magnet for professionals eager to create environmental solutions, and with an emphasis on clean technology, renewable energy and environmental innovation, it's attracted companies across various industries, all working toward a shared goal: advancing clean technology.
