Workiy Logo

Workiy

QA Lead – Agentic AI Platform

Posted 4 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in CAN
Senior level
Remote
Hiring Remotely in CAN
Senior level
Lead QA for an Agentic AI platform: define and execute testing strategy, implement automation, validate LLM outputs and conversational workflows, oversee functional/integration/regression/performance testing, integrate CI/CD, mentor QA engineers, and promote quality best practices across teams.
The summary above was generated by AI

This is a remote position.

Job Description :

We are seeking an experienced QA Lead to oversee quality assurance efforts for a next-generation Agentic AI platform. The ideal candidate will be responsible for defining and executing comprehensive testing strategies that ensure the reliability, accuracy, scalability, and performance of AI-driven applications. This role requires close collaboration with product managers, software engineers, data scientists, and business stakeholders to validate end-to-end system functionality and deliver high-quality releases.

The QA Lead will drive the implementation of automated testing frameworks, establish quality standards and release criteria, and oversee functional, integration, regression, performance, and user acceptance testing activities. The role also involves validating AI model outputs, conversational workflows, API integrations, data pipelines, and overall user experience. Candidates should possess strong leadership skills, hands-on experience with test automation, API testing, CI/CD processes, and data validation, along with a deep understanding of Agile development practices.

The successful candidate will mentor QA engineers, promote quality best practices across teams, identify risks early in the development lifecycle, and continuously improve testing processes to support the delivery of robust, enterprise-grade AI solutions. Experience with Generative AI, Large Language Models (LLMs), Agentic AI systems, cloud platforms, and modern software quality engineering methodologies is highly preferred.



Requirements
  • AI/LLM Testing and Validation
  • Agentic AI and Conversational AI Platforms
  • Test Automation Frameworks (Selenium, Playwright, Cypress, or equivalent)
  • API Testing (REST, GraphQL)
  • Python or Java for Test Automation
  • Data Quality and Data Validation Testing
  • SQL and Database Testing
  • CI/CD Pipeline Integration (Jenkins, GitHub Actions, GitLab CI)
  • Functional, Integration, Regression, and End-to-End Testing
  • Performance and Load Testing
  • Defect Management and Test Planning
  • Quality Strategy, Release Gates, and Risk-Based Testing
  • Agile/Scrum Methodologies
  • QA Leadership and Team Mentoring
  • Strong Analytical and Problem-Solving Skills
  • Experience with Cloud Platforms (AWS, Azure, or GCP)


Similar Jobs

4 Hours Ago
Remote
Canada
Senior level
Senior level
Beauty • Robotics • Design • Appliances • Manufacturing
The Senior Sales Operations Manager drives revenue growth and operational excellence, focusing on forecasting, inventory management, and cross-functional collaboration to optimize performance across retail accounts.
Top Skills: Business Analytics ToolsExcelPowerPoint
4 Hours Ago
Easy Apply
In-Office or Remote
Canada
Easy Apply
Senior level
Senior level
Artificial Intelligence • Hardware • Healthtech • Software
As a Senior Machine Learning Engineer, you'll design and develop workflows utilizing vision-language models, manage data pipelines, and collaborate with multiple teams to enhance model accuracy and efficiency.
Top Skills: Cloud Inference ApisPythonPyTorch
4 Hours Ago
Remote
Canada
Senior level
Senior level
Cloud • Fintech • Food • Information Technology • Software • Hospitality
Design, build, deploy, and maintain scalable backend features and APIs for enterprise restaurant products. Lead complex projects, ensure quality with automated testing, monitor rollouts, collaborate with UX/PM, mentor engineers, and partner across teams to improve functionality and reliability for customers.
Top Skills: AndroidAPIsDistributed SystemsJavaKotlin

What you need to know about the Vancouver Tech Scene

Raincouver, Vancity, The Big Smoke — Vancouver is known by many names, and in recent years, it has gained a reputation as a growing hub for both tech and sustainability. Renowned for its natural beauty, the city has become a magnet for professionals eager to create environmental solutions, and with an emphasis on clean technology, renewable energy and environmental innovation, it's attracted companies across various industries, all working toward a shared goal: advancing clean technology.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account