MARLOWE COMPANIES INC. Logo

MARLOWE COMPANIES INC.

AI Chatbot Tester

Posted 5 Hours Ago
Be an Early Applicant
Remote
Hiring Remotely in CA
Entry level
Remote
Hiring Remotely in CA
Entry level
Evaluates and validates AI chatbot and conversational AI performance through test plans, regression testing, user acceptance testing, and conversation analysis. Documents defects, verifies business requirements, identifies conversational gaps, reports findings, and recommends improvements. Collaborates with AI trainers, prompt engineers, and development teams to optimize chatbot quality, compliance, reliability, and user experience. Supports evaluation frameworks, testing standards, and continuous improvement initiatives.
The summary above was generated by AI
POSITION OVERVIEW

MCI is one of the fastest-growing tech-enabled business services companies in the USA, with a strong call center footprint and operations that extend across multiple countries. We deliver Customer Experience (CX), Business Process Outsourcing (BPO), and Anything-as-a-Service (XaaS) cloud technology solutions across a wide range of industries, including healthcare, retail, government, education, telecom, technology e-commerce, and financial services. Our contact centers are powered by both on-site and remote agents, leveraging advanced technologies to enhance customer journeys, drive scalability and reduce costs. 

At MCI we are committed to fostering an environment where professionals can build meaningful careers, access continuous learning and development opportunities and contribute to the success of a globally expanding, industry-leading organization.  



We are seeking an AI Chatbot Tester to evaluate, validate, and improve AI-powered chatbot and conversational AI solutions. This role focuses on ensuring chatbot responses are accurate, reliable, compliant, and aligned with business requirements and user expectations.

The successful candidate will play a key role in maintaining quality standards and enhancing customer experiences across AI-driven interactions.


To be considered for this role, you must complete a full application on our company careers page, including all screening questions and a brief pre-employment test.

POSITION RESPONSIBILITIES

Key Responsibilities:


Chatbot Testing & Validation

  • Execute test plans and chatbot evaluation scenarios.
  • Assess response quality and conversational effectiveness.
  • Validate chatbot functionality across use cases.
  • Identify defects, inconsistencies, and performance issues.

Quality Assurance

  • Conduct regression and user acceptance testing.
  • Verify compliance with business requirements.
  • Document test results and findings.
  • Support issue resolution activities.

Conversation Analysis

  • Review chatbot interactions and user journeys.
  • Identify gaps in conversational flows.
  • Recommend improvements to responses and workflows.
  • Analyze trends and recurring issues.

Collaboration & Reporting

  • Work closely with AI trainers and prompt engineers.
  • Provide testing feedback to development teams.
  • Participate in quality review sessions.
  • Prepare reports and performance insights.

Continuous Improvement

  • Support chatbot optimization initiatives.
  • Contribute to testing standards and best practices.
  • Stay informed about conversational AI developments.
  • Assist with evaluation framework improvements.
CANDIDATE QUALIFICATIONS

WONDER IF YOU ARE A GOOD FIT FOR THIS POSITION?

All positive, and driven applicants are encouraged to apply. The Ideal candidates for this position are highly motivated and dedicated and should possess the below qualities:

  • Diploma or Bachelor's Degree in Information Technology, Quality Assurance, Communications, Business, or related field.
  • Experience in software testing, QA, customer experience, or chatbot evaluation.
  • Strong attention to detail.
  • Excellent written communication skills.
  • Analytical and problem-solving abilities.
  • Experience documenting defects and test outcomes.
  • Ability to follow testing methodologies and processes.
  • Strong organizational skills.
  • Ability to work independently and collaboratively.
  • Basic understanding of AI and chatbot technologies.
  • Experience using productivity and reporting tools.
  • Customer-focused mindset.

Nice to Have

  • Experience testing AI chatbots or virtual assistants.
  • Knowledge of prompt engineering principles.
  • Familiarity with Generative AI technologies.
  • Experience with QA management tools.
  • Exposure to conversational design principles.
  • Knowledge of user experience testing methodologies.
  • Experience within technology or BPO environments.
  • Understanding of AI evaluation metrics.
PHYSICAL REQUIREMENTS

This job operates in a professional office environment. While performing the duties of this job, the employee will be largely sedentary and will be required to sit/stand for long periods while using a computer and telephone headset. The employee will be regularly required to operate a computer and other office equipment, including a phone, copier, and printer. The employee may occasionally be required to move about the office to accomplish tasks; reach in any direction; raise or lower objects, move objects from place to place, hold onto objects, and move or exert force up to forty (40) pounds.

CONDITIONS OF EMPLOYMENT

All MCI Locations

  • Must be authorized to work in the country where the job is based.

Subject to the program and location of the position

  • Must be willing to submit up to a LEVEL II background and/or security investigation with a fingerprint.  Job offers are contingent on background/security investigation results.
  • Must be willing to submit to drug screening.  Job offers are contingent on drug screening results. (Does not apply in Canada)
REASONABLE ACCOMMODATION

Consistent with the Americans with Disabilities Act (ADA), it is the policy of MCI and its affiliates to provide reasonable accommodations when requested by a qualified applicant or employee with a disability unless such accommodations would cause undue hardship. The policy regarding requests for reasonable accommodation applies to all aspects of employment. If reasonable accommodations are needed, please contact Human Resources.

EQUAL OPPORTUNITY EMPLOYER

At MCI and its subsidiaries, we embrace differences and believe diversity is a benefit to our employees, our company, our customers, and our community.  All aspects of employment at MCI are based solely on a person's merit and qualifications.  MCI maintains a work environment free from discrimination, one where employees are treated with dignity and respect. All employees share in the responsibility for fulfilling MCI's commitment to a diverse and equal opportunity work environment.


MCI does not discriminate against any employee or applicant on the basis of age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations, and ordinances.  MCI will consider for employment qualified applicants with criminal histories in a manner consistent with local and federal requirements.


MCI will not tolerate discrimination or harassment based on any of these characteristics.  We adhere to these principles in all aspects of employment, including recruitment, hiring, training, compensation, promotion, benefits, social and recreational programs, and discipline. In addition, it is the policy of MCI to provide reasonable accommodation to qualified employees who have protected disabilities to the extent required by applicable laws, regulations, and ordinances where an employee works.

ABOUT MCI (PARENT COMPANY)

MCI helps customers take on their CX and DX challenges differently, creating industry-leading solutions that deliver exceptional experiences and drive optimal performance. MCI assists companies with business process outsourcing, staff augmentation, contact center customer services, and IT Services needs by providing general and specialized hosting, software, staff, and services.


In 2019, Marlowe Companies Inc. (MCI) was named by Inc. Magazine as Iowa’s Fastest Growing Company in the State of Iowa and was named the 452nd Fastest Growing Privately Company in the USA, making the coveted top 500 for the first time. MCI’s subsidiaries had previously made Inc. Magazine's List of Fastest-Growing Companies 15 times, respectively. MCI has ten business process outsourcing service delivery facilities in Georgia, Florida, Texas, New Mexico, California, Kansas, Nova Scotia, South Africa, and the Philippines.


Driving modernization through digitalization, MCI ensures clients do more for less. MCI is the holding company for a diverse lineup of tech-enabled business services operating companies. MCI organically grows, acquires, and operates companies that have synergistic products and services portfolios, including but not limited to Automated Contact Center Solutions (ACCS), customer contact management, IT Services (IT Schedule 70), and Temporary and Administrative Professional Staffing (TAPS Schedule 736), Business Process Management (BPM), Business Process Outsourcing (BPO), Claims Processing, Collections, Customer Experience Provider (CXP), Customer Service, Digital Experience Provider (DXP), Account Receivables Management (ARM), Application Software Development, Managed Services, and Technology Services, to mid-market, Federal & enterprise partners. MCI now employs 10,000+ talented individuals with 150+ diverse North American client partners across the following MCI brands: MCI BPO, MCI BPOaaS, MarketForce,  GravisApps, Gravis Marketing, MarchEast, Mass Markets, MCI Federal Services (MFS), OnBrand24, The Sydney Call Center, Valor Intelligent Processing (VIP), BYC Aqua, EastWest BPO, TeleTechnology, and Vinculum.

................

The purpose of the above job description is to provide potential candidates with a general overview of the role. It's not an all-inclusive list of the duties, responsibilities, skills, and qualifications required for the job.  You may be asked by your supervisors or managers to perform other duties. You will be evaluated in part based upon your performance of the tasks listed in this job description.


The employer has the right to revise this job description at any time. This job description is not a contract for employment, and either you or the employer may terminate employment at any time, for any reason.

Similar Jobs

59 Minutes Ago
Remote
Ontario, ON, CAN
Expert/Leader
Expert/Leader
Fintech • Financial Services
Architects and develops AI-powered systems, backend services, APIs, experimentation frameworks, and automation using foundational models. Integrates AI capabilities with microservices, AWS, Snowflake, and diverse technology stacks while ensuring scalability, reliability, and maintainability. Collaborates with product, data science, and engineering teams to translate business needs into technical solutions, evaluate emerging AI tools, and rapidly prototype proof-of-concept applications.
Top Skills: APIsAWSAws BedrockClaudeContainer OrchestrationData PipelinesGoHugging FaceLangchainMicroservicesOpenaiPythonRubySnowflakeVector Databases
An Hour Ago
Easy Apply
Remote
Canada
Easy Apply
Senior level
Senior level
Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Conduct red team operations, adversary simulations, and offensive security assessments across cloud environments. Evaluate cloud infrastructure, identity architectures, CI/CD pipelines, containerized workloads, and cloud-native services. Identify attack paths involving IAM, secrets, metadata, automation, and configuration weaknesses. Validate detection and response capabilities with blue teams, track emerging attacker techniques, and drive remediation through concise reporting and stakeholder communication.
Top Skills: Ci/CdCloud ComputingContainerizationGpenGxpnIamMitre Att&CkOscpOsep
An Hour Ago
Easy Apply
Remote or Hybrid
Canada
Easy Apply
Junior
Junior
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Own end-to-end sales for small-to-medium commercial customers (11–30 vehicles). Prospect and qualify leads, run proofs of concept, negotiate multi-stakeholder deals, handle high-volume transactional sales, and meet quota while championing customer success and company culture.
Top Skills: IotSalesforce (Sfdc)Telematics

What you need to know about the Vancouver Tech Scene

Raincouver, Vancity, The Big Smoke — Vancouver is known by many names, and in recent years, it has gained a reputation as a growing hub for both tech and sustainability. Renowned for its natural beauty, the city has become a magnet for professionals eager to create environmental solutions, and with an emphasis on clean technology, renewable energy and environmental innovation, it's attracted companies across various industries, all working toward a shared goal: advancing clean technology.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account