QA score

What is a QA score?

· Glossary

Short answer

A QA score is the grade a support conversation gets when it is reviewed against a quality scorecard, shown as a percentage. Each criterion, such as accuracy, tone and resolution, is scored and weighted, and the scores roll up to agents and teams.
Also called
QA rating, quality score, internal quality score (IQS)
Scale
Usually 0 to 100%
Built from
A weighted scorecard of quality criteria
Coverage
A sample of conversations, or all of them

QA stands for quality assurance. In customer service, a QA score is how a team turns "was that a good reply?" into a number it can track: for each person, each request type and the operation as a whole. The number is only as good as the scorecard behind it and the share of conversations it covers.

How a QA score is calculated

Each criterion on the scorecard has a weight. A reviewer scores the conversation on each one, and the weighted scores add up to a percentage.

CriterionWeightScore
Correct answer3535
Problem solved2525
Followed policy2010
Checked the order and the customer1010
Tone and clarity108
Total10088%

Here the agent answered a return question correctly and kindly but skipped the store's photo-of-damage step, losing half the policy points. Many scorecards also have auto-fail criteria: sharing another customer's details, or promising a refund the policy does not allow, sets the whole score to zero.

What goes on a QA scorecard

A scorecard lists what good looks like; a rubric explains how to score each line.

  • Accuracy. Was every fact right: the order status, the policy, the product detail?
  • Resolution. Did the customer get what they needed, or a next step with a date?
  • Policy and process. Were the required checks done, in order?
  • Communication. Clear, warm, the right length, in the store's voice.
  • Efficiency. No needless back and forth or repeated questions.

Weighted scorecards put most of the points on accuracy and resolution, because a polite wrong answer is still wrong. Calibration sessions, where reviewers score the same conversations and compare, keep different reviewers' scores consistent.

In Aide, the same kind of inconsistency surfaces on its own: when teammates answer the same question differently, Aide asks which answer is policy as part of its nightly knowledge gaps.

Sampled QA vs 100% QA

Most teams score a small sample, often a few conversations per agent per week, because reviewing takes time. A sampled score is an estimate: a problem that repeats in the unreviewed conversations can hide for weeks.

100% QA means scoring every conversation, usually with AI doing the first pass against the same scorecard and people checking the failures and a share of the passes. It catches repeating problems sooner and removes the luck of the draw from individual scores. It is only trustworthy if the AI's scores are regularly checked against human reviewers.

QA scores for AI agents

Conversations handled by an AI agent need QA as much as human ones, scored on the same scorecard so the two can be compared. Two criteria matter more for AI. Accuracy, because an AI can state a wrong fact fluently. And actions, because a wrong cancellation or refund costs more than a clumsy sentence.

The practice this page rejects is QA as a policing exercise on a tiny sample, read once a month. A QA score exists to find what to fix: a help article, a policy, a step in a process.

With Aide, every reply is checked before it is sent: a wrong fact, a promise the policies don't back or a leftover placeholder gets one rewrite, and the reply goes to the team if that doesn't fix it, so some failures a scorecard would mark are stopped before a customer sees them.

Where Aide fits

Aide runs QA on its own replies, not on your team's. The Quality page reviews a random daily sample of Aide's drafts and replies against what the team actually sent, plus every one that stands out: a draft rewritten or discarded, a handoff, a knowledge gap. Each is acceptable or not, with no partial credit, and the headline is pass or fail against a bar of 90% acceptable over at least 100 reviews, so a handful of reviews can't flip the result. A teammate can mark any draft Good or Wrong, and their verdict overrides Aide's own review.

For reviewing the team's conversations, Aide gives reviewers the record to score from: each customer message shows the topics Aide detected, each reply shows the sources it used, and order actions offered, run or sent for approval are logged in the conversation's Action Trace. Aide's analytics show CSAT for Aide and for the team separately, and every number opens the conversations it counts, which makes it easy to pull the ones worth reviewing.

Frequently asked questions

A quality assurance score: the percentage a support conversation earns when reviewed against a scorecard of criteria such as accuracy, resolution, policy and tone. Averaged across conversations, it becomes an agent's or a team's QA score.

Many teams set the pass mark between 85% and 90%, but the number depends on how strict the scorecard is. Track the trend and the scores on individual criteria, which show what to fix.

The scorecard lists the criteria and their weights. The rubric describes what each score means for each criterion, so two reviewers give the same conversation the same score.

Scoring every support conversation instead of a sample, usually with AI scoring first and people reviewing the failures and a share of the rest.

Review a random sample so the pass rate is an honest estimate, add every reply that stands out (rewritten drafts, handoffs, complaints), grade each as acceptable or not, and only trust the rate once enough replies have been reviewed. Aide's bar is 90% acceptable over at least 100 reviews.

Weekly is common for sampled programs, so feedback reaches agents while the conversations are fresh. With automated scoring, conversations can be scored as they close and reviewed in a weekly session.

About Aide

Aide is the AI platform for customer service. Its AI agent answers customers and resolves orders, refunds and returns, inside Zendesk, Gorgias or Front, or on its own with Aide Helpdesk. Built for ecommerce brands, with deep Shopify integration. What is Aide (aide.app)?

The AI platform for customer service

Aide answers customers and resolves Shopify orders in chat, email and your helpdesk. Free to start.