Test before go-live

How to test an AI support agent before it goes live

With Aide you test on your own conversations before any customer sees a reply: preview the draft a scenario would write on real conversations from the last 28 days, chat with the agent yourself in its preview, and roll each helpdesk inbox out from Watch only to test senders, a share of conversations and then everyone. Nothing is sent to customers or written to your helpdesk while you preview or watch.

Updated  · Every plan, Free included
Everything you verify before going live
Real conversations matchedWhy it holds backAgent previewCompared with your teamWatch onlyTest sendersReal conversations matchedWhy it holds backAgent previewCompared with your teamWatch onlyTest sendersReal conversations matchedWhy it holds backAgent previewCompared with your teamWatch onlyTest senders
Exact or estimated match countsUnsaved changes flaggedDrafting hint per topic levelRuns listed per scenarioSent, drafted or neither per inboxPreviews never billedExact or estimated match countsUnsaved changes flaggedDrafting hint per topic levelRuns listed per scenarioSent, drafted or neither per inboxPreviews never billedExact or estimated match countsUnsaved changes flaggedDrafting hint per topic levelRuns listed per scenarioSent, drafted or neither per inboxPreviews never billed

The ways to test Aide before going live

Match count on real conversationsWhile you build a scenario, Aide shows how many of your conversations from the last 28 days its conditions match, exact for small sets and estimated above that, with up to five real examples.
Preview draftOwners and admins run Aide's reply on any of those examples with the saved scenario, even while it is switched off. You see the reply, or why Aide would hand off, skip or hold back, and which scenarios applied. Nothing is sent or written.
Agent previewChat with the agent from its page, as a customer would. The preview says what it is answering from, for example "Answering from 120 pages of acme.com".
Drafts on recent ticketsConnect Zendesk, Gorgias or Front and Aide drafts replies to up to 10 recent open tickets and 3 recently solved ones inside Aide, with your team's actual reply beside each solved one.
Watch onlyA helpdesk inbox or mailbox in Watch only decides and drafts on live traffic inside Aide and writes nothing to the helpdesk. The inbox lists every conversation a scenario ran on, Watch only included.
Staged rolloutThen test senders (addresses you choose), a share of conversations, and everyone. Per inbox, each reply is sent, drafted or neither, with the reason shown.
Topic levelsNew topics start at Drafts. Aide sends replies and acts on its own only on topics you move to AI Agent.
CostPreviews and spam are never counted as AI replies. Replies to test senders count like any reply, and drafts Aide keeps inside Aide in Watch only count once per customer message, like any draft.

A test-before-launch routine

  1. Step 1

    Build the scenario

    Set the conditions (topic, order, shipment, fields) and the instructions or actions. The editor says whether Aide drafts, sends or writes nothing on that topic.

  2. Step 2

    Check what it matches

    See how many conversations from the last 28 days match and open the real examples, before the scenario is switched on.

  3. Step 3

    Preview the draft

    Run Aide's reply on those examples. Fix the instructions or knowledge, save and preview again until the answer is right.

  4. Step 4

    Roll out in stages

    Keep the topic at Drafts, then AI Agent. Move each inbox from Watch only to test senders, a share of conversations and everyone.

Really great approach and strong answers out of the box. Ability to grow into your AI journey at your own pace starting with suggested responses, macro suggestions or precanned messages and then slowly automate once you're confident.
Zendesk Marketplace reviewZendesk
We currently use Zendesk and as such needed an AI solution that works with our existing CX platform and allows us to fully leverage our Shopify data to cut down support times and costs. Aide was a perfect fit as it integrates with both and seamlessly helped our agents get through tickets faster and automatically populates ticket fields on Zendesk!
Patchstore24Shopify
We have been working with Aide for some time now and they have been exceedingly responsive and helpful to our needs. Throughout the process, the Aide team has taken our feedback well and made this as smooth as possible.
Wicked ClothesShopify
What you see while testing

Watch it work before customers do

Every example below is a preview or a staged rollout, not a reply to a customer. This is what your team sees before Aide answers anyone.

The count under the conditions updates a moment after you stop editing, using the conditions on screen, saved or not. Each example opens the real conversation, with the customer message the conditions matched.
Customer
Can I change the address on my order? I just moved.
Aide
Of course. What's your order number and the email you used at checkout? Once they match, I'll update the address if the order hasn't shipped yet.
✓About 120 conversations in the last 28 days match · Preview draft · Nothing sent

A preview doesn't only show a reply. When Aide would hand off, skip or hold a reply back for your team, the preview says so and why, and lists which scenarios applied.
Customer
I want a refund for my last order, it arrived late.
Aide
Would draft for your team: the Refund requests topic is set to Drafts, so Aide writes the reply and a teammate sends it. Refunds also wait for approval.
✓Preview · Topic level: Drafts · Scenarios applied: Refund policy

Open the preview on the agent's page and write as a customer. Push on your policies and the edge cases you're worried about. The preview says what the agent is answering from, so a missing article is easy to spot.
Customer
If I return something, do I get my shipping back too?
Aide
Returns are refunded for the item price. Original shipping isn't refunded unless the item arrived damaged or we sent the wrong one.
✓Agent preview · Answering from 120 pages of acme.com

When you connect a helpdesk, Aide drafts replies to a few recently solved tickets inside Aide and shows each next to the reply your team actually sent.
Customer
Is the trail runner true to size? I'm usually a 9.
Aide
Most customers find it true to size, so a 9 should fit. If you're between sizes or prefer room in the toe, go up half a size.
✓Drafted inside Aide · Your team's reply shown beside it · Nothing written to Zendesk

An inbox in Watch only lets Aide decide and draft on real incoming tickets, inside Aide, while writing nothing to the helpdesk. Your team sees exactly what Aide would have done.
Customer
My package says delivered but it isn't here.
Aide
I'm sorry about that. The carrier marked it delivered this morning. Could you check with neighbours or your building's front desk? If it doesn't turn up by tomorrow, reply here and our team will help.
✓Watch only · Drafted in Aide · Nothing written to Gorgias

Move an inbox to test senders and only the addresses you list get Aide's replies, so your team can write in as customers. Then a share of conversations, then everyone.
Customer
Hi, testing: can I cancel order #1001?
Aide
I can help with that. Order #1001 hasn't shipped yet. Shall I cancel it and refund your payment?
✓Rollout: test senders · Replied to your test address only
Testing in Aide uses your real conversations, your knowledge and your scenarios. Read more about how Aide stays safe on the homepage, or about security at aide.app/security.
After you go live

Tested before launch. Checked after.

Testing decides what goes live. These keep it accountable once it does.
Every reply checkedBefore a reply is sent, Aide checks it. One that promises something the topic's level doesn't allow, or claims to be a person, is revised or handed off.
Refunds wait for your teamRefunds wait for a teammate by default, and large refunds need an Owner or Admin.
Always says it is an AIWhen asked, Aide answers with a fixed line no setting can change. Talk to a person reaches your team at once.
On the recordEach conversation shows the topic, sources and actions behind a reply, and the audit log keeps every change for two years.
Getting started

Test on the conversations you already have

Connect your helpdesk or add Aide Chat, and testing runs on your own conversations. No migration and no engineering.

Frequently asked questions

In Aide you test on your own conversations: see how many conversations from the last 28 days a scenario matches, preview the draft Aide would write on them, chat with the agent in its preview, and keep a helpdesk inbox in Watch only before widening it to test senders, a share of conversations and everyone. New topics start at Drafts, so a person sends every reply until you move the topic to AI Agent.

Yes. Scenario match counts and Preview draft run on your real conversations from the last 28 days. When you connect Zendesk, Gorgias or Front, Aide also drafts replies to up to 10 recent open tickets and 3 recently solved ones inside Aide, with your team's actual reply beside each solved one.

No. A preview shows the reply Aide would write, or why it would hand off, skip or hold back, and nothing is sent to the customer or written to the conversation or your helpdesk. An inbox in Watch only drafts inside Aide and writes nothing to the helpdesk.

Yes. Each helpdesk inbox moves through Watch only, test senders (only addresses you list get Aide's replies), a share of conversations, and everyone. You can also start with one topic at AI Agent and keep the rest at Drafts or None.

Owners and admins. A preview uses the saved scenario, even while it is switched off; with unsaved changes it asks you to save first. A workspace can run 30 previews an hour.

No. Previews and spam are never counted. Replies Aide sends to test senders count like any other reply, and drafts Aide keeps inside Aide while an inbox is in Watch only count once per customer message, like any other draft.

Every reply is checked before it is sent, refunds wait for your team by default, Aide says it is an AI when asked, and each conversation shows the topic, sources and actions behind every reply. The audit log keeps every settings change for two years.

Start free with 150 AI replies a month and no card, with every feature included. Paid plans start at $39 a month with a 7-day free trial, and you pay for AI replies, not seats. See aide.app/pricing.

Test Aide on your own conversations, free

Every feature is on the Free plan, previews included. Connect your helpdesk and see Aide's drafts on your recent tickets in minutes.