QA and preview
Preview each group on your real store or your phone (QR codes), on any theme, run automated screenshots, pin comments and work through the launch checklist.
On this page
The QA & preview tab is where you check a test before launch.
Launch checklist
The checklist at the top of QA & preview checks the test before shoppers see it. The count next to it says where you stand: Ready to launch, Ready · 2 heads-up, 1 to check or 2 to fix before launch. Rows that need you carry a tag:
| Tag | What it means |
|---|---|
| (green tick, no tag) | Passed. |
| Heads up | Passed, but worth knowing (for example, copies of a price test's products still count in automatic collections). |
| Recommended | Worth fixing, but it doesn't stop you launching. |
| Blocks launch | Launch test stays off until it's fixed. Crovio refuses the launch too, so nothing half-set-up reaches shoppers. |
Most rows have a button that takes you straight to the fix.
Every test
| Row | If it fails |
|---|---|
| Crovio theme embed is on in your live theme | Click Turn on. Recommended: launch still works, but visitors won't see the variants until it's on. |
| Tracking pixel is connected (visitors and orders are counted) | Click Connect tracking. Recommended: nothing is counted until it's connected. |
| At least one variant is different from control | Click Open and the test's own tab (for example Open Prices) and make a change. Blocks launch. |
| Traffic is split between control and variants | Click Edit split and give control and at least one variant some traffic on Test groups. Blocks launch. |
| No other live test on the same pages | Click Show each shopper only one, or pause the other test. Blocks launch, because both tests would show changes to the same visitors. |
Per test type
The test type adds its own rows. The ones you're most likely to meet:
| Test type | Row | What to do |
|---|---|---|
| Price | A product isn't for sale on your Online Store | Make it active and add it to the Online Store sales channel, or remove it from the test. Blocks launch. |
| Price | No price tags for your live theme yet | Heads up: Crovio uses common theme selectors. Tag your prices once so every price on the page changes. |
| Offer | Your Crovio offers may compete with this test | Recommended: your live Crovio discounts and bundles don't stack with the test's discount: Shopify can drop them for the whole cart (a free gift is then charged), so groups may pay the same. Open discount or Open bundle and pause it while the test runs. |
| Offer | "(discount name)" competes with this offer | Recommended: another automatic discount in Shopify can't combine with the test's. Change Combines with, or pause it in Shopify. |
| Shipping rates | No rate shows twice at checkout | A group's rate has the same name as a Shopify rate you aren't replacing, so shoppers would see both. Replace Shopify's rate too, or rename yours. Blocks launch. |
| Shipping rates | Crovio rates added to every zone | Click Add Crovio rates, or add them to the zone in Shopify. Blocks launch. |
| Template | Missing from your live theme | A group's template isn't in your live theme, so Shopify would show the default one. Pick a template that exists. Blocks launch. |
| Template | A variant has no template, or uses the control's | Click Choose templates and pick a different template for each variant. Blocks launch. |
| Checkout | Place location "crovio-1" in Shopify's checkout editor | Add the Crovio block in the checkout editor with that Location ID and save. Recommended. |
| Theme | Crovio's app embed is off in a test theme | Switch it on in that theme's App embeds. Blocks launch. |
Launching
Click Launch test. The dialog sums up what goes live (who joins and where, what each group sees, what decides the winner and roughly how long a result takes) and asks you to confirm you previewed each group. If anything still blocks launch, the dialog lists each blocker with its fix and Launch test stays off. A missing embed or tracking pixel is a warning in the dialog, not a blocker.
Preview each group
Each group has a tile with a QR code. Click Preview to open your store showing that group, even while the test is a draft. Copy link to send it to a colleague: the link forces that group for whoever opens it. Preview visits are never counted. A small Crovio preview badge sits at the bottom left; click Exit to go back to normal.
On your phone
Point your phone's camera at a group's QR code and open the link: your store opens on the phone showing that group. It's the quickest way to check a variant on a real device.
On another theme
If your store has more than one theme, a Theme menu sits above the tiles. Pick an unpublished theme and every preview link (and QR code) opens that group on it, for example to check a test still works on the theme you're about to publish. Theme tests don't have this menu: each group already has its own theme.
Screenshots and checks
Crovio opens every group in a real browser on desktop and phone, takes full-page screenshots and checks for problems. Click Run QA again after changes. When everything's fine you'll see All checks passed.
Click anywhere on a screenshot to pin a comment, for example "Make this line smaller and move it under the price". Comments are Open, Fixed by AI or Resolved. Click Fix comments with AI under a group to hand your open comments to Claude: it updates the variant through the Crovio connector and re-runs QA.
Was this page helpful?