Skip to content

Theme tests

Show each group a different theme across your whole store, for a redesign or a new theme. Same address, no Shopify preview bar.

On this page

A theme test shows each group a different theme. Your live theme is the control, and each variant group gets one of your store's unpublished themes. Use it for a redesign, a new theme or changes across many page types at once.

Variant shoppers browse the whole store on their theme. The address stays the same and Shopify's preview bar is hidden, so they can't tell they're in a test. Checkout looks the same for every group: themes don't change checkout.

Set it up

  1. In Shopify, add the theme you want to test under Online Store > Themes (Add theme, or Duplicate your live theme and change the copy). Leave it unpublished.
  2. In Crovio, go to A/B tests, click New test and pick Theme.
  3. On Themes, control shows your live theme. Pick an unpublished theme for each variant group. Each group shows a live preview of the home page on its theme: switch between Desktop and Phone, or click Customize to open that theme in the theme editor.
  4. Check that each tested theme shows Crovio is on. If it says Crovio is off, click Turn on Crovio, save in the theme editor and come back: the list refreshes on its own (or click Check again). Visitors on a theme without Crovio aren't counted.
  5. Set Goals, preview each group from QA & preview and launch. The launch checklist confirms Crovio is on in every test theme.

Before you launch

The Before you launch card on Themes lists what has to match, because a theme test changes everything a visitor sees:

  • Crovio is on in every test theme. Checked automatically on Themes and at launch.
  • Apps that add things to your pages (reviews, upsells, chat) are switched on in each test theme too. Otherwise variant shoppers don't see them and the test compares more than the theme.
  • Templates have the same names in both themes, so products, collections and pages with their own template look right on the test theme.
  • Price, offer and shipping tests keep working on any theme with Crovio on, so they can run at the same time.

While it's live

  • Keep your test themes for 60 days after the test ends. Don't delete or rename them while the test runs. Visitors who saw a test theme are sent back to your live theme on their next visit, which needs the theme to still exist.
  • Edits you make to a test theme show to its group right away, so treat it like a live theme.
  • Search engine crawlers always see your live theme.
  • Variant visitors are sent to their theme before the page shows, so they never see the live theme first.

When it ends

To keep the winning theme, publish it in Online Store > Themes. Crovio doesn't publish themes for you. Keeping your current theme? End the test and nothing changes.

Troubleshooting

What you seeWhat to do
"Your store has no unpublished theme yet"Add one in Online Store > Themes (Add theme, or Duplicate on your live theme), then come back.
Crovio is off under a themeClick Turn on Crovio, switch on the Crovio app embed in that theme's editor and save.
"This theme isn't in your store anymore."The theme was deleted. Pick another one, or restore it from Online Store > Themes.
"Another group already uses this theme."Each variant needs its own theme.

Was this page helpful?