Skip to content

A template, price, offer, shipping or checkout test isn't working

Fixes for the common setup problems in each A/B test type, from a missing template to test rates not showing at checkout.

On this page

Start with the basics: the test is Live, the app embed is on in your live theme, and the QA & preview checklist is all green. Then find your test type below. If visitors aren't counted at all, see My test shows no visitors.

Template test: the template isn't listed or a page isn't in the test

  • Templates come from your live theme and must be for the page type you picked under Where does this test run?. A template in a draft theme isn't listed.
  • Each variant needs its own alternate template. If it says "Same as the control", click Create in theme editor on the variant to make one from the control.
  • A page with its own template is never in the test. Crovio warns you when you add it under Narrow it down on the Templates tab: pick its template as the control, or remove the page.
  • "Not in your live theme anymore": the template was deleted or renamed, or another theme was published. Pick a template again. Shoppers are never shown an error page meanwhile.

Template tests

Split URL test: visitors aren't redirected

  • Type the page into Check a URL on Pages. If no group moves, the page doesn't match a redirect or the URL rule.
  • With Redirect only the first time, a visitor who has already been redirected can open the original page.
  • Search engine crawlers are never redirected, by design.

Split URL tests

Price test: a price doesn't change, or the cart shows the old price

  • Open the price checker on that page. A blue outline means Crovio can't tell which product the price belongs to: tag a price inside the product card. No outline means it isn't tagged yet: click Pick on page.
  • The cart shows the normal price for Control, for shoppers paying in another currency, and for a draft without copies. In a draft, click Make copies now under Hidden copies (on When the test ends) before you preview the cart.
  • A product discount code doesn't apply to the copies: add the products tagged crovio-price-test to the code.
  • "Hidden copies: failed": click Retry failed copies.

Price tests

Offer test: the discount doesn't apply

  • The discount appears in Shopify Discounts as "Crovio test: (test name)". If it was deleted, save the test again to recreate it. Don't edit it in Shopify.
  • Goals count the cart before discounts, and gift lines never count towards them.
  • Two discounts that can't combine: Shopify keeps the better one. Change Discount at checkout to let them combine.
  • Only one offer test runs at a time.

Offer tests

Shipping rates test: test rates don't show at checkout

  • Your plan. Test rates are served as a carrier-calculated rate. That's included on Advanced and Plus. On other plans, ask Shopify Support to turn on carrier-calculated shipping (a monthly fee, or free with yearly billing). The test can't launch without it.
  • Crovio rates on every zone. The setup checklist on the Shipping tab shows each zone. If one is missing, click Add Crovio rates, or add it yourself: Settings → Shipping and delivery, open the shipping profile, and in the zone choose Add rate → Use carrier or app to calculate rates → Crovio rates. Products in another shipping profile need the zone ticked in that profile too.
  • Before launch, your Shopify rates still show next to the test rates in preview. That's expected.
  • Bundle apps that rebuild cart lines drop the shopper's group: those carts get the original group's rates.

Shipping rate tests

Checkout test: a block doesn't show

  • Each Location ID must be placed once in Shopify's checkout editor: Add app block → Crovio block, type the ID, then Save. The Checkout tab shows In editor, then Placed once a real checkout loads it.
  • Blocks inside the information, shipping and payment steps need Shopify Plus. On other plans, use thank you page locations.
  • Turn on Include in Shop Pay in the block settings so express checkouts show it.
  • Payment and shipping method changes need Crovio A/B tests (payment methods) and (shipping methods) in Shopify. Don't delete them while a test runs; save the test to reinstall them.

Checkout tests

Still stuck?

Open Help in Crovio and ask in your own words, or click Ask Claude for a hand-off with your question and page filled in. You can also email hello@crovio.app.

Was this page helpful?