Skip to content

A/B testing

Build tests, target the right visitors and read results with confidence.

  1. Create your first A/B testSet up, preview and launch a test in Crovio, from a blank test or an idea.5 min read
  2. Test typesContent, code, template, theme, split URL, price, offer, shipping and checkout tests, and when to use each one.6 min read
  3. Checkout testsTest checkout blocks, upsells, timers and payment or shipping methods per test group, and place them with Location IDs.4 min read
  4. Offer testsTest volume discounts, spend thresholds, product discounts, free gifts and buy X get Y offers, with each group's offer applied at checkout.6 min read
  5. Price testsTest real prices on chosen products. Shoppers in each group see and pay that group's price, from product page to checkout.7 min read
  6. Split URL testsSend each group to a different page, for example two landing pages or an old and a new product page, with UTM tags kept and crawlers never redirected.2 min read
  7. Template testsShow each group a different theme template on the same pages, for example a new product page layout against your current one. Same page, no preview bar.4 min read
  8. Theme testsShow each group a different theme across your whole store, for a redesign or a new theme. Same address, no Shopify preview bar.3 min read
  9. Use the visual editorChange text, images, styles and layout on your live store for one test group, without code.2 min read
  10. Code and the AI builderWrite a variant in CSS and JavaScript, or let Claude write it from a description.1 min read
  11. Targeting and audiencesChoose where a test runs, when visitors count, who sees it (devices, traffic, cart and product conditions), traffic share and IP rules, and keep overlapping tests apart.9 min read
  12. GoalsChoose the primary goal that decides the winner, the key metrics shown first in results, which orders count, and custom metrics like clicks, page visits and scrolling.7 min read
  13. QA and previewPreview each group on your real store or your phone (QR codes), on any theme, run automated screenshots, pin comments and work through the launch checklist.5 min read
  14. Reading resultsWhat every number on Results means: key metrics for any two groups, monthly estimates, chance to be best, rolling out a group, Claude summaries and charts.7 min read
  15. Segments and filtersRecalculate a test's results for one audience, like mobile visitors from paid social, and save filters for later.1 min read
  16. Date and time filterLook at a test's results for a period or a time of day, in your store's time zone.1 min read
  17. How Crovio decides a winnerThe three stages every test goes through before Crovio calls it, and the rules you can adjust.3 min read
  18. Pause, roll out, end and other test actionsWhat each action in a test's menu does, from pausing and rolling out a winner to archiving, deleting and resetting data.3 min read
  19. Custom events with Crovio.trackSend your own events to Crovio from your theme or another app, then use them as goals and results filters.1 min read
  20. Find test ideasUse the store scan, the pattern library, Ideas and Learnings to decide what to test next.1 min read
  21. Shipping rate testsTest real checkout rates and free-shipping thresholds per group, with Crovio's carrier rates on your shipping zones.6 min read