Skip to content

A/B test a widget

Compare a widget with no widget in one click, or turn widgets on for chosen groups of any A/B test.

On this page

Countdowns, popups and badges feel like they should help, but sometimes they don't. Test a widget before you keep it.

One click: widget on vs off

  1. Open the widget's menu (in the editor or on its row in Widgets) and click Start A/B test.
  2. The widget's status changes to Only in A/B tests: it's hidden from your store except for test groups that turn it on.
  3. Crovio creates a draft test called "widget name — on vs off" and opens it:
    • Control: your store without the widget.
    • Widget on: the same pages with the widget.
    • 50/50 traffic, on the widget's pages, URL rules, devices and visitors.
  4. Check the goal and launch. Revenue per visitor is a good default for most widgets.

The widget editor links to the test while it's open ("Turned on by this A/B test").

When the test is called

  • The widget won: set its status to Live and end the test. Everyone now sees it.
  • It didn't: end the test and set the widget to Paused or leave it as it is. With no open test, an Only in A/B tests widget is hidden.

Widgets in any A/B test

You can also turn widgets on for chosen groups of any content, template or split URL test:

  1. Set the widgets to Only in A/B tests in Widgets.
  2. In the test's Test groups, select a group and pick the widgets under Widgets shown to this group. Groups without them don't see them.

This lets you test, for example, a countdown against a delivery estimate, or a new product page design with and without a sticky add to cart.

Was this page helpful?