Shipping rate tests
Test real checkout rates and free-shipping thresholds per group, with Crovio's carrier rates on your shipping zones.
A shipping rate test shows each group its own shipping rates at checkout. Use it to find the rate or free-shipping threshold that keeps conversion up without giving away margin: $5 against $8, free over $100 against free over $70, a cheaper express option, or tiers by order value or weight.
How it works
- You pick the shipping zones the test runs in. Crovio adds Crovio rates to those zones in Shopify. Before launch it doesn't show anything to shoppers, except in preview.
- You choose the Shopify rates to replace (or keep them all and add a rate next to them).
- When the test starts, each group sees the rates you set for it. Your Shopify rates are never changed: the ones you replace are only hidden at checkout, for shoppers whose group gets new rates. The original group sees today's checkout exactly, delivery dates included.
- Shoppers outside the test, carts Crovio can't place in a group, and any checkout where Crovio's rates don't load get your Shopify rates as usual, so nobody is ever left without shipping.
- When you pause or end the test, checkout goes straight back to your Shopify rates. There's nothing to restore. Ending also takes Crovio rates off your zones.
Only one shipping rate test can exist at a time. Free shipping and shipping discount tests can run next to it.
Set it up
- Click New test and pick Shipping rates.
- On Test groups, add your groups and split the traffic.
- On the Shipping tab, click Configure shipping rates:
- Select shipping zones: tick the zones in each shipping profile. If your products sit in several profiles, tick the matching zone in each one.
- Rates to replace: choose Replace existing rates and tick the rates to swap out, or Add a rate alongside them.
- Set rates per group: the original group starts on Current Shopify rates, so it matches today's checkout exactly in every zone. Variants start from the rates you're replacing: change what each one tests.
- Save. Crovio adds its rates to your zones. The setup checklist on the Shipping tab shows when every zone has them. If Shopify refused one, click Add Crovio rates again, or add it yourself in Settings > Shipping and delivery: open the profile, and in the zone choose Add rate > Use carrier or app to calculate rates > Crovio rates.
Rate types
| Type | What shoppers see |
|---|---|
| Current Shopify rates | The rates you're replacing, exactly as they are today in the shopper's zone (each zone keeps its own prices and conditions). Use it for the original group. Only in Replace existing rates. |
| Flat rate | Every rate, always (for example Standard and Express). |
| Flat rate with free threshold | Your rates below the threshold. At or above it, the first rate becomes free. |
| Free threshold only | A free rate at or above the threshold. Smaller carts keep the rates you're replacing, as they are today (or your other Shopify rates, when you add a rate alongside them). Use it to test a different threshold. |
| Tiered by price or weight | One rate per range of order value or weight. Add a free tier for the top range. |
Each rate has a delivery estimate in business days (Saturdays and Sundays don't count, like Shopify's own estimates), shown at checkout as a date range. If the original group keeps your Shopify rates, they show Shopify's delivery dates, so give the variant's rates delivery days too: the editor reminds you. Turn on Advanced settings on a group for rate codes (what fulfilment apps see).
Thresholds and price ranges use your store currency and the cart's product total before discount codes: Shopify doesn't send discounts to shipping apps. Shopify's own "free over" conditions use the total after discounts, so a shopper with a code reaches a Crovio threshold a little sooner than the same threshold in Shopify. Keep that in mind when you compare thresholds against the original group.
Each rate name should show once at checkout. If a group has a rate with the same name as a Shopify rate you aren't replacing (for example both have "Express"), shoppers in that group would see two. The editor flags it with one click to Replace Shopify's Express too, or you can rename your rate, or choose Show both if you mean it. The launch checklist checks it again.
Test rates only show in the zones you picked. If you add Crovio rates to another zone by hand in Shopify, Crovio returns no rates there.
Test rates are the same in every zone you pick. If your zones charge different rates today (for example $5 in the US and $15 in Canada), the original group still gets each zone's own rates, but variants don't: run the test on zones that share rates for a clean comparison.
Preview and check
- Preview your rates at checkout on the Shipping tab shows what each group gets for a sample cart total and weight, next to the Shopify rates that stay live.
- Open a group's preview link, add a product to the cart and go to checkout. Before launch your Shopify rates still show next to the test rates.
- QA & preview checks that carrier-calculated shipping is on, every zone has Crovio rates, the replaced rates still exist and every group has valid rates.
Before you launch
- Google Shopping: Google can't read rates from an app. If the Google & YouTube channel syncs shipping automatically, switch it to manual and set your highest test rate in Merchant Center before you start.
- Several ship-from locations: a carrier rate is charged once per location that fulfils the order, so split orders add up.
- Bundle apps: apps that rebuild cart lines drop the hidden tag that carries the visitor's group. Those carts get the original group's rates. "Buy it now" buttons on product pages carry the group too.
- Uninstalling Crovio: end the test first so the results are kept. Your Shopify rates are never changed, so checkout simply shows them again once Crovio is gone.
- Other carrier apps on the same zones keep showing their rates. Rates that come from another app can't be replaced.
- Markets-driven shipping: rate tests run on the zones of your shipping profiles. Don't switch your store to Markets-driven shipping while a test runs: Crovio's rates would stop showing and every group would get your Shopify rates.
- Site copy: change your announcement bar, shipping page or progress bar per group under Extra changes for each version on the Shipping tab. Themes can read the group's free-shipping threshold from
window.Crovio.shipping.threshold(and listen for thecrovio:shippingevent).
Results
Besides conversion, revenue and order value, the results of a shipping test add a Shipping card: the share of each group's orders with free shipping, what buyers paid for shipping per order (after shipping discounts), and the share of orders on each shipping method.
Ending the test
End the test from the test page. Checkout shows your Shopify rates to everyone again (they were never changed) and Crovio's rates leave your zones. Crovio can't roll out a winning rate for you: set it in Settings > Shipping and delivery when you end the test, and update any copy that names the old rates.
Was this page helpful?