Skip to content

QA and preview

Preview each group on your real store or your phone (QR codes), on any theme, run automated screenshots, pin comments and work through the launch checklist.

On this page

The QA & preview tab is where you check a test before launch.

Launch checklist

The checklist at the top of QA & preview checks the test before shoppers see it. The count next to it says where you stand: Ready to launch, Ready · 2 heads-up, 1 to check or 2 to fix before launch. Rows that need you carry a tag:

TagWhat it means
(green tick, no tag)Passed.
Heads upPassed, but worth knowing (for example, copies of a price test's products still count in automatic collections).
RecommendedWorth fixing, but it doesn't stop you launching.
Blocks launchLaunch test stays off until it's fixed. Crovio refuses the launch too, so nothing half-set-up reaches shoppers.

Most rows have a button that takes you straight to the fix.

Every test

RowIf it fails
Crovio theme embed is on in your live themeClick Turn on. Recommended: launch still works, but visitors won't see the variants until it's on.
Tracking pixel is connected (visitors and orders are counted)Click Connect tracking. Recommended: nothing is counted until it's connected.
At least one variant is different from controlClick Open and the test's own tab (for example Open Prices) and make a change. Blocks launch.
Traffic is split between control and variantsClick Edit split and give control and at least one variant some traffic on Test groups. Blocks launch.
No other live test on the same pagesClick Show each shopper only one, or pause the other test. Blocks launch, because both tests would show changes to the same visitors.

Per test type

The test type adds its own rows. The ones you're most likely to meet:

Test typeRowWhat to do
PriceA product isn't for sale on your Online StoreMake it active and add it to the Online Store sales channel, or remove it from the test. Blocks launch.
PriceNo price tags for your live theme yetHeads up: Crovio uses common theme selectors. Tag your prices once so every price on the page changes.
OfferYour Crovio offers may compete with this testRecommended: your live Crovio discounts and bundles don't stack with the test's discount: Shopify can drop them for the whole cart (a free gift is then charged), so groups may pay the same. Open discount or Open bundle and pause it while the test runs.
Offer"(discount name)" competes with this offerRecommended: another automatic discount in Shopify can't combine with the test's. Change Combines with, or pause it in Shopify.
Shipping ratesNo rate shows twice at checkoutA group's rate has the same name as a Shopify rate you aren't replacing, so shoppers would see both. Replace Shopify's rate too, or rename yours. Blocks launch.
Shipping ratesCrovio rates added to every zoneClick Add Crovio rates, or add them to the zone in Shopify. Blocks launch.
TemplateMissing from your live themeA group's template isn't in your live theme, so Shopify would show the default one. Pick a template that exists. Blocks launch.
TemplateA variant has no template, or uses the control'sClick Choose templates and pick a different template for each variant. Blocks launch.
CheckoutPlace location "crovio-1" in Shopify's checkout editorAdd the Crovio block in the checkout editor with that Location ID and save. Recommended.
ThemeCrovio's app embed is off in a test themeSwitch it on in that theme's App embeds. Blocks launch.

Launching

Click Launch test. The dialog sums up what goes live (who joins and where, what each group sees, what decides the winner and roughly how long a result takes) and asks you to confirm you previewed each group. If anything still blocks launch, the dialog lists each blocker with its fix and Launch test stays off. A missing embed or tracking pixel is a warning in the dialog, not a blocker.

Preview each group

Each group has a tile with a QR code. Click Preview to open your store showing that group, even while the test is a draft. Copy link to send it to a colleague: the link forces that group for whoever opens it. Preview visits are never counted. A small Crovio preview badge sits at the bottom left; click Exit to go back to normal.

On your phone

Point your phone's camera at a group's QR code and open the link: your store opens on the phone showing that group. It's the quickest way to check a variant on a real device.

On another theme

If your store has more than one theme, a Theme menu sits above the tiles. Pick an unpublished theme and every preview link (and QR code) opens that group on it, for example to check a test still works on the theme you're about to publish. Theme tests don't have this menu: each group already has its own theme.

Screenshots and checks

Crovio opens every group in a real browser on desktop and phone, takes full-page screenshots and checks for problems. Click Run QA again after changes. When everything's fine you'll see All checks passed.

Click anywhere on a screenshot to pin a comment, for example "Make this line smaller and move it under the price". Comments are Open, Fixed by AI or Resolved. Click Fix comments with AI under a group to hand your open comments to Claude: it updates the variant through the Crovio connector and re-runs QA.

Was this page helpful?