If you have been paying for a testing app every month just to split-test your homepage or your checkout, I have got news that might clear a line item off your bill. Shopify has built A/B testing straight into the admin, and for a lot of brands it is now good enough to do the job on its own.

It has been live since early June, and Shopify put it back in the spotlight with the Summer 26 Editions. So this is not a beta or a maybe. It is in your admin right now.

What actually shipped

You can now schedule changes, roll them out gradually, and split-test them, all from inside the Shopify admin. That covers themes, checkout, and customer-account configurations. No third-party app sitting on your theme, no extra script to load. In the same Editions drop, Checkout Components also hit general availability for Plus.

Here is the short version. The stuff most brands were paying an app to do, run a clean split test on a theme change or a checkout tweak, Shopify now does for you at no extra cost.

Why this matters more than it looks

For a long time, testing meant a paid app like Intelligems or Shoplift bolted onto your theme. Fair enough. If you wanted to know whether version A of your PDP beat version B, you needed a tool to serve the split and count the winner. That tool cost you a monthly fee, and it usually added another script to your storefront, which is one more thing slowing the page down.

For a brand doing $250K to $1M, that fee was often hard to justify. So a lot of you just did not test at all. You changed the homepage, eyeballed the numbers for a week, and hoped. Now the basic version of that job is free and native, and it is not dragging your site speed down with an extra script.

And look, here is the bigger pattern, and it is the one to actually pay attention to. Shopify keeps absorbing the app ecosystem into the core product. Reviews, bundles, subscriptions, now testing. Every Editions release, something that used to be a paid app becomes a native feature. If your tech stack is a pile of monthly subscriptions, some of those line items are quietly becoming free. It is worth a look every few months to see what you are still paying for that Shopify now does for you.

Who this is for

Two groups should care about this.

The first is brands who always wanted to test a homepage, a product page, or a checkout change but could never justify a dedicated testing app. That excuse is gone. The tool is sitting in your admin. You have no reason not to run your first real split test this month.

The second is brands already paying for a testing app. I am not telling you to cancel it today. I am telling you to open it up, look at what you actually use it for, and ask an honest question: is the native tool now enough for how you test? If all you ever run is theme and checkout splits, you might be paying for a full suite and using a fraction of it.

What it is not

Let me be straight, because this is where brands get it wrong. This is not a full CRO suite. You do not get the deep segmentation, the price testing, or the statistical depth that the specialist tools give you. If you are running serious price tests or bundle tests, or you need proper confidence intervals before you call a winner, keep your app. It is earning its fee.

The native tool is good enough for most. Not best for everyone. Know which one you are before you cancel anything.

What to do this week

Crawl. Open the admin and find the A/B testing option. Pick one change you have been meaning to make, a hero section, a headline, a checkout setting, and set up a single test. One variable. Let it run.

Walk. If you are already paying for a testing app, list out every test type you ran in the last three months. Mark which ones the native tool could have handled. That list tells you whether you are still getting your money's worth.

Run. Build a simple testing habit. One test live at all times, on the page that matters most to your conversion rate. The point was never the app. The point is that you are actually testing instead of guessing.

Because at the end of the day, the tool is not the thing that moves your numbers. The discipline is. A free testing feature you never open is worth exactly the same as an expensive one you never open. What matters is whether you are making changes based on what your customers actually do, or based on what you reckon they do. Only one of those shows up in your conversion rate.

We track what Shopify ships and what it means for brands at your stage, then we tell you what to actually do about it. Subscribe to our mailing list and get the tips, the updates, and the real numbers first, straight to your inbox, before they go anywhere else. No fluff, just what is working right now.