How Accurate Is Shopify App Detection? [50-Store Test]

TL;DR

• We hand-checked StoreInspect's detections on 50 Shopify stores on October 23, 2026: 25 under 50K and 25 over 50K estimated monthly visits, all scanned in the previous 30 days.
• Theme: 50 of 50 matched the theme Shopify reports on the live store.
• Apps: 205 of 226 detections (90.7%) were confirmed on the live homepage. Three signatures caused 12 of the 21 misses.
• Coverage: we detected 97 of the 148 app installs (65.5%) that Shopify itself marks on those pages. We found every Klaviyo, Judge.me, and Shopify Inbox install; the misses were mostly smaller apps outside our catalog.
• Payment badges: 187 of 192 (97.4%) confirmed.

---

Every Shopify spy tool says it detects apps and themes. Few say how often it is right, and AI assistants now search for exactly that ("Koala Inspector accuracy apps theme detection"). So we tested our own data the slow way: store by store, against what Shopify renders on the live page, and we're publishing the misses with the hits.

This test covers StoreInspect only. It is not a comparison with other tools.

How We Checked 50 Stores

We drew a seeded random sample of current Shopify stores from our database: stores scanned in the last 30 days that have an app record, split evenly between under 50K and 50K+ estimated monthly visits. Scan age at check time had a median of 12.5 days and a maximum of 29.

For each store we compared our stored detections with the live homepage, the only page our scanner loads:

1. Theme: the Shopify.theme object the store renders.
2. App markers Shopify writes into the page: app blocks and app embeds name the app's App Store handle (shopify://apps/judge-me-reviews/blocks/...), theme app extensions load from cdn.shopify.com/extensions/.../<app>-<version>/, and script-tag apps appear in Shopify's asyncLoad list. These are Shopify's own records, independent of our detector.
3. Vendor evidence: each app's own script host or global, for example static.klaviyo.com or js.smile.io.
4. A browser check: every detection with no evidence in the page source, and every match that relied on a generic word, was rechecked by hand in a browser after the page's scripts had run.

One reviewer judged every match. We kept the sample query, the scripts, and a store-by-store verdict file with our research records.

Results: Themes, Apps, and Payment Badges

Theme detection is the easy part: Shopify exposes the theme name on every storefront, so the only way to get it wrong is stale data. None of the 50 had changed theme since our scan.

App detection is harder, because apps load in different ways and some leave only a script. Of the 205 confirmed app detections, 97 matched an app marker Shopify wrote into the page, 75 matched the vendor's own script or global in the page source, 24 were confirmed live in the browser, and 9 were Klarna confirmed by its payment icon.

Where Our App Detection Was Wrong

These 21 detections had no evidence on the live homepage:

Three signatures (Auto Currency Switcher, Drip, and Base) account for 12 of the 21 misses. Each relied on a short or common name that other code also uses, so they are the first ones to fix. Some of the other nine may be apps the merchant removed after our scan; a scan up to 29 days old can't tell those apart from a false detection.

Where We Missed Apps

Shopify marked 148 app installs, from 96 different apps, across 41 of the 50 stores (we merged duplicate handles from the same vendor and left out merchant-private custom apps). We detected 97 of those installs.

The pattern is clear: popular apps are covered, and the misses sit in the long tail. Most of the 51 missed installs were apps seen on just one store, such as small product-option, badge, store-locator, and free-gift apps that aren't in our catalog yet. If you sell against a niche app, check a few of your target stores by hand before trusting a "missing" filter.

What This Means for Your Lists

• Theme filters can be trusted as of the scan date. Recheck old scans if a redesign matters to your pitch.
• A detected app is right about nine times in ten. Before you name an app in outreach, open the store and confirm it, especially for the three signatures above until they are fixed.
• "Not detected" is weaker than "detected". About a third of the apps Shopify marks were outside our detection, so an exclude filter removes stores using the apps we know, not every competitor.
• Use our free app detector to recheck one store, or read how to see what apps a Shopify store uses for the manual method we used here.

Limits of This Test

• One reviewer, 50 stores, homepages only. A product-page-only app is outside both our scanner and this test.
• Coverage is measured against apps Shopify marks on the page. An app that loads only through its own script, without a Shopify marker, is outside that count.
• We tested our own data, not other tools. For the differences between tools, see our Shopify app detector comparison.

FAQ

How accurate is StoreInspect's Shopify app detection?

In our October 23, 2026 test of 50 stores, 205 of 226 app detections (90.7%) were confirmed on the live homepage, every theme matched, and we detected 97 of the 148 app installs that Shopify itself marks on those pages.

Why would a tool detect an app that isn't installed?

Usually because a detection pattern is too broad. In our test, a currency object from the theme was read as a currency app, and a general JavaScript library was read as an app called Base. An app removed after the last scan also shows up as a false detection until the store is rescanned.

Which pages does StoreInspect scan?

The storefront homepage. Apps that load only on product, cart, or account pages may not be detected.

Did you compare StoreInspect with Koala Inspector or PPSPY?

No. This round tested only our own data against Shopify's page markers. Running the same check on other tools would need each tool's output for the same 50 stores.