# Shopify builds repeatable storefront sandboxes for testing shopping agents

_Published Thursday, October 1, 2026 at 2:24 PM EDT · AI, Products · Latest · Tier 2 — Notable_

![Shopify builds repeatable storefront sandboxes for testing shopping agents — Primary](https://cdn.shopify.com/b/shopify-brochure2-assets/355a7cfb2ee03d45e38359d9e6f50441.png)

Shopify built ShopGym to convert live storefronts into resettable sandbox shops and generate shopping tasks, the company said. The framework lets developers reproduce failures and compare agents while avoiding changes in live products, prices, and store layouts.

Shopify evaluated 224 tasks across six sandbox shops, three using synthetic data and three using real data. Agent performance on synthetic shops positively correlated with performance on the live stores they mirrored. Alignment was clearest on multi-step tasks; some focused tasks showed larger gaps, so the sandboxes do not reproduce live-store difficulty exactly.

## Sources

- [Shopify Engineering](https://shopify.engineering/shopgym)

---
Canonical: https://techandbusiness.org/newswire/o8SknFOdoS98OJ19hMCm5y
Published: 2026-10-01T18:24:29.104Z
Story chronology: 2026-10-01T16:23:24.000Z
Retrieved: 2026-10-01T20:05:43.228Z
Publisher: Tech & Business (techandbusiness.org)