Shopify says continual training cut its GraphQL agent's serving cost 96%

Shopify says a daily continual-learning system enabled its specialized GraphQL agent to surpass its frontier-model baseline while reducing estimated serving costs by 96%. The production agent handles as many as 2,000 requests per minute, translating merchant questions into queries against Shopify's administrative interface. The system turns low-scoring, anonymized conversations into repaired training examples, then applies supervised fine-tuning and reinforcement learning. It also compresses a roughly 6,000-token system prompt to about 1,500 learned tokens. The performance and cost comparisons are Shopify's estimates based on its own evaluation system.