Vercel says decision models handle 26% of AI Gateway requests

Decision models accounted for 26% of AI Gateway requests in October but just 0.53% of total spend, Vercel reported in its November Production Index. These models classify, score or choose between options rather than generate text; Vercel says they cost about a seventieth as much per request as language models. Nearly a third of paid teams used a decision model, rising to seven in ten among teams processing over 10 billion tokens monthly. Almost all decision-model request volume went to TypeSafe AI's Jev. The figures cover traffic routed through Vercel's gateway, and spending is estimated at published list prices rather than actual bills.