# Atlassian says smaller moderation model cuts latency and increases throughput

_Published Wednesday, November 4, 2026 at 3:03 PM EST · AI · Latest · Tier 2 — Notable_

![Atlassian says smaller moderation model cuts latency and increases throughput — Primary](https://atlassianblog.wpengine.com/wp-content/uploads/2026/11/ambient-pattern_itsm_repeat_shade_neutral-3x_w4xg5vbhpphk6rrb7w8p7w-scaled.png)

Atlassian says it has deployed a fine-tuned 4B model ahead of its larger content moderation model, reducing end-to-end latency from 740ms to 350ms and increasing throughput by 42%. The system checks requests flowing through products including Rovo Chat and Rovo Search.

Built with NVIDIA, the smaller model handles most requests while the larger model examines suspicious cases. Training used synthetic policy examples, adversarial variations and reasoning traces, allowing the smaller model to classify requests without generating reasoning at inference.

Atlassian reports system precision rose from 94.0% to 98.1%, while recall rose from 50.9% to 56.6%. The smaller model's standalone recall of 75.5% is a separate evaluation result.

## Sources

- [Inside Atlassian](https://www.atlassian.com/blog/how-we-build/teaching-a-4b-model-to-think-like-a-policy-expert)

---
Canonical: https://techandbusiness.org/newswire/yIga0a-ODZ2oBpYH4ZyV_t
Published: 2026-11-04T20:03:04.270Z
Story chronology: 2026-11-04T16:55:00.000Z
Retrieved: 2026-11-04T22:59:32.921Z
Publisher: Tech & Business (techandbusiness.org)