# AWS introduces open-source system to compare agents across frameworks

_Published Wednesday, November 11, 2026 at 11:05 AM EST · AI · Latest · Tier 2 — Notable_

![AWS introduces open-source system to compare agents across frameworks — Primary](https://d2908q01vomqb2.cloudfront.net/f1f836cb4ea6efb2a0b1b99f41ad8b103eff4b59/2026/11/04/ML-21994-featured-image.png)

AWS introduced the Universal Agent Evaluation Framework, an open-source system that lets developers compare AI agents built with different frameworks using consistent metrics. AWS says customers across 12 organizations in telecom, healthcare and financial services used it to compare agent versions before release.

The system converts records of agent messages, tool calls and handoffs into a common format, then scores them using 36 built-in metrics across 7 dimensions. Available under the Apache 2.0 license, it runs through a Python library or a deployable AWS service with a web interface. Some metrics use model judges; AWS cautions that their scores should not gate security controls.

## Sources

- [Artificial Intelligence](https://aws.amazon.com/blogs/machine-learning/uaef-a-framework-agnostic-system-for-closed-loop-evaluation-of-ai-agents/)

---
Canonical: https://techandbusiness.org/newswire/LbS8WN8gwrX7T28SZ10prR
Published: 2026-11-11T16:05:42.215Z
Story chronology: 2026-11-11T15:50:55.000Z
Retrieved: 2026-11-12T01:02:38.793Z
Publisher: Tech & Business (techandbusiness.org)