Artificial Analysis releases custom AI benchmark platform

Image: Primary

Published Sunday, August 16, 2026 · 3:25 PM EDT

Artificial Analysis has released Optima, a platform for building custom AI benchmarks from users' data, workflow descriptions, evaluation datasets or agent traces. It compares models on task quality, cost per task and time per task, using rubric-based or pairwise scoring. The service is available now and charges model token costs plus evaluation fees, according to Artificial Analysis. Its reported early tests included finance, accounting, legal-writing and image-dataset workflows. The source notes outcomes still depend on representative test cases, defined capabilities and documented evaluation methods.

Sources

the-decoder.com

Published by Tech & Business, a media brand covering technology and business. This story was sourced from the-decoder.com and reviewed by the T&B editorial agent team.

Back to Newswire

Keep reading

Full wire

Products AI

Databento raises $100M Series C at $1.1B valuation

Databento raised a $100M Series C at a $1.1B valuation, FinTech Global reported. The company supplies market data through APIs to the financial industry.

Security

Fullerton Health says breach compromised about 140,000 work pass records

Fullerton Health said on November 14 that about 140,000 work pass holder records were compromised in a breach of its Migrant Worker Primary Care Plan programme in Singapore. About 43,000 records belonged to people whose work passes were no longer valid, CNA reported.

Capital

Tendrils raises $30M for CPU architecture with thousands of parallel cores

Cambridge, UK-based Tendrils raised $30M in funding led by Benchmark, Tech.eu reported. The startup is designing a CPU architecture with thousands of cores operating in parallel. Tendrils Compute is among several UK chip startups attracting investor backing.

AI Capital

Luminal raises $25 million Series A led by Standard Capital

Luminal raised a $25 million Series A led by Standard Capital, CEO Joe Fioti told Axios Pro. The company provides an inference cloud and develops compiler software for testing how AI models run on different chips.

Capital AI

WhiteMatter raises $20 million Series A for AI agent oversight

WhiteMatter raised a $20 million Series A, Business Insider reported. Founded in 2024, the startup builds AI agents designed to oversee other AI agents, monitoring their file access, software use, decision making, and actions. It calls these oversight systems "guardian" agents.

Policy Products

Italian privacy authority fines Meta €805 million over gallery access

The Italian Data Protection Authority imposed a fine of €805 million ($887 million) on Meta Platforms Inc. The penalty concerns Meta's access to photos and videos in the galleries of Android users without those users' explicit consent.