Kurate preprint demonstrates evidence-quality scoring across 4,347 papers

Researchers report in an arXiv preprint that Kurate, a system using large language models, assessed study quality across 4,347 papers, including 3,913 reporting randomized trials. It scores eight dimensions of study design and reporting, drawing on papers and related documents such as trial registrations and protocols, and links judgments to supporting passages. Against expert annotations of 60 held-out clinical-trial documents, extracted information matched expert labels in 221/242 protocol scorepoints and 294/370 results-publication scorepoints. Across the larger corpus, issues appeared most often in statistical power, selective reporting and analysis prespecification. Average quality differed between clinical areas.