Skip to main content

Share story

Science

Preprint reports lower-compute method for LLM scaling laws

A preprint describes Power-Law Entropy Search, a multi-fidelity Bayesian-optimization method designed to estimate how optimal LLM-training hyperparameters change with model and data scale. The authors tested it on synthetic benchmarks, surrogates fitted to real LLM training data and LLM pre-training runs, reporting accurate estimates with less than one-tenth the compute budget of grid search and other baselines. The results have not been peer reviewed.
Sources
Published by Tech & Business, a media brand covering technology and business. This story was sourced from cs.AI updates on arXiv.org and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
Products Infrastructure
Products Infrastructure

JPMorgan deploys $230 billion in economic security financing

JPMorgan Chase deployed $230 billion of capital in the first year of its decade-long US economic security effort, Bloomberg reports. The financing includes equity and debt across areas including energy independence, defense and ae...

Capital AI
Capital AI

Town raises $108m at $1bn valuation for workplace AI assistants

Town announced a $108m Series B on Monday at a $1bn valuation, co-led by Forerunner Ventures and Menlo Ventures. Existing investors a16z and First Round Capital also participated. The startup connects individual AI assistants to ...

Capital AI
Capital AI

AI companion startup Tolan raises $30 million

Tolan has raised another $30 million from investors including Union Square Ventures, Khosla Ventures and Homebrew, TechCrunch reported, citing Upstarts Media. The round doubles the AI companion startup's total funding; its new val...

Capital
Capital

Prism Data raises $20 million for credit risk analytics

Prism Data raised $20 million in Series A funding led by Story Ventures, CEO Jason Rosen told Axios. The company provides credit-scoring data and analytics that use bank transaction data to help lenders assess borrowers' credit ri...

Infrastructure Products
Infrastructure Products

PLD Space begins system-level testing of Miura 5 orbital rocket

PLD Space says it has begun system-level testing of its Miura 5 orbital rocket, with a fully assembled second stage at its Teruel test site in Spain. The stage will undergo a practice countdown using real propellants, followed by ...

Infrastructure
Infrastructure

Li Auto announces 1.625bn yuan financing for chip subsidiary

Li Auto has announced agreements for 1.625bn yuan ($242.86m) in equity financing for Shanghai Mahe Xin Technology, its chip and domain controller business. Li Auto will provide 1bn yuan through a wholly owned subsidiary, while ext...