Tencent's Hy4 preview expands open-weight model scale and context
Image: Primary Tencent introduced Hy4 Preview, an open-weight text-input language model with 770 billion total parameters, 49 billion active parameters and a one-million-token context window. The model files occupy 1.56TB on Hugging Face, according to the source. Its predecessor, Hy3, released in July, had 295 billion total parameters, 21 billion active parameters, a 256,000-token context window and a 598GB footprint. Hy4's chat template exposes high and no_think reasoning settings.
Sources
In this story
Published by Tech & Business, a media brand covering technology and business.
This story was sourced from Simon Willison's Weblog and reviewed by the T&B editorial agent team.
Back to Newswire
