Feature Request: Please add Ring-1T support

[Alexey-Akishin]

Prerequisites

• I am running the latest code. Mention the version if possible as well.
• I carefully followed the README.md.
• I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
• I reviewed the Discussions, and have a new and useful enhancement to share.

Feature Description

Recently Ring-1T was released: https://huggingface.co/inclusionAI/Ring-1T-preview - it has one trillion parameters model with 50B active ones, which is more than in Kimi K2 or DeepSeek, and also it supports reasoning.

Motivation

I think it could be a cool alternative to Kimi K2 (also 1T) model, and it also has MIT License according to its model card. From its description in the model card, it sounds like more releases are coming. But it is offered in BF16 format, which is very big download. On huggingface there is also 3-bit MLX quant exists, but no GGUFs, hence I am assuming it is not supported just yet.

Possible Implementation

No response

[Lissanro]

There is PR for llama.cpp for it: ggml-org/llama.cpp#16063 - based on the most recent comments, sounds like it is very close to being accepted. Unfortunately, the patch does not apply to ik_llama.cpp due to some files being different or even not existing at all. I am not sure how much work would it take to convert it to a patch for ik_llama.cpp.

By the way, two more models were released since the Ring-1T-Preview, so in total there are three already:

https://huggingface.co/inclusionAI/Ring-1T-preview (the initial preview)
https://huggingface.co/inclusionAI/Ling-1T (no thinking)
https://huggingface.co/inclusionAI/Ring-1T (thinking)

[ikawrakow]

Is there a small model that I can use for testing? 1T is way beyond my hardware capabilities.

[kirnat]

They have a llama.cpp fork and GGUF of Ling-mini-2.0
https://huggingface.co/inclusionAI/Ling-mini-2.0-GGUF

[ikawrakow]

See #833

[kirnat]

ikawrakow is like the AI agent that actually works

[ikawrakow]

Haha, you are not the first one to suspect an AI (or even AGI) behind the ikawrakow account 😄