Larger and newer 1-bit models are not supported
Larger and newer 1.58-bit models, such as 70B and 405B variants and Bonsai, are not supported by the project.
Tier II · Emerging Problems that are still building up.
3 public reports · first reported 18 October 2024 · last reported 19 April 2025
What's going wrong
Users want the project to support bigger ternary models, including Llama-scale 70B and 405B variants, and newer small models such as Bonsai 0.5B that use channel-wise scaling the current kernels do not handle.
AI-assisted: written with the help of AI from the reports. The idea report has the full summary.
In the idea report
- The full summary.
- The products the 3 reports are about, and how many came each month.
- Related problems.
No business has been found with this problem yet, so the report has no contacts. All sales are final — no refunds. Pricing.