New LLMs need manual FastChat support
New open LLM releases need hand-written templates and code changes before FastChat can serve them.
Tier I · Proven The best-established problems.
6 public reports · first reported 6 September 2023 · last reported 11 February 2025
What's going wrong
FastChat users report that each newly released open language model needs hand-written conversation templates and code changes before it can be served.
AI-assisted: written with the help of AI from the reports. The idea report has the full summary.
In the idea report
- The full summary.
- The products the 6 reports are about, and how many came each month.
- Related problems.
No business has been found with this problem yet, so the report has no contacts. All sales are final — no refunds. Pricing.