Optimizer runs stop on provider rate limits
Multi-threaded DSPy runs and optimizers hit provider rate limits and stop, with no built-in throttling or fallback.
Tier II · Emerging Problems that are still building up.
3 public reports · first reported 1 October 2024 · last reported 23 March 2025
What's going wrong
Users running optimizers or evaluations with several threads report that provider request limits stop the whole run.
AI-assisted: written with the help of AI from the reports. The idea report has the full summary.
In the idea report
- The full summary.
- The products the 3 reports are about, and how many came each month.
- Related problems.
No business has been found with this problem yet, so the report has no contacts. All sales are final — no refunds. Pricing.