Plugin corrupts robots.txt and blocks crawlers
The plugin rewrites robots.txt with stray comments, and search engines then stop crawling or delist the site.
Tier II · Emerging Problems that are still building up.
3 public reports · first reported 14 November 2017 · last reported 2 December 2025
What's going wrong
Several site owners report that after enabling the minifier, their robots.txt file contained injected comment text that Google and PageSpeed Insights flag as invalid syntax.
AI-assisted: written with the help of AI from the reports. The idea report has the full summary.
In the idea report
- The full summary.
- The products the 3 reports are about, and how many came each month.
- Related problems.
No business has been found with this problem yet, so the report has no contacts. All sales are final — no refunds. Pricing.