S3 file listing with sizes runs out of memory
Listing a bucket with hundreds of millions of S3 objects, with sizes, runs out of memory even with large container limits.
Tier II · Emerging Problems that are still building up.
5 public reports · first reported 4 September 2026 · last reported 5 September 2026
What's going wrong
A team moving hundreds of millions of objects from one object store to another needs a full listing with file sizes to split the work into balanced chunks.
AI-assisted: written with the help of AI from the reports. The idea report has the full summary.
In the idea report
- The full summary.
- The products the 5 reports are about, and how many came each month.
- Related problems.
No business has been found with this problem yet, so the report has no contacts. All sales are final — no refunds. Pricing.