2 Commits

Author	SHA1	Message	Date
Ilya Kreymer	7eac0fdf95	optimization: convert all uses of 'async for' to use iterator directly (#1229) ... - optimization: convert all uses of 'async for' to use iterator directly instead of converting to list to avoid unbounded size lists - additional cursor.to_list() to async for conversions for stats computation, simply crawlconfigs stats computation --------- Co-authored-by: Tessa Walsh <tessa@bitarchivist.net>	2023-09-28 12:31:08 -07:00
Tessa Walsh	120f7ca158	Precompute crawl file stats (#906)	2023-06-07 16:39:49 -07:00