Tessa Walsh fb80a04f18 Add crawl /log API endpoint ... If a crawl is completed, the endpoint streams the logs from the log files in all of the created WACZ files, sorted by timestamp. The API endpoint supports filtering by log_level and context whether the crawl is still running or not. This is not yet proper streaming because the entire log file is read into memory before being streamed to the client. We will want to switch to proper streaming eventually, but are currently blocked by an aiobotocore bug - see: https://github.com/aio-libs/aiobotocore/issues/991?#issuecomment-1490737762		2023-04-11 11:51:17 -04:00
..
templates	backend: Fix for total crawl time limit. (#665)	2023-03-10 11:43:16 -08:00
__init__.py
base_job.py	Rename api / nginx settings -> backend / frontend, set pull policy job images (#504)	2023-01-18 20:21:36 -08:00
crawl_job.py	backend: make crawlconfigs mutable! (#656) (#662)	2023-03-07 20:36:50 -08:00
k8sapi.py	Reformat backend for black 23.1.0 (#548)	2023-02-01 20:01:09 -05:00
k8sman.py	Add crawl /log API endpoint	2023-04-11 11:51:17 -04:00
profile_job.py
utils.py