browsertrix/backend
Ilya Kreymer dce1ae6129
better resources scaling by number of browsers per crawler container (#1103)
- set crawler cpu / memory with fixed base + incremental bumps based on number of browsers
- allow parsing k8s quantities with parse_quantity, compute in operator
- set 'crawler_cpu = crawler_cpu_base + crawler_extra_cpu_per_browser * (num_browsers - 1)'
and same for memory
2023-09-06 01:42:44 -04:00
..
btrixcloud better resources scaling by number of browsers per crawler container (#1103) 2023-09-06 01:42:44 -04:00
test Add event webhook notifications system to backend (#1061) 2023-08-31 19:52:37 -07:00
test_nightly Add max crawl size option to backend and frontend (#1045) 2023-08-26 22:00:37 -07:00
.pylintrc quickfix: pydantic / lint fix (#452) 2023-01-10 18:54:11 -08:00
Dockerfile
requirements.txt better resources scaling by number of browsers per crawler container (#1103) 2023-09-06 01:42:44 -04:00