browsertrix/backend/test_nightly
Tessa Walsh d38abbca7f
Standardize handling of storage and execution time quotas (#1969)
Fixes #1968 

Changes:
- `stopped_quota_reached` and `skipped_quota_reached` migrated to new
values that indicate which quota was reached
- Before crawls are run, the operator checks if storage or exec mins
quotas are reached and if so fails the crawl with the appropriate state
of `skipped_storage_quota_reached` or `skipped_time_quota_reached`
- While crawls are running, the operator checks if the exec mins quota
is reached or if the size of all running crawls will mean the storage
quota is reached once uploaded; if so, the crawl is stopped gracefully
and given `stopped_storage_quota_needed` or `stopped_time_quota_reached`
state as appropriate
- Adds new nightly tests for enforcing storage quota
2024-07-25 12:49:11 -07:00
..
__init__.py
conftest.py Refactor Invites and Registration, Flatten Per-User Invites (#1902) 2024-07-02 15:13:27 -07:00
test_concurrent_crawl_limit.py
test_crawl_errors.py
test_crawl_logs.py
test_crawl_timeout.py Give test_crawl_timeout 10 mins to finish (#1627) 2024-03-26 18:33:30 -07:00
test_crawlconfig_crawl_stats.py
test_delete_crawls.py
test_execution_minutes_quota.py Standardize handling of storage and execution time quotas (#1969) 2024-07-25 12:49:11 -07:00
test_free_register.py Refactor Invites and Registration, Flatten Per-User Invites (#1902) 2024-07-02 15:13:27 -07:00
test_invite_expiration.py
test_max_crawl_size_limit.py
test_org_deletion.py Add nightly backend tests for org deletion while browsers are running (#1919) 2024-07-10 16:52:27 -07:00
test_storage_quota.py Standardize handling of storage and execution time quotas (#1969) 2024-07-25 12:49:11 -07:00
test_upload_replicas.py
test_z_background_jobs.py
utils.py