browsertrix/backend/test_nightly
Tessa Walsh be41c48c27
Add extra and gifted execution minutes (#1361)
Fixes #1358 

- Adds `extraExecMinutes` and `giftedExecMinutes` org quotas, which are
not reset monthly but are updateable amounts that carry across months
- Adds `quotaUpdate` field to `Organization` to track when quotas were
updated with timestamp
- Adds `extraExecMinutesAvailable` and `giftedExecMinutesAvailable`
fields to `Organization` to help with tracking available time left
(includes tested migration to initialize these to 0)
- Modifies org backend to track time across multiple categories, using
monthlyExecSeconds, then giftedExecSeconds, then extraExecSeconds.
All time is also written into crawlExecSeconds, which is now the monthly
total and also contains any overage time above the quotas
- Updates Dashboard crawling meter to include all types of execution
time if `extraExecMinutes` and/or `giftedExecMinutes` are set above 0
- Updates Dashboard Usage History table to include all types of
execution time (only displaying columns that have data)
- Adds backend nightly test to check handling of quotas and execution
time
- Includes migration to add new fields and copy crawlExecSeconds to
monthlyExecSeconds for previous months

Co-authored-by: emma <hi@emma.cafe>
2023-12-07 14:34:37 -05:00
..
__init__.py
conftest.py Add API endpoint to retry all failed bg jobs (#1396) 2023-12-05 13:00:45 -08:00
test_concurrent_crawl_limit.py Enforce quota and hard cap for monthly execution minutes (#1284) 2023-10-26 15:38:51 -07:00
test_crawl_errors.py Add crawl errors endpoint (#757) 2023-04-17 12:59:25 -04:00
test_crawl_logs.py Add crawl /log API endpoint 2023-04-11 11:51:17 -04:00
test_crawl_timeout.py Replace partial_complete -> stopped_by_user or stopped_quota_reached + operator edge cases (#1368) 2023-11-14 11:17:16 -08:00
test_crawlconfig_crawl_stats.py
test_delete_crawls.py Background Jobs Work (#1321) 2023-11-02 13:02:17 -07:00
test_execution_minutes_quota.py Add extra and gifted execution minutes (#1361) 2023-12-07 14:34:37 -05:00
test_invite_expiration.py
test_max_crawl_size_limit.py Replace partial_complete -> stopped_by_user or stopped_quota_reached + operator edge cases (#1368) 2023-11-14 11:17:16 -08:00
test_upload_replicas.py Crawl Timeout via elapsed time (#1338) 2023-11-06 16:32:58 -08:00
test_z_background_jobs.py Add API endpoint to retry all failed bg jobs (#1396) 2023-12-05 13:00:45 -08:00
utils.py Background Jobs Work (#1321) 2023-11-02 13:02:17 -07:00