browsertrix/backend/test
Tessa Walsh 094f27bcff
Track bytes stored per file type and include in org metrics (#1207)
* Add bytes stored per type to org and metrics

The org now tracks bytesStored by type of crawl, uploads, and browser profiles
in addition to the total, and returns these values in the org metrics endpoint.

A migration is added to precompute these values in existing deployments.

In addition, all /metrics storage values are now returned solely as bytes, as
the GB form wasn't being used in the frontend and is unnecessary.

* Improve deletion of multiple archived item types via `/all-crawls` delete endpoint

- Update `/all-crawls` delete test to check that org and workflow size values
are correct following deletion.
- Fix bug where it was always assumed only one crawl was deleted per cid
and size was not tracked per cid
- Add type check within delete_crawls
2023-09-22 12:55:21 -04:00
..
data Uploads API: BaseCrawl refactor + Initial support for /uploads endpoint (#937) 2023-07-07 09:13:26 -07:00
__init__.py
conftest.py Track bytes stored per file type and include in org metrics (#1207) 2023-09-22 12:55:21 -04:00
echo_server.py Add event webhook tests (#1155) 2023-09-12 22:08:40 -07:00
test_collections.py feat: implement 'collections' array with {name, id} for archived item details (#1098) 2023-08-25 00:26:46 -07:00
test_crawl_config_search_values.py Backend API consistency pass (#921) 2023-06-16 18:52:46 -07:00
test_crawl_config_tags.py Backend API consistency pass (#921) 2023-06-16 18:52:46 -07:00
test_crawlconfigs.py Remove config from list endpoints to speed up responses (#1193) 2023-09-19 11:05:48 -05:00
test_filter_sort_results.py feat: implement 'collections' array with {name, id} for archived item details (#1098) 2023-08-25 00:26:46 -07:00
test_invites.py Paginate API list endpoints (#659) 2023-03-06 14:41:25 -05:00
test_login.py
test_org.py Track bytes stored per file type and include in org metrics (#1207) 2023-09-22 12:55:21 -04:00
test_permissions.py Paginate API list endpoints (#659) 2023-03-06 14:41:25 -05:00
test_run_crawl.py Add and enforce org storage quota (#1106) 2023-09-07 12:45:43 -04:00
test_settings.py tests: fixes for crawl cancel + crawl stopped (#864) 2023-05-22 20:17:29 -07:00
test_stop_cancel_crawl.py Operator refactor to control pods + pvcs directly instead of statefulsets (#1149) 2023-09-11 10:38:04 -07:00
test_uploads.py Track bytes stored per file type and include in org metrics (#1207) 2023-09-22 12:55:21 -04:00
test_users.py Add org role to /users/me-with-orgs (#536) 2023-01-31 16:27:13 -05:00
test_webhooks.py Increase wait to 30 seconds to ensure webhooks are sent (#1173) 2023-09-13 20:20:47 -07:00
test_workflow_auto_add_to_collection.py feat: implement 'collections' array with {name, id} for archived item details (#1098) 2023-08-25 00:26:46 -07:00
utils.py Uploads API: BaseCrawl refactor + Initial support for /uploads endpoint (#937) 2023-07-07 09:13:26 -07:00