browsertrix/backend
Tessa Walsh 094f27bcff
Track bytes stored per file type and include in org metrics (#1207)
* Add bytes stored per type to org and metrics

The org now tracks bytesStored by type of crawl, uploads, and browser profiles
in addition to the total, and returns these values in the org metrics endpoint.

A migration is added to precompute these values in existing deployments.

In addition, all /metrics storage values are now returned solely as bytes, as
the GB form wasn't being used in the frontend and is unnecessary.

* Improve deletion of multiple archived item types via `/all-crawls` delete endpoint

- Update `/all-crawls` delete test to check that org and workflow size values
are correct following deletion.
- Fix bug where it was always assumed only one crawl was deleted per cid
and size was not tracked per cid
- Add type check within delete_crawls
2023-09-22 12:55:21 -04:00
..
btrixcloud Track bytes stored per file type and include in org metrics (#1207) 2023-09-22 12:55:21 -04:00
test Track bytes stored per file type and include in org metrics (#1207) 2023-09-22 12:55:21 -04:00
test_nightly Expect that crawl deleted response is bool, not int (#1170) 2023-09-12 15:03:17 -07:00
.pylintrc quickfix: pydantic / lint fix (#452) 2023-01-10 18:54:11 -08:00
Dockerfile Remove Code and Configs for Swarm/podman support (#407) 2022-12-08 18:19:58 -08:00
mypy.ini Improved type checking for backend with mypy (#1174) 2023-09-13 19:40:26 -07:00
requirements.txt better resources scaling by number of browsers per crawler container (#1103) 2023-09-06 01:42:44 -04:00