browsertrix/backend
Ilya Kreymer 16e7a1d0a2
Storage Ops Refactor (#1257)
* storage ops refactor:
- create StorageOps class similar to other ops classes
- init storages list in StorageOps, no longer require lookup up default storages via CrawlManager
- convert all storage functions to members, add storageops to operator
- remove unused params, ensure crawl exists for rollover restart
- add env var to determine if using local minio to use correct endpoint URL

* crawls /seeds endpoint: just return empty list if not a crawl (eg. upload)

* crawlmanager: remove unused code, rename check_storage -> has_storage
2023-10-10 15:04:23 -07:00
..
btrixcloud Storage Ops Refactor (#1257) 2023-10-10 15:04:23 -07:00
test Require that all passwords are between 8 and 64 characters (#1239) 2023-10-03 18:57:46 -07:00
test_nightly Expect that crawl deleted response is bool, not int (#1170) 2023-09-12 15:03:17 -07:00
.pylintrc
Dockerfile
mypy.ini Improved type checking for backend with mypy (#1174) 2023-09-13 19:40:26 -07:00
requirements.txt better resources scaling by number of browsers per crawler container (#1103) 2023-09-06 01:42:44 -04:00