browsertrix/backend/btrixcloud
Ilya Kreymer 7ea6d76f10
Resource Constraints Cleanup: (fixes #895) (#1019)
* resource constraints: (fixes #895)
- for cpu, only set cpu requests
- for memory, set mem requests == mem limits
- add missing resource constraints for minio and scheduled job
- for crawler, set mem and cpu constraints per browser, scale based on browser instances per crawler
- add comments in values.yaml for crawler values being multiplied
- default values: bump crawler to 650 millicpu per browser instance just in case

cleanup: remove unused entries from main backend configmap
2023-08-01 00:11:16 -07:00
..
migrations Rename notes to description in frontend and backend (#1011) 2023-07-26 13:00:04 -07:00
templates Resource Constraints Cleanup: (fixes #895) (#1019) 2023-08-01 00:11:16 -07:00
__init__.py
basecrawls.py Streaming Download for Collections (#1012) 2023-07-26 15:42:17 -07:00
colls.py Streaming Download for Collections (#1012) 2023-07-26 15:42:17 -07:00
crawlconfigs.py Move pydantic models to separate module + refactor crawl response endpoints to be consistent (#983) 2023-07-20 13:05:33 +02:00
crawlmanager.py Move pydantic models to separate module + refactor crawl response endpoints to be consistent (#983) 2023-07-20 13:05:33 +02:00
crawls.py Rename notes to description in frontend and backend (#1011) 2023-07-26 13:00:04 -07:00
db.py Rename notes to description in frontend and backend (#1011) 2023-07-26 13:00:04 -07:00
emailsender.py Reformat backend for black 23.1.0 (#548) 2023-02-01 20:01:09 -05:00
invites.py Move pydantic models to separate module + refactor crawl response endpoints to be consistent (#983) 2023-07-20 13:05:33 +02:00
k8sapi.py Concurrent Crawl Limit (#874) 2023-05-30 15:38:03 -07:00
main_op.py startup fixes: (#793) 2023-04-24 18:32:52 -07:00
main_scheduled_job.py fix issues that caused cronjob container to crash: (#987) 2023-07-18 18:08:53 +02:00
main.py Move pydantic models to separate module + refactor crawl response endpoints to be consistent (#983) 2023-07-20 13:05:33 +02:00
models.py Rename notes to description in frontend and backend (#1011) 2023-07-26 13:00:04 -07:00
operator.py load handling: scale up redis only when crawler pods running (#1009) 2023-07-26 08:40:05 -07:00
orgs.py Move pydantic models to separate module + refactor crawl response endpoints to be consistent (#983) 2023-07-20 13:05:33 +02:00
pagination.py Move pydantic models to separate module + refactor crawl response endpoints to be consistent (#983) 2023-07-20 13:05:33 +02:00
profiles.py Move pydantic models to separate module + refactor crawl response endpoints to be consistent (#983) 2023-07-20 13:05:33 +02:00
storages.py Streaming Download for Collections (#1012) 2023-07-26 15:42:17 -07:00
uploads.py Rename notes to description in frontend and backend (#1011) 2023-07-26 13:00:04 -07:00
users.py Move pydantic models to separate module + refactor crawl response endpoints to be consistent (#983) 2023-07-20 13:05:33 +02:00
utils.py stopping fix: backend fixes for #836 + prep for additional status fields (#837) 2023-05-08 14:02:20 -07:00
version.py Uploads API: BaseCrawl refactor + Initial support for /uploads endpoint (#937) 2023-07-07 09:13:26 -07:00
zip.py Add crawl /log API endpoint 2023-04-11 11:51:17 -04:00