browsertrix/chart
Ilya Kreymer 5b6aa3bc95
Affinity + Tolerations + Cleanup Crawl Job (#256)
* k8s: add tolerations for 'nodeType=crawling:NoSchedule' to allow scheduling crawling on designated nodes for crawler and profiles jobs and statefulsets
* add affinity for 'nodeType=crawling' on crawling and profile browser statefulsets
* refactor crawljob: combine crawl_updater logic into base crawl_job
* increment new 'crawlAttemptCount' counter crawlconfig when crawl is started, not necessarily finished, to avoid deleting configs that had attempted but not finished crawls.
* better external mongodb support: use MONGO_DB_URL to set custom url directly, otherwise build from username, password and mongo host
2022-06-10 19:21:37 -07:00
..
templates Affinity + Tolerations + Cleanup Crawl Job (#256) 2022-06-10 19:21:37 -07:00
.helmignore Frontend + Backend Integrated Deployment (K8s only) (#45) 2021-12-03 10:17:22 -08:00
Chart.yaml helm chart: support cloud-based persistent volumes if values 'volume_storage_class' is specified. 2022-01-15 19:34:31 -08:00
values.yaml Affinity + Tolerations + Cleanup Crawl Job (#256) 2022-06-10 19:21:37 -07:00