tea/browsertrix
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

helm chart tweaks: (#1067)

Browse Source 
* helm chart tweaks:
- lower mem requirements for backend and crawler
- disable cors in ingress to pass through cors headers from backend
- crawler statefulset: use ordered instead of parallel scaling policy to avoid single crawl taking up all crawling capacity quickly
This commit is contained in:
Ilya Kreymer 2023-08-14 16:43:12 -07:00 committed by GitHub
parent ffd0e525d9
commit 9553115bbe
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
3 changed files with 5 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
backend/btrixcloud/templates/crawler.yaml
View File

@ -19,7 +19,7 @@ spec:
serviceName: crawl-{{ id }} serviceName: crawl-{{ id }}
replicas: {{ scale }} replicas: {{ scale }}
podManagementPolicy: Parallel podManagementPolicy: OrderedReady
# not yet supported # not yet supported
#persistentVolumeClaimRetentionPolicy: #persistentVolumeClaimRetentionPolicy:

4
chart/templates/ingress.yaml
View File

@ -10,8 +10,8 @@ metadata:
kubernetes.io/ingress.class: {{ .Values.ingress_class | default "nginx" }} kubernetes.io/ingress.class: {{ .Values.ingress_class | default "nginx" }}
nginx.ingress.kubernetes.io/ssl-redirect: "true" nginx.ingress.kubernetes.io/ssl-redirect: "true"
nginx.ingress.kubernetes.io/rewrite-target: /$1 nginx.ingress.kubernetes.io/rewrite-target: /$1
nginx.ingress.kubernetes.io/enable-cors: "true" # cors enabled via backend directly on allowed paths
nginx.ingress.kubernetes.io/cors-allow-origin: "*" #nginx.ingress.kubernetes.io/enable-cors: "true"
nginx.ingress.kubernetes.io/proxy-body-size: "0" nginx.ingress.kubernetes.io/proxy-body-size: "0"
nginx.ingress.kubernetes.io/proxy-request-buffering: "off" nginx.ingress.kubernetes.io/proxy-request-buffering: "off"
nginx.ingress.kubernetes.io/proxy-buffering: "off" nginx.ingress.kubernetes.io/proxy-buffering: "off"

4
chart/values.yaml
View File

@ -101,7 +101,7 @@ backend_workers: 2
backend_cpu: "25m" backend_cpu: "25m"
backend_memory: "384Mi" backend_memory: "200Mi"
# port for operator service # port for operator service
opPort: 8756 opPort: 8756
@ -187,7 +187,7 @@ crawler_browser_instances: 2
crawler_cpu_per_browser: 650 crawler_cpu_per_browser: 650
# this value is an integer in 'Mi' (Megabyte) units, multiplied by 'crawler_browser_instances' # this value is an integer in 'Mi' (Megabyte) units, multiplied by 'crawler_browser_instances'
crawler_memory_per_browser: 768 crawler_memory_per_browser: 675
# minimum size allocated to each crawler # minimum size allocated to each crawler
# should be at least double crawl session size to ensure space for WACZ # should be at least double crawl session size to ensure space for WACZ