browsertrix/chart/templates/priorities.yaml
Tessa Walsh dc41468daf
Allow users to run crawls with 1 or 2 browser windows (#2627)
Fixes #2425 

## Changed

- Switch backend to primarily using number of browser windows rather
than scale multiplier (including migration to calculate `browserWindows`
from `scale` for existing workflows and crawls)
- Still support `scale` in addition to `browserWindows` in input models
for creating and updating workflows and re-adjusting live crawl scale
for backwards compatibility
- Adds new `max_browser_windows` value to Helm chart, but calculates the
value from `max_crawl_scale` as fallback for users with that value
already set in local charts
- Rework frontend to allow users to select multiples of
`crawler_browser_instances` or any value below
`crawler_browser_instances` for browser windows. For instance, with
`crawler_browser_instances=4` and `max_browser_windows=8`, the user
would be presented with the following options: 1, 2, 3, 4, 8
- Sets maximum width of screencast to image width returned by `message`

---------

Co-authored-by: Ilya Kreymer <ikreymer@gmail.com>
Co-authored-by: sua yoo <sua@suayoo.com>
Co-authored-by: Ilya Kreymer <ikreymer@users.noreply.github.com>
2025-06-03 13:37:30 -07:00

39 lines
895 B
YAML

{{ $max_browser_windows := not (empty .Values.max_browser_windows) | ternary (int .Values.max_browser_windows) (mul (int .Values.max_crawl_scale) (int .Values.crawler_browser_instances) ) }}
{{- range untilStep 0 $max_browser_windows 1 }}
---
apiVersion: scheduling.k8s.io/v1
kind: PriorityClass
metadata:
name: crawl-pri-{{ . }}
value: {{ sub 0 . }}
globalDefault: false
description: "Priority for crawl instance #{{ . }}"
{{- end }}
{{- range untilStep 0 $max_browser_windows 1 }}
---
apiVersion: scheduling.k8s.io/v1
kind: PriorityClass
metadata:
name: qa-crawl-pri-{{ . }}
value: {{ sub -2 . }}
globalDefault: false
description: "Priority for QA crawl instance #{{ . }}"
{{- end }}
# Lower Priority for Background Jobs
---
apiVersion: scheduling.k8s.io/v1
kind: PriorityClass
metadata:
name: bg-job
value: -1000
globalDefault: false
description: "Priority for background jobs"