browsertrix/chart
Tessa Walsh 032859f361
Support multiple crawler versions (#1420)
Fixes #1385 

## Changes
Supports multiple crawler 'channels' which can be configured to
different browsertrix-crawler versions
- Replaces `crawler_image` in helm chart with `crawler_channels` array
similar to how storages are handled
- The `default` crawler channel must always be provided and specifies
the default crawler image
- Adds backend `/orgs/{oid}/crawlconfigs/crawler-channels` API endpoint
to fetch information about available crawler versions (name, image, and
label) and test
- Adds crawler channel select to workflow creation/edit screens and
profile creation dialog, and updates related API endpoints and
configmaps accordingly. The select dropdown is shown only if more than
one channel is configured.
- Adds `crawlerChannel` to workflow and crawl details.
- Add `image` to crawler image, used to display actual image used as
part of the crawl.
- Modifies `crawler_crawl_id` backend test fixture to use `test` crawler
version to ensure crawler versions other than latest work
- Adds migration to add `crawlerChannel` set to `default` to existing
workflow and profile objects and workflow configmaps

---------
Co-authored-by: Ilya Kreymer <ikreymer@gmail.com>
Co-authored-by: Henry Wilkinson <henry@wilkinson.graphics>
2024-01-16 15:32:12 -08:00
..
admin/logging
app-templates Support multiple crawler versions (#1420) 2024-01-16 15:32:12 -08:00
btrix-crds Add max crawl size option to backend and frontend (#1045) 2023-08-26 22:00:37 -07:00
charts Operator refactor to control pods + pvcs directly instead of statefulsets (#1149) 2023-09-11 10:38:04 -07:00
email-templates Email Templates (#1375) 2023-11-15 15:22:12 -08:00
examples Support multiple crawler versions (#1420) 2024-01-16 15:32:12 -08:00
templates Support multiple crawler versions (#1420) 2024-01-16 15:32:12 -08:00
test Support multiple crawler versions (#1420) 2024-01-16 15:32:12 -08:00
.helmignore
Chart.lock Operator refactor to control pods + pvcs directly instead of statefulsets (#1149) 2023-09-11 10:38:04 -07:00
Chart.yaml version: bump to 1.9.0-beta.0 2023-12-20 00:08:16 -08:00
README.md Refactor to use new operator on backend (#789) 2023-04-24 18:30:52 -07:00
values.yaml Support multiple crawler versions (#1420) 2024-01-16 15:32:12 -08:00

Update Helm dependencies

  • It needs to update Helm charts after changing its dependencies (e.g. logging)
$ helm dependency update .

Update metacontroller

#!/bin/bash

# intall metacontroller
git clone --depth=1 https://github.com/metacontroller/metacontroller.git
cd metacontroller
helm package deploy/helm/metacontroller --destination deploy/helm
cd ..

# update dependency
helm dependency update
  • Bump up the metacontroller version in Chart.yaml