browsertrix/chart
Ilya Kreymer 8ea16393c5
Optimize single-page crawl workflows (#2656)
For single page crawls:
- Always force 1 browser to be used, ignoring browser windows/scale
setting
- Don't use custom PVC volumes in crawler / redis, just use emptyDir -
no chance of crawler being interrupted and restarted on different
machine for a single page.

Adds a 'is_single_page' check to CrawlConfig, checking for either limit
or scopeType / no extra hops.

Fixes #2655
2025-06-10 12:13:57 -07:00
..
admin/logging
app-templates Optimize single-page crawl workflows (#2656) 2025-06-10 12:13:57 -07:00
btrix-crds
charts Configure browsertrix proxies (#1847) 2024-10-02 18:35:45 -07:00
email-templates Rework crawl page migration + MongoDB Query Optimizations (#2412) 2025-02-20 15:26:11 -08:00
examples docs: update remote deployment docs with working nginx-install example (#2625) 2025-05-28 20:07:02 -07:00
proxies Configure browsertrix proxies (#1847) 2024-10-02 18:35:45 -07:00
templates Allow users to run crawls with 1 or 2 browser windows (#2627) 2025-06-03 13:37:30 -07:00
test tests: fix nightly test config after #2611 (#2614) 2025-05-20 12:25:15 -07:00
.helmignore
Chart.lock Configure browsertrix proxies (#1847) 2024-10-02 18:35:45 -07:00
Chart.yaml version: bump to 1.17.0-beta.0 2025-06-02 14:46:32 -07:00
README.md
values.yaml Optimize single-page crawl workflows (#2656) 2025-06-10 12:13:57 -07:00

Update Helm dependencies

  • It needs to update Helm charts after changing its dependencies (e.g. logging)
$ helm dependency update .

Update metacontroller

#!/bin/bash

# intall metacontroller
git clone --depth=1 https://github.com/metacontroller/metacontroller.git
cd metacontroller
helm package deploy/helm/metacontroller --destination deploy/helm
cd ..

# update dependency
helm dependency update
  • Bump up the metacontroller version in Chart.yaml