browsertrix

History

Ilya Kreymer 8ea16393c5 Optimize single-page crawl workflows (#2656 ) For single page crawls: - Always force 1 browser to be used, ignoring browser windows/scale setting - Don't use custom PVC volumes in crawler / redis, just use emptyDir - no chance of crawler being interrupted and restarted on different machine for a single page. Adds a 'is_single_page' check to CrawlConfig, checking for either limit or scopeType / no extra hops. Fixes #2655		2025-06-10 12:13:57 -07:00
..
admin/logging	Add lightweight logging mode (#668 )	2023-03-10 14:34:37 -08:00
app-templates	Optimize single-page crawl workflows (#2656 )	2025-06-10 12:13:57 -07:00
btrix-crds	Add max crawl size option to backend and frontend (#1045 )	2023-08-26 22:00:37 -07:00
charts	Configure browsertrix proxies (#1847 )	2024-10-02 18:35:45 -07:00
email-templates	Rework crawl page migration + MongoDB Query Optimizations (#2412 )	2025-02-20 15:26:11 -08:00
examples	docs: update remote deployment docs with working nginx-install example (#2625 )	2025-05-28 20:07:02 -07:00
proxies	Configure browsertrix proxies (#1847 )	2024-10-02 18:35:45 -07:00
templates	Allow users to run crawls with 1 or 2 browser windows (#2627 )	2025-06-03 13:37:30 -07:00
test	tests: fix nightly test config after #2611 (#2614 )	2025-05-20 12:25:15 -07:00
.helmignore	Frontend + Backend Integrated Deployment (K8s only) (#45 )	2021-12-03 10:17:22 -08:00
Chart.lock	Configure browsertrix proxies (#1847 )	2024-10-02 18:35:45 -07:00
Chart.yaml	version: bump to 1.17.0-beta.0	2025-06-02 14:46:32 -07:00
README.md	Refactor to use new operator on backend (#789 )	2023-04-24 18:30:52 -07:00
values.yaml	Optimize single-page crawl workflows (#2656 )	2025-06-10 12:13:57 -07:00

README.md

Update Helm dependencies

It needs to update Helm charts after changing its dependencies (e.g. logging)

$ helm dependency update .

Update metacontroller

#!/bin/bash

# intall metacontroller
git clone --depth=1 https://github.com/metacontroller/metacontroller.git
cd metacontroller
helm package deploy/helm/metacontroller --destination deploy/helm
cd ..

# update dependency
helm dependency update

Bump up the metacontroller version in Chart.yaml