browsertrix/chart
Ilya Kreymer b4fd5e6e94
Crawl Timeout via elapsed time (#1338)
Fixes #1337 

Crawl timeout is tracked via `elapsedCrawlTime` field on the crawl
status, which is similar to regular crawl execution time, but only
counts one pod if scale > 1. If scale == 1, this time is equivalent.

Crawl is gracefully stopped when the elapsed execution time exceeds the
timeout. For more responsiveness, also adding current crawl time since
last update interval.

Details:
- handle crawl timeout via elapsed crawl time - longest running time of a
single pod, instead of expire time.
- include current running from last update for best precision
- more accurately count elapsed time crawl is actually running
- store elapsedCrawlTime in addition to crawlExecTime, storing the
longest duration of each pod since last test interval

---------
Co-authored-by: Tessa Walsh <tessa@bitarchivist.net>
2023-11-06 16:32:58 -08:00
..
admin/logging
app-templates Crawl Timeout via elapsed time (#1338) 2023-11-06 16:32:58 -08:00
btrix-crds
charts
examples Rename "Production" to "Remote" (#1105) 2023-09-14 15:20:02 -07:00
templates Move backend app templates to be installed from configmap volume (#1331) 2023-11-06 09:37:48 -08:00
test test: don't pin crawler image to non-working version 2023-11-04 01:02:38 -07:00
.helmignore
Chart.lock
Chart.yaml version: bump to 1.8.0-beta.1 2023-10-27 14:35:24 -07:00
README.md
values.yaml Allow User to specify custom cluster-issuer (#1332) 2023-11-04 13:29:17 -07:00

Update Helm dependencies

  • It needs to update Helm charts after changing its dependencies (e.g. logging)
$ helm dependency update .

Update metacontroller

#!/bin/bash

# intall metacontroller
git clone --depth=1 https://github.com/metacontroller/metacontroller.git
cd metacontroller
helm package deploy/helm/metacontroller --destination deploy/helm
cd ..

# update dependency
helm dependency update
  • Bump up the metacontroller version in Chart.yaml