Backend: - add 'maxCrawlSize' to models and crawljob spec - add 'MAX_CRAWL_SIZE' to configmap - add maxCrawlSize to new crawlconfig + update APIs - operator: gracefully stop crawl if current size (from stats) exceeds maxCrawlSize - tests: add max crawl size tests Frontend: - Add Max Crawl Size text box Limits tab - Users enter max crawl size in GB, convert to bytes - Add BYTES_PER_GB as constant for converting to bytes - docs: Crawl Size Limit to user guide workflow setup section Operator Refactor: - use 'status.stopping' instead of 'crawl.stopping' to indicate crawl is being stopped, as changing later has no effect in operator - add is_crawl_stopping() to return if crawl is being stopped, based on crawl.stopping or size or time limit being reached - crawlerjob status: store byte size under 'size', human readable size under 'sizeHuman' for clarity - size stat always exists so remove unneeded conditional (defaults to 0) - store raw byte size in 'size', human readable size in 'sizeHuman' Charts: - subchart: update crawlerjob crd in btrix-crds to show status.stopping instead of spec.stopping - subchart: show 'sizeHuman' property instead of 'size' - bump subchart version to 0.1.1 --------- Co-authored-by: Ilya Kreymer <ikreymer@gmail.com>
28 lines
1.0 KiB
YAML
28 lines
1.0 KiB
YAML
apiVersion: v2
|
|
name: browsertrix-cloud
|
|
description: A chart for running the Webrecorder Browsertrix System
|
|
type: application
|
|
icon: https://webrecorder.net/assets/icon.png
|
|
|
|
# This is the chart version. This version number should be incremented each time you make changes
|
|
# to the chart and its templates, including the app version.
|
|
# Versions are expected to follow Semantic Versioning (https://semver.org/)
|
|
version: 0.1.0
|
|
|
|
# This is the version number of the application being deployed. This version number should be
|
|
# incremented each time you make changes to the application. Versions are not expected to
|
|
# follow Semantic Versioning. They should reflect the version the application is using.
|
|
appVersion: 0.1.0
|
|
|
|
dependencies:
|
|
- name: btrix-admin-logging
|
|
version: 0.1.0
|
|
condition: addons.admin.logging
|
|
repository: file://./admin/logging
|
|
- name: btrix-crds
|
|
version: 0.1.1
|
|
repository: file://./btrix-crds
|
|
- name: metacontroller-helm
|
|
version: v4.10.1
|
|
repository: "oci://ghcr.io/metacontroller"
|