browsertrix

History

Ilya Kreymer 4f676e4e82 QA Runs Initial Backend Implementation (#1586 ) Supports running QA Runs via the QA API! Builds on top of the `issue-1498-crawl-qa-backend-support` branch, fixes #1498 Also requires the latest Browsertrix Crawler 1.1.0+ (from webrecorder/browsertrix-crawler#469 branch) Notable changes: - QARun objects contain info about QA runs, which are crawls performed on data loaded from existing crawls. - Various crawl db operations can be performed on either the crawl or `qa.` object, and core crawl fields have been moved to CoreCrawlable. - While running,`QARun` data stored in a single `qa` object, while finished qa runs are added to `qaFinished` dictionary on the Crawl. The QA list API returns data from the finished list, sorted by most recent first. - Includes additional type fixes / type safety, especially around BaseCrawl / Crawl / UploadedCrawl functionality, also creating specific get_upload(), get_basecrawl(), get_crawl() getters for internal use and get_crawl_out() for API - Support filtering and sorting pages via `qaFilterBy` (screenshotMatch, textMatch) along with `gt`, `lt`, `gte`, `lte` params to return pages based on QA results. --------- Co-authored-by: Tessa Walsh <tessa@bitarchivist.net>		2024-03-20 22:42:16 -07:00
..
admin/logging
app-templates	QA Runs Initial Backend Implementation (#1586 )	2024-03-20 22:42:16 -07:00
btrix-crds	Add max crawl size option to backend and frontend (#1045 )	2023-08-26 22:00:37 -07:00
charts	Operator refactor to control pods + pvcs directly instead of statefulsets (#1149 )	2023-09-11 10:38:04 -07:00
email-templates	Browsertrix Cloud → Browsertrix text rename (#1466 )	2024-03-12 11:30:05 -04:00
examples	Support multiple crawler versions (#1420 )	2024-01-16 15:32:12 -08:00
templates	QA Runs Initial Backend Implementation (#1586 )	2024-03-20 22:42:16 -07:00
test	QA Runs Initial Backend Implementation (#1586 )	2024-03-20 22:42:16 -07:00
.helmignore
Chart.lock	Operator refactor to control pods + pvcs directly instead of statefulsets (#1149 )	2023-09-11 10:38:04 -07:00
Chart.yaml	version: bump to 1.10.0-beta.0	2024-02-20 00:22:29 -08:00
README.md	Refactor to use new operator on backend (#789 )	2023-04-24 18:30:52 -07:00
values.yaml	QA Runs Initial Backend Implementation (#1586 )	2024-03-20 22:42:16 -07:00

README.md

Update Helm dependencies

It needs to update Helm charts after changing its dependencies (e.g. logging)

$ helm dependency update .

Update metacontroller

#!/bin/bash

# intall metacontroller
git clone --depth=1 https://github.com/metacontroller/metacontroller.git
cd metacontroller
helm package deploy/helm/metacontroller --destination deploy/helm
cd ..

# update dependency
helm dependency update

Bump up the metacontroller version in Chart.yaml