browsertrix/chart/templates
Ilya Kreymer 4f676e4e82
QA Runs Initial Backend Implementation (#1586)
Supports running QA Runs via the QA API!

Builds on top of the `issue-1498-crawl-qa-backend-support` branch, fixes
#1498

Also requires the latest Browsertrix Crawler 1.1.0+ (from
webrecorder/browsertrix-crawler#469 branch)

Notable changes:
- QARun objects contain info about QA runs, which are crawls
performed on data loaded from existing crawls.

- Various crawl db operations can be performed on either the crawl or
`qa.` object, and core crawl fields have been moved to CoreCrawlable.

- While running,`QARun` data stored in a single `qa` object, while
finished qa runs are added to `qaFinished` dictionary on the Crawl. The
QA list API returns data from the finished list, sorted by most recent
first.

- Includes additional type fixes / type safety, especially around
BaseCrawl / Crawl / UploadedCrawl functionality, also creating specific
get_upload(), get_basecrawl(), get_crawl() getters for internal use and
get_crawl_out() for API

- Support filtering and sorting pages via `qaFilterBy` (screenshotMatch, textMatch) 
along with `gt`, `lt`, `gte`, `lte` params to return pages based on QA results.

---------
Co-authored-by: Tessa Walsh <tessa@bitarchivist.net>
2024-03-20 22:42:16 -07:00
..
backend.yaml Increase startup probe time to account for long-running migrations (#1560) 2024-02-28 14:22:33 -08:00
configmap.yaml QA Runs Initial Backend Implementation (#1586) 2024-03-20 22:42:16 -07:00
frontend.yaml supports overriding the replayweb.page version without having to be r… (#1122) 2023-09-05 20:10:21 -04:00
ingress.yaml Allow User to specify custom cluster-issuer (#1332) 2023-11-04 13:29:17 -07:00
minio.yaml Background Jobs Work (#1321) 2023-11-02 13:02:17 -07:00
mongo.yaml Resource Constraints Cleanup: (fixes #895) (#1019) 2023-08-01 00:11:16 -07:00
namespaces.yaml refactoring to use statefulsets + job (#245) 2022-06-05 10:37:17 -07:00
operators.yaml QA Runs Initial Backend Implementation (#1586) 2024-03-20 22:42:16 -07:00
priorities.yaml QA Runs Initial Backend Implementation (#1586) 2024-03-20 22:42:16 -07:00
role.yaml Track pod resource usage, detect OOM crashes, handle auto-scaling (#1235) 2023-10-05 20:41:18 -07:00
secrets.yaml Support multiple crawler versions (#1420) 2024-01-16 15:32:12 -08:00
service.yaml Use Shared Services for Crawling, Redis, Profile Browsers (#1088) 2023-08-24 20:08:53 -07:00
signer.yaml charts cleanup: (#1360) 2023-11-08 19:24:00 -08:00