Go to file
Tessa Walsh e9895e78a2
Add additional filters to page list endpoints (#1622)
Fixes #1617 

Filters added:

- reviewed: filter by page has approval or at least one note (true) or
neither (false)
- approved: filter by approval value (accepts list of strings,
comma-separated, each of which are coerced into True, False, or None, or
ignored if they are invalid values)
- hasNotes: filter by has at least one note (true) or not (false)

Tests have also been added to ensure that results are as expected.
2024-03-21 21:33:07 -07:00
.github Disable Prettier check in CI (#1619) 2024-03-20 15:01:51 -07:00
.vscode Add ESLint rules for import ordering (#1608) 2024-03-18 21:50:02 -04:00
ansible Bump cryptography from 41.0.1 to 42.0.4 in /ansible (#1574) 2024-03-06 16:24:36 -08:00
assets Docs: Update docs theme (#1594) 2024-03-16 15:09:31 -07:00
backend Add additional filters to page list endpoints (#1622) 2024-03-21 21:33:07 -07:00
chart QA Runs Initial Backend Implementation (#1586) 2024-03-20 22:42:16 -07:00
configs
docs Update node version mentioned in docs (#1615) 2024-03-19 16:40:53 -04:00
frontend Emit more modern code for browsers (#1614) 2024-03-19 17:22:41 -04:00
scripts publish helm chart on release (fixes #1114) (#1117) (#1123) 2023-08-30 12:02:02 -07:00
test fix(build): use /usr/bin/env bash instead of /bin/bash (#1020) 2023-07-28 21:50:04 -07:00
.gitignore Make btrix helper work with microk8s (#768) 2023-04-18 08:50:46 -04:00
.pre-commit-config.yaml Format backend with Black 24 (#1507) 2024-02-07 11:35:34 -08:00
btrix Add setup command to btrix helper to copy local config (#1462) 2024-01-10 19:32:39 -08:00
CHANGES.md
LICENSE
mkdocs.yml Docs: Update docs theme (#1594) 2024-03-16 15:09:31 -07:00
NOTICE
pylintrc
README.md Docs: Update docs theme (#1594) 2024-03-16 15:09:31 -07:00
update-version.sh enable screenshots by default + fix py version formatting (#1518) 2024-02-07 17:07:28 -08:00
version.txt version: bump to 1.10.0-beta.0 2024-02-20 00:22:29 -08:00
yarn.lock Frontend collections beta UI (#886) 2023-06-06 17:52:01 -07:00

Browsertrix Logo

 

Browsertrix is an open-source cloud-native high-fidelity browser-based crawling service designed to make web archiving easier and more accessible for everyone.

The service provides an API and UI for scheduling crawls and viewing results, and managing all aspects of crawling process. This system provides the orchestration and management around crawling, while the actual crawling is performed using Browsertrix Crawler containers, which are launched for each crawl.

See browsertrix.com for a feature overview and information about Browsertrix hosting.

Documentation

The full docs for using, deploying, and developing Browsertrix are available at: https://docs.browsertrix.cloud

Deployment

The latest deployment documentation is available at: https://docs.browsertrix.cloud/deploy

The docs cover deploying Browsertrix in different environments using Kubernetes, from a single-node setup to scalable clusters in the cloud.

Previously, Browsertrix also supported Docker Compose and podman-based deployment. This has been deprecated due to the complexity of maintaining feature parity across different setups, and with various Kubernetes deployment options being available and easy to deploy, even on a single machine.

Making deployment of Browsertrix as easy as possible remains a key goal, and we welcome suggestions for how we can further improve our Kubernetes deployment options.

If you are looking to just try running a single crawl, you may want to try Browsertrix Crawler first to test out the crawling capabilities.

Development Status

Browsertrix is currently in a beta, though the system and backend API is fairly stable, we are working on many additional features.

Additional developer documentation is available at https://docs.browsertrix.cloud/develop

Please see the GitHub issues and this GitHub Project for our current project plan and tasks.

License

Browsertrix is made available under the AGPLv3 License.

Documentation is made available under the Creative Commons Attribution 4.0 International License