Go to file
Tessa Walsh dc41468daf
Allow users to run crawls with 1 or 2 browser windows (#2627)
Fixes #2425 

## Changed

- Switch backend to primarily using number of browser windows rather
than scale multiplier (including migration to calculate `browserWindows`
from `scale` for existing workflows and crawls)
- Still support `scale` in addition to `browserWindows` in input models
for creating and updating workflows and re-adjusting live crawl scale
for backwards compatibility
- Adds new `max_browser_windows` value to Helm chart, but calculates the
value from `max_crawl_scale` as fallback for users with that value
already set in local charts
- Rework frontend to allow users to select multiples of
`crawler_browser_instances` or any value below
`crawler_browser_instances` for browser windows. For instance, with
`crawler_browser_instances=4` and `max_browser_windows=8`, the user
would be presented with the following options: 1, 2, 3, 4, 8
- Sets maximum width of screencast to image width returned by `message`

---------

Co-authored-by: Ilya Kreymer <ikreymer@gmail.com>
Co-authored-by: sua yoo <sua@suayoo.com>
Co-authored-by: Ilya Kreymer <ikreymer@users.noreply.github.com>
2025-06-03 13:37:30 -07:00
.github Don't clobber existing helm chart in release! (#2643) 2025-06-03 09:28:34 -07:00
.vscode devex: Add Storybook for component development (#2556) 2025-04-21 13:06:31 -07:00
ansible
assets
backend Allow users to run crawls with 1 or 2 browser windows (#2627) 2025-06-03 13:37:30 -07:00
chart Allow users to run crawls with 1 or 2 browser windows (#2627) 2025-06-03 13:37:30 -07:00
configs
frontend Allow users to run crawls with 1 or 2 browser windows (#2627) 2025-06-03 13:37:30 -07:00
scripts
test
.gitattributes
.gitignore
.pre-commit-config.yaml
btrix
LICENSE
NOTICE
pylintrc
README.md docs: Organize readme and fix doc links (#2479) 2025-03-11 18:37:20 -07:00
update-version.sh
version.txt version: bump to 1.17.0-beta.0 2025-06-02 14:46:32 -07:00
yarn.lock docs: add public collections gallery howto (#2462) 2025-03-08 15:57:13 -08:00

Browsertrix

 

Browsertrix is a cloud-native, high-fidelity, browser-based crawling service designed to make web archiving easier and more accessible for everyone.

The service provides an API and UI for starting, scheduling, sharing, and managing crawls. This repo includes the orchestration and management tools around crawling, while the actual crawling is performed using browsertrix-crawler containers.

Install Browsertrix to self host, or access hosted Browsertrix from app.browsertrix.com.

See webrecorder.net/browsertrix for a full overview of features.

Documentation

Documentation for using, deploying, and developing Browsertrix is available at docs.browsertrix.com.

See instructions in frontend/docs to run the docs locally.

Installation

Instructions for setting up Browsertrix is available at docs.browsertrix.com/deploy.

The docs cover deploying Browsertrix in different environments using Kubernetes, from a single-node setup to scalable clusters in the cloud.

Support

Ask us your questions about Browsertrix and web archiving in the community help forum.

Dedicated professional support is available with a custom subscription. For details, see hosted Browsertrix plans.

Bugs

For bug reports or feature requests, please open a GitHub issue.

Changelog

See release notes.

Contributing

Developing

Guides for getting started with local development are available at docs.browsertrix.com/develop.

See Code of Conduct.

Translating

Translations are managed through Weblate, a web-based and open source translation tool. View translations in progress and register to contribute at our Weblate project.

Translation status

License

Browsertrix is made available under the AGPLv3 License.

Documentation is made available under the Creative Commons Attribution 4.0 International License.