f1fd11c031
Use V4 ('s3v4') signature version for for all presigning URLs to support
backblaze, fixes #2472
- add 'access_addressing_style' to be able to choose virtual/path
addressing for access endpoint (default to 'virtual' as before)
- fix minio presigning with v4 by using 'path' addressing style for
minio
- if path matches '/data/' for internal minio bucket, then always use
'path'
- also make minio access path '/data/' configurable
also simplify running in any namespace with default settings:
- don't hardcode 'local-minio.default'
- in crawlers namespace, add a 'local-minio' externalName service which
maps to the main namespace service.
|
||
|---|---|---|
| .github | ||
| .vscode | ||
| ansible | ||
| assets | ||
| backend | ||
| chart | ||
| configs | ||
| frontend | ||
| scripts | ||
| test | ||
| .gitattributes | ||
| .gitignore | ||
| .pre-commit-config.yaml | ||
| btrix | ||
| LICENSE | ||
| NOTICE | ||
| pylintrc | ||
| README.md | ||
| update-version.sh | ||
| version.txt | ||
| yarn.lock | ||
Browsertrix is a cloud-native, high-fidelity, browser-based crawling service designed to make web archiving easier and more accessible for everyone.
The service provides an API and UI for starting, scheduling, sharing, and managing crawls. This repo includes the orchestration and management tools around crawling, while the actual crawling is performed using browsertrix-crawler containers.
Install Browsertrix to self host, or access hosted Browsertrix from app.browsertrix.com.
See webrecorder.net/browsertrix for a full overview of features.
Documentation
Documentation for using, deploying, and developing Browsertrix is available at docs.browsertrix.com.
See instructions in frontend/docs to run the docs locally.
Installation
Instructions for setting up Browsertrix is available at docs.browsertrix.com/deploy.
The docs cover deploying Browsertrix in different environments using Kubernetes, from a single-node setup to scalable clusters in the cloud.
Support
Ask us your questions about Browsertrix and web archiving in the community help forum.
Dedicated professional support is available with a custom subscription. For details, see hosted Browsertrix plans.
Bugs
For bug reports or feature requests, please open a GitHub issue.
Changelog
See release notes.
Contributing
Developing
Guides for getting started with local development are available at docs.browsertrix.com/develop.
See Code of Conduct.
Translating
Translations are managed through Weblate, a web-based and open source translation tool. View translations in progress and register to contribute at our Weblate project.
License
Browsertrix is made available under the AGPLv3 License.
Documentation is made available under the Creative Commons Attribution 4.0 International License.