browsertrix/backend/btrixcloud
Ilya Kreymer f1fd11c031
storage: use s3v4 signature for presigning urls (#2611)
Use V4 ('s3v4') signature version for for all presigning URLs to support
backblaze, fixes #2472
- add 'access_addressing_style' to be able to choose virtual/path
addressing for access endpoint (default to 'virtual' as before)
- fix minio presigning with v4 by using 'path' addressing style for
minio
- if path matches '/data/' for internal minio bucket, then always use
'path'
- also make minio access path '/data/' configurable

also simplify running in any namespace with default settings:
- don't hardcode 'local-minio.default'
- in crawlers namespace, add a 'local-minio' externalName service which
maps to the main namespace service.
2025-05-19 15:44:36 -07:00
..
migrations Add ISO-639-1 language code validation to backend (#2602) 2025-05-13 16:54:33 -04:00
operator Ensure error and behavior logs are written to database in order (#2540) 2025-04-08 09:35:50 -04:00
__init__.py
auth.py fixes token lifetime bug / improve security (#2490) 2025-03-19 10:07:09 -07:00
background_jobs.py
basecrawls.py Add behavior logs from Redis to database and add endpoint to serve (#2526) 2025-04-08 02:16:10 +02:00
colls.py compute top page origins for each collection (#2483) 2025-05-08 14:22:40 -07:00
crawlconfigs.py Add ISO-639-1 language code validation to backend (#2602) 2025-05-13 16:54:33 -04:00
crawlmanager.py feat: Apply saved workflow settings to current crawl (#2514) 2025-04-29 11:43:14 -07:00
crawls.py Add behavior logs from Redis to database and add endpoint to serve (#2526) 2025-04-08 02:16:10 +02:00
db.py Add ISO-639-1 language code validation to backend (#2602) 2025-05-13 16:54:33 -04:00
emailsender.py
invites.py
k8sapi.py
main_bg.py
main_migrations.py
main_op.py
main.py
models.py storage: use s3v4 signature for presigning urls (#2611) 2025-05-19 15:44:36 -07:00
ops.py
orgs.py Add ISO-639-1 language code validation to backend (#2602) 2025-05-13 16:54:33 -04:00
pages.py Ensure crawl page counts are correct when re-adding pages (#2601) 2025-05-13 14:05:41 -04:00
pagination.py
profiles.py support overriding crawler image pull policy per channel (#2523) 2025-03-31 14:11:41 -07:00
storages.py storage: use s3v4 signature for presigning urls (#2611) 2025-05-19 15:44:36 -07:00
subs.py Add API endpoint to check if subscription is activated (#2582) 2025-05-06 17:36:58 -07:00
uploads.py
users.py Fix user emails use userout (#2511) 2025-03-24 12:04:39 -07:00
utils.py Add ISO-639-1 language code validation to backend (#2602) 2025-05-13 16:54:33 -04:00
version.py Bump version to 1.16.1 (#2606) 2025-05-13 17:29:49 -04:00
webhooks.py