browsertrix/backend/btrixcloud
Tessa Walsh 82a5d1e4e4
Regression fix: add profiles/ prefix to profile filenames (#1365)
Fixes #1364 

Regression fix for issue introduced in storage refactoring (see issue
for more details).

Changes:
1. Add `profiles/` prefix to profile filename passed in to crawler for
profile creation and written into db
2. Remove hardcoded `profiles/` prefix from crawler YAML
3. Add migration to add `profiles/` prefix to profile filenames that
don't already have it, including updating PROFILE_FILENAME in ConfigMaps

This way between the related storage document and the profile filename,
we have the full path to the object in the database rather than relying
on additional prefixes hardcoded into k8s job YAML files.

Note that this as a follow-up it'll be necessary to manually move any
profiles that had been written into the `<oid>` "directory" in object
storage rather than `<oid>/profiles` to the latter. This should only
affect profiles created very recently in a 1.8.0-beta release.
2023-11-09 17:44:16 -08:00
..
migrations Regression fix: add profiles/ prefix to profile filenames (#1365) 2023-11-09 17:44:16 -08:00
__init__.py
auth.py Additional Type Hints / Type Fix Pass (#1320) 2023-10-30 12:59:24 -04:00
background_jobs.py Send email to superuser when background job fails (#1355) 2023-11-08 19:55:59 -08:00
basecrawls.py Background Jobs Work (#1321) 2023-11-02 13:02:17 -07:00
colls.py Additional Type Hints / Type Fix Pass (#1320) 2023-10-30 12:59:24 -04:00
crawlconfigs.py Additional Type Hints / Type Fix Pass (#1320) 2023-10-30 12:59:24 -04:00
crawlmanager.py Background Jobs Work (#1321) 2023-11-02 13:02:17 -07:00
crawls.py exclusion optimizations: dynamic exclusions (part of #1216): (#1268) 2023-11-06 09:36:25 -08:00
db.py Regression fix: add profiles/ prefix to profile filenames (#1365) 2023-11-09 17:44:16 -08:00
emailsender.py Send email to superuser when background job fails (#1355) 2023-11-08 19:55:59 -08:00
invites.py Additional Type Hints / Type Fix Pass (#1320) 2023-10-30 12:59:24 -04:00
k8sapi.py Crawl Timeout via elapsed time (#1338) 2023-11-06 16:32:58 -08:00
main_op.py Send email to superuser when background job fails (#1355) 2023-11-08 19:55:59 -08:00
main.py Send email to superuser when background job fails (#1355) 2023-11-08 19:55:59 -08:00
models.py Background Jobs Work (#1321) 2023-11-02 13:02:17 -07:00
operator.py Crawl Timeout via elapsed time (#1338) 2023-11-06 16:32:58 -08:00
orgs.py Additional Type Hints / Type Fix Pass (#1320) 2023-10-30 12:59:24 -04:00
pagination.py
profiles.py Regression fix: add profiles/ prefix to profile filenames (#1365) 2023-11-09 17:44:16 -08:00
storages.py charts cleanup: (#1360) 2023-11-08 19:24:00 -08:00
uploads.py Background Jobs Work (#1321) 2023-11-02 13:02:17 -07:00
users.py Additional Type Hints / Type Fix Pass (#1320) 2023-10-30 12:59:24 -04:00
utils.py Add slugs to org backend (#1250) 2023-10-10 18:30:09 -07:00
version.py version: bump to 1.8.0-beta.2 2023-11-06 16:35:15 -08:00
webhooks.py Additional Type Hints / Type Fix Pass (#1320) 2023-10-30 12:59:24 -04:00
zip.py Fix: Stream log downloading from WACZ (#1225) 2023-09-28 18:54:52 -07:00