browsertrix/backend
Tessa Walsh 82a5d1e4e4
Regression fix: add profiles/ prefix to profile filenames (#1365)
Fixes #1364 

Regression fix for issue introduced in storage refactoring (see issue
for more details).

Changes:
1. Add `profiles/` prefix to profile filename passed in to crawler for
profile creation and written into db
2. Remove hardcoded `profiles/` prefix from crawler YAML
3. Add migration to add `profiles/` prefix to profile filenames that
don't already have it, including updating PROFILE_FILENAME in ConfigMaps

This way between the related storage document and the profile filename,
we have the full path to the object in the database rather than relying
on additional prefixes hardcoded into k8s job YAML files.

Note that this as a follow-up it'll be necessary to manually move any
profiles that had been written into the `<oid>` "directory" in object
storage rather than `<oid>/profiles` to the latter. This should only
affect profiles created very recently in a 1.8.0-beta release.
2023-11-09 17:44:16 -08:00
..
btrixcloud Regression fix: add profiles/ prefix to profile filenames (#1365) 2023-11-09 17:44:16 -08:00
test users: add case-insensitive index to maintain backwards compatibility with fastapi-users (#1319) 2023-10-27 14:31:29 -07:00
test_nightly Crawl Timeout via elapsed time (#1338) 2023-11-06 16:32:58 -08:00
.pylintrc
Dockerfile
mypy.ini Improved type checking for backend with mypy (#1174) 2023-09-13 19:40:26 -07:00
requirements.txt Storage Refactor: Replication + Custom Storage Support (#1296) 2023-10-26 21:44:09 -07:00
test-requirements.txt Add slugs to org backend (#1250) 2023-10-10 18:30:09 -07:00