browsertrix/backend/btrixcloud
Ilya Kreymer 3cd52342a7
Remove Crawl Workflow Configmaps (#1894)
Fixes #1893 

- Removes crawl workflow-scoped configmaps, and replaces with operator-controlled
per-crawl configmaps that only contain the json config passed to Browsertrix
Crawler (as a volume).
- Other configmap settings replaced are replaced the custom CrawlJob options
(mostly already were, just added profile_filename and storage_filename)
- Cron jobs also updated to create CrawlJob without relying on configmaps,
querying the db for additional settings.
- The `userid` associated with cron jobs is set to the user that last modified
 the schedule of the crawl, rather than whomever last modified the workflow
- Various functions that deal with updating configmaps have been removed,
including in migrations.
- New migration 0029 added to remove all crawl workflow configmaps
2024-06-28 15:25:23 -07:00
..
migrations Remove Crawl Workflow Configmaps (#1894) 2024-06-28 15:25:23 -07:00
operator Remove Crawl Workflow Configmaps (#1894) 2024-06-28 15:25:23 -07:00
__init__.py
auth.py
background_jobs.py
basecrawls.py ensure QA configmap is updated for long running QA runs: (#1865) 2024-06-12 10:51:35 -07:00
colls.py
crawlconfigs.py Remove Crawl Workflow Configmaps (#1894) 2024-06-28 15:25:23 -07:00
crawlmanager.py Remove Crawl Workflow Configmaps (#1894) 2024-06-28 15:25:23 -07:00
crawls.py Remove Crawl Workflow Configmaps (#1894) 2024-06-28 15:25:23 -07:00
db.py Remove Crawl Workflow Configmaps (#1894) 2024-06-28 15:25:23 -07:00
emailsender.py feat: Rename org when accepting org invite for first admin (#1870) 2024-06-27 16:08:31 -07:00
invites.py feat: Rename org when accepting org invite for first admin (#1870) 2024-06-27 16:08:31 -07:00
k8sapi.py Remove Crawl Workflow Configmaps (#1894) 2024-06-28 15:25:23 -07:00
main_op.py
main.py Add billing enabled and sales email to Helm chart and /settings API endpoint (#1873) 2024-06-25 10:55:29 -04:00
models.py Add and enforce readOnly field in Organization (#1886) 2024-06-25 19:30:53 -07:00
orgs.py feat: Rename org when accepting org invite for first admin (#1870) 2024-06-27 16:08:31 -07:00
pages.py QA stats aggregation: exclude isFile / isError pages from stats (#1879) 2024-06-25 08:54:42 -07:00
pagination.py
profiles.py Use standard firstSeed/seedCount fallback for workflows with no name in profile details (#1852) 2024-06-06 14:28:19 -04:00
storages.py
uploads.py
users.py feat: Rename org when accepting org invite for first admin (#1870) 2024-06-27 16:08:31 -07:00
utils.py Add slug validation and test (#1891) 2024-06-26 15:04:54 -04:00
version.py version: bump to 1.10.2 2024-06-11 16:28:40 -07:00
webhooks.py