6df10d5fb0
Fixes #1888 Refactors scale handling: - Ensures number of scaled instances does not exceed number of pages, but is also at minimum 1 - Checks for finish condition to be numFailed + numDone >= desired scale - If at least one instance succeeds, crawl considers successful / done. - If all instances fail, crawl considered failed - Ensures that pod done count >= redis done count --------- Co-authored-by: Tessa Walsh <tessa@bitarchivist.net> |
||
|---|---|---|
| .. | ||
| migrations | ||
| operator | ||
| __init__.py | ||
| auth.py | ||
| background_jobs.py | ||
| basecrawls.py | ||
| colls.py | ||
| crawlconfigs.py | ||
| crawlmanager.py | ||
| crawls.py | ||
| db.py | ||
| emailsender.py | ||
| invites.py | ||
| k8sapi.py | ||
| main_op.py | ||
| main.py | ||
| models.py | ||
| orgs.py | ||
| pages.py | ||
| pagination.py | ||
| profiles.py | ||
| storages.py | ||
| uploads.py | ||
| users.py | ||
| utils.py | ||
| version.py | ||
| webhooks.py | ||