- Adds two new crawl finished state, stopped_by_user and stopped_quota_reached - Tracking other possible 'stop reasons' in operator, though not making them distinct states for now. - Updated frontend with 'Stopped by User' and 'Stopped: Time Quota Reached', shown with same icon as current partial_complete - Added migration of partial_complete to either stopped_by_user or complete (no historical quota data available) - Addresses edge case in scaling: if crawl never scaled (no redis entry, no pod), automatically scale down - Edge case in status: if crawl is somehow 'canceled' but not deleted, immediately delete crawl object and begin finalizing. --------- Co-authored-by: Tessa Walsh <tessa@bitarchivist.net> |
||
|---|---|---|
| .. | ||
| migrations | ||
| __init__.py | ||
| auth.py | ||
| background_jobs.py | ||
| basecrawls.py | ||
| colls.py | ||
| crawlconfigs.py | ||
| crawlmanager.py | ||
| crawls.py | ||
| db.py | ||
| emailsender.py | ||
| invites.py | ||
| k8sapi.py | ||
| main_op.py | ||
| main.py | ||
| models.py | ||
| operator.py | ||
| orgs.py | ||
| pagination.py | ||
| profiles.py | ||
| storages.py | ||
| uploads.py | ||
| users.py | ||
| utils.py | ||
| version.py | ||
| webhooks.py | ||
| zip.py | ||