- Adds two new crawl finished state, stopped_by_user and stopped_quota_reached - Tracking other possible 'stop reasons' in operator, though not making them distinct states for now. - Updated frontend with 'Stopped by User' and 'Stopped: Time Quota Reached', shown with same icon as current partial_complete - Added migration of partial_complete to either stopped_by_user or complete (no historical quota data available) - Addresses edge case in scaling: if crawl never scaled (no redis entry, no pod), automatically scale down - Edge case in status: if crawl is somehow 'canceled' but not deleted, immediately delete crawl object and begin finalizing. --------- Co-authored-by: Tessa Walsh <tessa@bitarchivist.net> |
||
---|---|---|
.. | ||
migrations | ||
__init__.py | ||
auth.py | ||
background_jobs.py | ||
basecrawls.py | ||
colls.py | ||
crawlconfigs.py | ||
crawlmanager.py | ||
crawls.py | ||
db.py | ||
emailsender.py | ||
invites.py | ||
k8sapi.py | ||
main_op.py | ||
main.py | ||
models.py | ||
operator.py | ||
orgs.py | ||
pagination.py | ||
profiles.py | ||
storages.py | ||
uploads.py | ||
users.py | ||
utils.py | ||
version.py | ||
webhooks.py | ||
zip.py |