dfba4b3940
- Adds two new crawl finished state, stopped_by_user and stopped_quota_reached - Tracking other possible 'stop reasons' in operator, though not making them distinct states for now. - Updated frontend with 'Stopped by User' and 'Stopped: Time Quota Reached', shown with same icon as current partial_complete - Added migration of partial_complete to either stopped_by_user or complete (no historical quota data available) - Addresses edge case in scaling: if crawl never scaled (no redis entry, no pod), automatically scale down - Edge case in status: if crawl is somehow 'canceled' but not deleted, immediately delete crawl object and begin finalizing. --------- Co-authored-by: Tessa Walsh <tessa@bitarchivist.net> |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| conftest.py | ||
| test_concurrent_crawl_limit.py | ||
| test_crawl_errors.py | ||
| test_crawl_logs.py | ||
| test_crawl_timeout.py | ||
| test_crawlconfig_crawl_stats.py | ||
| test_delete_crawls.py | ||
| test_execution_minutes_quota.py | ||
| test_invite_expiration.py | ||
| test_max_crawl_size_limit.py | ||
| test_upload_replicas.py | ||
| test_z_background_jobs.py | ||
| utils.py | ||