- Adds two new crawl finished state, stopped_by_user and stopped_quota_reached - Tracking other possible 'stop reasons' in operator, though not making them distinct states for now. - Updated frontend with 'Stopped by User' and 'Stopped: Time Quota Reached', shown with same icon as current partial_complete - Added migration of partial_complete to either stopped_by_user or complete (no historical quota data available) - Addresses edge case in scaling: if crawl never scaled (no redis entry, no pod), automatically scale down - Edge case in status: if crawl is somehow 'canceled' but not deleted, immediately delete crawl object and begin finalizing. --------- Co-authored-by: Tessa Walsh <tessa@bitarchivist.net> |
||
|---|---|---|
| .. | ||
| data | ||
| __init__.py | ||
| conftest.py | ||
| echo_server.py | ||
| test_collections.py | ||
| test_crawl_config_search_values.py | ||
| test_crawl_config_tags.py | ||
| test_crawlconfigs.py | ||
| test_filter_sort_results.py | ||
| test_invites.py | ||
| test_login.py | ||
| test_org.py | ||
| test_permissions.py | ||
| test_run_crawl.py | ||
| test_settings.py | ||
| test_stop_cancel_crawl.py | ||
| test_uploads.py | ||
| test_users.py | ||
| test_utils.py | ||
| test_webhooks.py | ||
| test_workflow_auto_add_to_collection.py | ||
| utils.py | ||