dfba4b3940
- Adds two new crawl finished state, stopped_by_user and stopped_quota_reached - Tracking other possible 'stop reasons' in operator, though not making them distinct states for now. - Updated frontend with 'Stopped by User' and 'Stopped: Time Quota Reached', shown with same icon as current partial_complete - Added migration of partial_complete to either stopped_by_user or complete (no historical quota data available) - Addresses edge case in scaling: if crawl never scaled (no redis entry, no pod), automatically scale down - Edge case in status: if crawl is somehow 'canceled' but not deleted, immediately delete crawl object and begin finalizing. --------- Co-authored-by: Tessa Walsh <tessa@bitarchivist.net> |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| migration_0001_archives_to_orgs.py | ||
| migration_0002_crawlconfig_crawlstats.py | ||
| migration_0003_mutable_crawl_configs.py | ||
| migration_0004_config_seeds.py | ||
| migration_0005_operator_scheduled_jobs.py | ||
| migration_0006_precompute_crawl_stats.py | ||
| migration_0007_colls_and_config_update.py | ||
| migration_0008_precompute_crawl_file_stats.py | ||
| migration_0009_crawl_types.py | ||
| migration_0010_collection_total_size.py | ||
| migration_0011_crawl_timeout_configmap.py | ||
| migration_0012_notes_to_description.py | ||
| migration_0013_crawl_name.py | ||
| migration_0014_to_collection_ids.py | ||
| migration_0015_org_storage_usage.py | ||
| migration_0016_operator_scheduled_jobs_v2.py | ||
| migration_0017_storage_by_type.py | ||
| migration_0018_usernames.py | ||
| migration_0019_org_slug.py | ||
| migration_0020_org_storage_refs.py | ||
| migration_0021_profile_filenames.py | ||
| migration_0022_partial_complete.py | ||