cb50c7c2c2
- add 'pause' crawl state (fixes #2567) - gracefully shut down crawler pods, and then redis pod when paused - crawler uploads WACZ before shutting down (dependent on webrecorder/browsertrix-crawler#824, supported in 1.6.1+) - add 'paused_at' on crawl spec to indicate when crawl is paused - support max pause time limit, after which crawl becomes automatically stopped. - add 'stopped_pause_expired' when pause automatically expires and crawl is stopped - /crawl/<id>/{pause,resume} apis to toggle 'paused' on crawl spec - ui: add pause/resume button, paused state (partially addresses #2568) - ui: add pausing/resuming derivative states when crawl is running and pausing, or paused and not pausing (partially addresses #2569) - Designed to work with crawler 1.6.1+ which support pausing + uploading on pause Work on #2566, Fixes #2576 --------- Co-authored-by: sua yoo <sua@webrecorder.org> Co-authored-by: Tessa Walsh <tessa@bitarchivist.net> Co-authored-by: sua yoo <sua@suayoo.com> |
||
|---|---|---|
| .. | ||
| data | ||
| __init__.py | ||
| conftest.py | ||
| echo_server.py | ||
| test_api.py | ||
| test_collections.py | ||
| test_crawl_config_search_values.py | ||
| test_crawl_config_tags.py | ||
| test_crawlconfigs.py | ||
| test_filter_sort_results.py | ||
| test_login.py | ||
| test_org_subs.py | ||
| test_org.py | ||
| test_permissions.py | ||
| test_profiles.py | ||
| test_qa.py | ||
| test_run_crawl.py | ||
| test_stop_cancel_crawl.py | ||
| test_uploads.py | ||
| test_users.py | ||
| test_utils.py | ||
| test_webhooks.py | ||
| test_workflow_auto_add_to_collection.py | ||
| test_y_org_import_export.py | ||
| test_z_delete_org.py | ||
| utils.py | ||