browsertrix/chart/app-templates
Ilya Kreymer cb50c7c2c2
Pause / Resume Crawls Initial Implmentation. (#2572)
- add 'pause' crawl state (fixes #2567)
- gracefully shut down crawler pods, and then redis pod when paused
- crawler uploads WACZ before shutting down (dependent on
webrecorder/browsertrix-crawler#824, supported in 1.6.1+)
- add 'paused_at' on crawl spec to indicate when crawl is paused
- support max pause time limit, after which crawl becomes automatically
stopped.
- add 'stopped_pause_expired' when pause automatically expires and crawl
is stopped
- /crawl/<id>/{pause,resume} apis to toggle 'paused' on crawl spec
- ui: add pause/resume button, paused state (partially addresses #2568)
- ui: add pausing/resuming derivative states when crawl is running and
pausing, or paused and not pausing (partially addresses #2569)
- Designed to work with crawler 1.6.1+ which support pausing + uploading on pause

Work on #2566, Fixes #2576 

---------
Co-authored-by: sua yoo <sua@webrecorder.org>
Co-authored-by: Tessa Walsh <tessa@bitarchivist.net>
Co-authored-by: sua yoo <sua@suayoo.com>
2025-05-21 14:05:16 -07:00
..
background_job.yaml Consolidate list page endpoints + better QA sorting + optimize pages fix (#2417) 2025-02-21 13:47:20 -08:00
crawl_configmap.yaml Remove Crawl Workflow Configmaps (#1894) 2024-06-28 15:25:23 -07:00
crawl_cron_job.yaml Remove Crawl Workflow Configmaps (#1894) 2024-06-28 15:25:23 -07:00
crawl_job.yaml Pause / Resume Crawls Initial Implmentation. (#2572) 2025-05-21 14:05:16 -07:00
crawler.yaml Pause / Resume Crawls Initial Implmentation. (#2572) 2025-05-21 14:05:16 -07:00
profile_job.yaml support overriding crawler image pull policy per channel (#2523) 2025-03-31 14:11:41 -07:00
profilebrowser.yaml Configure browsertrix proxies (#1847) 2024-10-02 18:35:45 -07:00
qa_configmap.yaml include workflow config in QA runs + different browser instances for QA (#1829) 2024-05-29 13:32:25 -07:00
redis.yaml Move backend app templates to be installed from configmap volume (#1331) 2023-11-06 09:37:48 -08:00
replica_deletion_cron_job.yaml Optionally delay replica deletion (#2252) 2024-12-19 18:50:28 -08:00
replica_job.yaml QA Runs Initial Backend Implementation (#1586) 2024-03-20 22:42:16 -07:00