browsertrix/backend/test
Ilya Kreymer 8ea16393c5
Optimize single-page crawl workflows (#2656)
For single page crawls:
- Always force 1 browser to be used, ignoring browser windows/scale
setting
- Don't use custom PVC volumes in crawler / redis, just use emptyDir -
no chance of crawler being interrupted and restarted on different
machine for a single page.

Adds a 'is_single_page' check to CrawlConfig, checking for either limit
or scopeType / no extra hops.

Fixes #2655
2025-06-10 12:13:57 -07:00
..
data
__init__.py
conftest.py Optimize single-page crawl workflows (#2656) 2025-06-10 12:13:57 -07:00
echo_server.py
test_api.py Allow users to run crawls with 1 or 2 browser windows (#2627) 2025-06-03 13:37:30 -07:00
test_collections.py remove deleted collections from crawlconfigs (#2615) 2025-05-20 18:38:40 -07:00
test_crawl_config_search_values.py
test_crawl_config_tags.py
test_crawlconfigs.py Optimize single-page crawl workflows (#2656) 2025-06-10 12:13:57 -07:00
test_filter_sort_results.py Optimize single-page crawl workflows (#2656) 2025-06-10 12:13:57 -07:00
test_login.py
test_org_subs.py Add API endpoint to check if subscription is activated (#2582) 2025-05-06 17:36:58 -07:00
test_org.py Add ISO-639-1 language code validation to backend (#2602) 2025-05-13 16:54:33 -04:00
test_permissions.py
test_profiles.py
test_qa.py Calculate total for crawl QA page endpoint (#2435) 2025-02-27 11:46:35 -08:00
test_run_crawl.py Allow users to run crawls with 1 or 2 browser windows (#2627) 2025-06-03 13:37:30 -07:00
test_stop_cancel_crawl.py
test_uploads.py Add behavior logs from Redis to database and add endpoint to serve (#2526) 2025-04-08 02:16:10 +02:00
test_users.py Fix user emails use userout (#2511) 2025-03-24 12:04:39 -07:00
test_utils.py
test_webhooks.py Better cacheing of presigned URLs + support for thumbnails (#2446) 2025-03-03 12:05:23 -08:00
test_workflow_auto_add_to_collection.py remove deleted collections from crawlconfigs (#2615) 2025-05-20 18:38:40 -07:00
test_y_org_import_export.py
test_z_delete_org.py
utils.py