tea/browsertrix
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
74324cdab4
browsertrix/backend/btrixcloud
History
Tessa Walsh 0c8c397fca
Add option to fail crawl if not logged in (#2754) 
This PR adds a new checkbox to both page and seed crawl workflow types,
which will fail the crawl if behaviors detect the browser is not logged
in for supported sites.

Changes include:

- Backend support for the new crawler flag
- A new `failed_not_logged_in` crawl state
- Checkbox workflow editor and config details in the frontend (currently
in the Scope section - I think it makes sense to have this option up
front, but worth considering)
- User Guide documentation of new option
- A new nightly test for the new workflow option and
`failed_not_logged_in` state


---------
Co-authored-by: Ilya Kreymer <ikreymer@gmail.com>
Co-authored-by: sua yoo <sua@webrecorder.org>
2025-07-28 22:58:43 -07:00
..
migrations Add seed file support to Browsertrix backend (#2710) 2025-07-22 19:11:02 -07:00
operator Add option to fail crawl if not logged in (#2754) 2025-07-28 22:58:43 -07:00
__init__.py
auth.py fixes token lifetime bug / improve security (#2490) 2025-03-19 10:07:09 -07:00
background_jobs.py Add seed file support to Browsertrix backend (#2710) 2025-07-22 19:11:02 -07:00
basecrawls.py Add seed file support to Browsertrix backend (#2710) 2025-07-22 19:11:02 -07:00
colls.py Add seed file support to Browsertrix backend (#2710) 2025-07-22 19:11:02 -07:00
crawlconfigs.py Add last crawl's stats object to CrawlConfigOut (#2714) 2025-07-23 20:10:46 -07:00
crawlmanager.py Add seed file support to Browsertrix backend (#2710) 2025-07-22 19:11:02 -07:00
crawls.py Add seed file support to Browsertrix backend (#2710) 2025-07-22 19:11:02 -07:00
db.py Add seed file support to Browsertrix backend (#2710) 2025-07-22 19:11:02 -07:00
emailsender.py Rework crawl page migration + MongoDB Query Optimizations (#2412) 2025-02-20 15:26:11 -08:00
file_uploads.py Add seed file support to Browsertrix backend (#2710) 2025-07-22 19:11:02 -07:00
invites.py
k8sapi.py Add seed file support to Browsertrix backend (#2710) 2025-07-22 19:11:02 -07:00
main_bg.py Add seed file support to Browsertrix backend (#2710) 2025-07-22 19:11:02 -07:00
main_migrations.py Add seed file support to Browsertrix backend (#2710) 2025-07-22 19:11:02 -07:00
main_op.py Add seed file support to Browsertrix backend (#2710) 2025-07-22 19:11:02 -07:00
main.py Add seed file support to Browsertrix backend (#2710) 2025-07-22 19:11:02 -07:00
models.py Add option to fail crawl if not logged in (#2754) 2025-07-28 22:58:43 -07:00
ops.py Add seed file support to Browsertrix backend (#2710) 2025-07-22 19:11:02 -07:00
orgs.py Add seed file support to Browsertrix backend (#2710) 2025-07-22 19:11:02 -07:00
pages.py Add Org Check for Collection access (#2616) 2025-05-20 15:30:22 -07:00
pagination.py
profiles.py Profiles: Make browser commit API call idempotent (#2728) 2025-07-22 17:59:49 -07:00
storages.py Add seed file support to Browsertrix backend (#2710) 2025-07-22 19:11:02 -07:00
subs.py Add API endpoint to check if subscription is activated (#2582) 2025-05-06 17:36:58 -07:00
uploads.py Ensure replay.json returns correct origin for pagesQueryUrl (#2741) 2025-07-16 10:48:24 -07:00
users.py Fix user emails use userout (#2511) 2025-03-24 12:04:39 -07:00
utils.py Ensure replay.json returns correct origin for pagesQueryUrl (#2741) 2025-07-16 10:48:24 -07:00
version.py version: bump to 1.18.0 2025-07-22 21:21:24 -07:00
webhooks.py Better cacheing of presigned URLs + support for thumbnails (#2446) 2025-03-03 12:05:23 -08:00