browsertrix/backend/btrixcloud
Tessa Walsh da19691184
Add crawl errors incrementally during crawl (#1561)
Fixes #1558 

- Adds crawl errors to database incrementally during crawl rather than
after crawl completes
- Simplifies crawl /errors API endpoint to always return errors from
database
2024-02-29 09:16:34 -08:00
..
migrations Add crawl pages and related API endpoints (#1516) 2024-02-28 12:11:35 -05:00
__init__.py
auth.py
background_jobs.py Format backend with Black 24 (#1507) 2024-02-07 11:35:34 -08:00
basecrawls.py Add crawl pages and related API endpoints (#1516) 2024-02-28 12:11:35 -05:00
colls.py Format backend with Black 24 (#1507) 2024-02-07 11:35:34 -08:00
crawlconfigs.py More friendly WARC prefix inside WACZ based on Org slug + Crawl Name / First Seed URL. (#1537) 2024-02-22 23:54:23 -08:00
crawlmanager.py More friendly WARC prefix inside WACZ based on Org slug + Crawl Name / First Seed URL. (#1537) 2024-02-22 23:54:23 -08:00
crawls.py Add crawl errors incrementally during crawl (#1561) 2024-02-29 09:16:34 -08:00
db.py Add crawl pages and related API endpoints (#1516) 2024-02-28 12:11:35 -05:00
emailsender.py
invites.py
k8sapi.py More friendly WARC prefix inside WACZ based on Org slug + Crawl Name / First Seed URL. (#1537) 2024-02-22 23:54:23 -08:00
main_op.py Add crawl pages and related API endpoints (#1516) 2024-02-28 12:11:35 -05:00
main.py Increase startup probe time to account for long-running migrations (#1560) 2024-02-28 14:22:33 -08:00
models.py Add crawl pages and related API endpoints (#1516) 2024-02-28 12:11:35 -05:00
operator.py Add crawl errors incrementally during crawl (#1561) 2024-02-29 09:16:34 -08:00
orgs.py Format backend with Black 24 (#1507) 2024-02-07 11:35:34 -08:00
pages.py Add crawl pages and related API endpoints (#1516) 2024-02-28 12:11:35 -05:00
pagination.py Format backend with Black 24 (#1507) 2024-02-07 11:35:34 -08:00
profiles.py Support multiple crawler versions (#1420) 2024-01-16 15:32:12 -08:00
storages.py Add crawl pages and related API endpoints (#1516) 2024-02-28 12:11:35 -05:00
uploads.py
users.py Add API endpoints for crawl statistics (#1461) 2024-01-10 13:30:47 -08:00
utils.py Add crawl pages and related API endpoints (#1516) 2024-02-28 12:11:35 -05:00
version.py version: bump to 1.10.0-beta.0 2024-02-20 00:22:29 -08:00
webhooks.py
zip.py Add crawl pages and related API endpoints (#1516) 2024-02-28 12:11:35 -05:00