tea/browsertrix
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
da19691184
browsertrix/backend/btrixcloud
History
Tessa Walsh da19691184
Add crawl errors incrementally during crawl (#1561) 
Fixes #1558 

- Adds crawl errors to database incrementally during crawl rather than
after crawl completes
- Simplifies crawl /errors API endpoint to always return errors from
database
2024-02-29 09:16:34 -08:00
..
migrations Add crawl pages and related API endpoints (#1516) 2024-02-28 12:11:35 -05:00
__init__.py
auth.py Additional Type Hints / Type Fix Pass (#1320) 2023-10-30 12:59:24 -04:00
background_jobs.py Format backend with Black 24 (#1507) 2024-02-07 11:35:34 -08:00
basecrawls.py Add crawl pages and related API endpoints (#1516) 2024-02-28 12:11:35 -05:00
colls.py Format backend with Black 24 (#1507) 2024-02-07 11:35:34 -08:00
crawlconfigs.py More friendly WARC prefix inside WACZ based on Org slug + Crawl Name / First Seed URL. (#1537) 2024-02-22 23:54:23 -08:00
crawlmanager.py More friendly WARC prefix inside WACZ based on Org slug + Crawl Name / First Seed URL. (#1537) 2024-02-22 23:54:23 -08:00
crawls.py Add crawl errors incrementally during crawl (#1561) 2024-02-29 09:16:34 -08:00
db.py Add crawl pages and related API endpoints (#1516) 2024-02-28 12:11:35 -05:00
emailsender.py Email Templates (#1375) 2023-11-15 15:22:12 -08:00
invites.py Email Templates (#1375) 2023-11-15 15:22:12 -08:00
k8sapi.py More friendly WARC prefix inside WACZ based on Org slug + Crawl Name / First Seed URL. (#1537) 2024-02-22 23:54:23 -08:00
main_op.py Add crawl pages and related API endpoints (#1516) 2024-02-28 12:11:35 -05:00
main.py Increase startup probe time to account for long-running migrations (#1560) 2024-02-28 14:22:33 -08:00
models.py Add crawl pages and related API endpoints (#1516) 2024-02-28 12:11:35 -05:00
operator.py Add crawl errors incrementally during crawl (#1561) 2024-02-29 09:16:34 -08:00
orgs.py Format backend with Black 24 (#1507) 2024-02-07 11:35:34 -08:00
pages.py Add crawl pages and related API endpoints (#1516) 2024-02-28 12:11:35 -05:00
pagination.py Format backend with Black 24 (#1507) 2024-02-07 11:35:34 -08:00
profiles.py Support multiple crawler versions (#1420) 2024-01-16 15:32:12 -08:00
storages.py Add crawl pages and related API endpoints (#1516) 2024-02-28 12:11:35 -05:00
uploads.py Background Jobs Work (#1321) 2023-11-02 13:02:17 -07:00
users.py Add API endpoints for crawl statistics (#1461) 2024-01-10 13:30:47 -08:00
utils.py Add crawl pages and related API endpoints (#1516) 2024-02-28 12:11:35 -05:00
version.py version: bump to 1.10.0-beta.0 2024-02-20 00:22:29 -08:00
webhooks.py Add crawl, upload, and collection delete webhook event notifications (#1363) 2023-11-09 18:19:08 -08:00
zip.py Add crawl pages and related API endpoints (#1516) 2024-02-28 12:11:35 -05:00