browsertrix/backend
Tessa Walsh 6b19f72a89
Add crawl errors endpoint (#757)
* Add crawl errors endpoint

If this endpoint is called while the crawl is running, errors are
pulled directly from redis.

If this endpoint is called when the crawl is finished, errors are
pulled from mongodb, where they're written when crawls complete.

* Add nightly backend test for errors endpoint

* Add errors for failed and cancelled crawls to mongo

Co-authored-by: Ilya Kreymer <ikreymer@users.noreply.github.com>
2023-04-17 12:59:25 -04:00
..
btrixcloud Add crawl errors endpoint (#757) 2023-04-17 12:59:25 -04:00
test Update collections backend API (#759) 2023-04-14 12:17:18 -04:00
test_nightly Add crawl errors endpoint (#757) 2023-04-17 12:59:25 -04:00
.pylintrc quickfix: pydantic / lint fix (#452) 2023-01-10 18:54:11 -08:00
Dockerfile Remove Code and Configs for Swarm/podman support (#407) 2022-12-08 18:19:58 -08:00
requirements.txt Filter and sort crawl and workflow list API endpoints in backend (#724) 2023-03-28 17:55:40 -04:00