browsertrix/backend
Tessa Walsh 6b19f72a89
Add crawl errors endpoint (#757)
* Add crawl errors endpoint

If this endpoint is called while the crawl is running, errors are
pulled directly from redis.

If this endpoint is called when the crawl is finished, errors are
pulled from mongodb, where they're written when crawls complete.

* Add nightly backend test for errors endpoint

* Add errors for failed and cancelled crawls to mongo

Co-authored-by: Ilya Kreymer <ikreymer@users.noreply.github.com>
2023-04-17 12:59:25 -04:00
..
btrixcloud Add crawl errors endpoint (#757) 2023-04-17 12:59:25 -04:00
test Update collections backend API (#759) 2023-04-14 12:17:18 -04:00
test_nightly Add crawl errors endpoint (#757) 2023-04-17 12:59:25 -04:00
.pylintrc
Dockerfile
requirements.txt