browsertrix/backend
Ilya Kreymer 9bd402fa17
New WS Endpoint for Watching Crawl (#152)
* backend support for new watch system (#134):
- support for watch via redis pubsub and websocket connection to backend
- can support watch from any number of crawler instances to support scaled crawls
- use /archives/{aid}/crawls/{crawl_id}/watch/ws websocket endpoint
- ws: ignore graceful connectionclosedok exception, log other exceptions
- set logging to info to instead of debug for now (debug logs all ws traffic)
- remove old watch apis in backend
- remove old websocket routing to crawler instance for old watch system
- oauth bearer check: support websockets, use websocket object if no request object
- crawler args: replace --screencastPort with --screencastRedis
2022-02-22 10:33:10 -08:00
..
archives.py Support for setting scale in crawlconfig (#148) 2022-02-20 11:27:47 -08:00
colls.py Refactor backend data model to support UUID (fixes #118) (#119) 2022-01-29 19:00:11 -08:00
crawlconfigs.py backend: fix crawl config revision links (#149) 2022-02-21 16:51:27 -08:00
crawls.py New WS Endpoint for Watching Crawl (#152) 2022-02-22 10:33:10 -08:00
db.py Crawl Config Editing Support (#141) 2022-02-17 16:04:07 -08:00
Dockerfile New WS Endpoint for Watching Crawl (#152) 2022-02-22 10:33:10 -08:00
dockerman.py backend: use redis to mark crawls as canceled immediately, avoid dupes in crawl list (even if paging is added for db results) 2022-02-01 15:58:56 -08:00
emailsender.py Config superuser (#59) 2021-12-05 14:12:42 -08:00
invites.py Refactor backend data model to support UUID (fixes #118) (#119) 2022-01-29 19:00:11 -08:00
k8sman.py New WS Endpoint for Watching Crawl (#152) 2022-02-22 10:33:10 -08:00
main.py Crawl Config Editing Support (#141) 2022-02-17 16:04:07 -08:00
requirements.txt New WS Endpoint for Watching Crawl (#152) 2022-02-22 10:33:10 -08:00
scheduler.py Misc backend fixes (#133) 2022-01-31 19:41:04 -08:00
storages.py Misc backend fixes (#133) 2022-01-31 19:41:04 -08:00
users.py New WS Endpoint for Watching Crawl (#152) 2022-02-22 10:33:10 -08:00