Set crawl-stop in redis from operator when crawl is stopped (#815)

Change redis to <crawl-id>:crawl-stop to match webrecorder/browsertrix-crawler#303
This commit is contained in:
Tessa Walsh 2023-05-05 14:34:24 -04:00 committed by GitHub
parent 8aac6ccb6a
commit 774ae518f4
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

View File

@ -364,7 +364,7 @@ class BtrixOperator(K8sAPI):
)
if crawl.stopping:
await redis.set(f"{crawl.id}:stopping", "1")
await redis.set(f"{crawl.id}:crawl-stop", "1")
# optimization: don't update db once crawl is already running
# will set stats at when crawl is finished, otherwise can read