- supported in both docker and k8s - additional pods with same job id automatically use same crawl state in redis - support dynamic scaling (#2) via /scale endpoint - k8s job parallelism adjusted dynamically for running job (only supported in k8s so far) |
||
---|---|---|
.. | ||
templates | ||
.helmignore | ||
Chart.yaml | ||
values.yaml |